[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:04:52.300310 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:39391
I20260709 13:04:52.301968 14516 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:04:52.303006 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:52.321508 14525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:52.321453 14523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:52.322697 14516 server_base.cc:1061] running on GCE node
W20260709 13:04:52.321480 14522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.534245 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.534534 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.534708 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602293534688 us; error 0 us; skew 500 ppm
I20260709 13:04:53.535579 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.542912 14516 webserver.cc:533] Webserver started at http://127.14.45.62:39793/ using document root <none> and password file <none>
I20260709 13:04:53.543853 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.544087 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.544519 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.551077 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "f3a5097a1fe7468e8410bb5d26386bcf"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-lfdf"
I20260709 13:04:53.559960 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:53.565668 14531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.567148 14516 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:04:53.567629 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "f3a5097a1fe7468e8410bb5d26386bcf"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-lfdf"
I20260709 13:04:53.568033 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.635692 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.637730 14516 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:04:53.638480 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.718744 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:39391
I20260709 13:04:53.718966 14582 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:39391 every 8 connection(s)
I20260709 13:04:53.728446 14583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.751200 14583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf: Bootstrap starting.
I20260709 13:04:53.757246 14583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.759153 14583 log.cc:826] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf: Log is configured to *not* fsync() on all Append() calls
I20260709 13:04:53.764022 14583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf: No bootstrap required, opened a new log
I20260709 13:04:53.784675 14583 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" member_type: VOTER }
I20260709 13:04:53.785382 14583 raft_consensus.cc:385] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.785624 14583 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a5097a1fe7468e8410bb5d26386bcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.786651 14583 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" member_type: VOTER }
I20260709 13:04:53.787150 14583 raft_consensus.cc:399] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:53.787397 14583 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:53.787691 14583 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.792318 14583 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" member_type: VOTER }
I20260709 13:04:53.793087 14583 leader_election.cc:304] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3a5097a1fe7468e8410bb5d26386bcf; no voters: 
I20260709 13:04:53.794799 14583 leader_election.cc:290] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:53.795241 14586 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.797950 14586 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 1 LEADER]: Becoming Leader. State: Replica: f3a5097a1fe7468e8410bb5d26386bcf, State: Running, Role: LEADER
I20260709 13:04:53.798858 14586 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" member_type: VOTER }
I20260709 13:04:53.799453 14583 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:53.812192 14587 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" member_type: VOTER } }
I20260709 13:04:53.813217 14587 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:53.815321 14588 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3a5097a1fe7468e8410bb5d26386bcf. Latest consensus state: current_term: 1 leader_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3a5097a1fe7468e8410bb5d26386bcf" member_type: VOTER } }
I20260709 13:04:53.815763 14588 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:53.819656 14596 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:53.831234 14596 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:53.833861 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:53.849947 14596 catalog_manager.cc:1383] Generated new cluster ID: 8bc84094c23e4d779199b185c314972a
I20260709 13:04:53.850488 14596 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:53.873178 14596 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:53.874826 14596 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:53.892903 14596 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf: Generated new TSK 0
I20260709 13:04:53.894071 14596 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:53.900518 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.909368 14605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.910688 14606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.914748 14516 server_base.cc:1061] running on GCE node
W20260709 13:04:53.914750 14608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.915890 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.916095 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.916319 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602293916286 us; error 0 us; skew 500 ppm
I20260709 13:04:53.916952 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.921635 14516 webserver.cc:533] Webserver started at http://127.14.45.1:39115/ using document root <none> and password file <none>
I20260709 13:04:53.922251 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.922466 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.922783 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.923950 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "5ad8512299ad481db24142e6102a8303"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-lfdf"
I20260709 13:04:53.930043 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:53.934283 14613 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.935153 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:53.935458 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "5ad8512299ad481db24142e6102a8303"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-lfdf"
I20260709 13:04:53.935793 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.957121 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.958572 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.961378 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.965597 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.965898 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:53.966174 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.966361 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.073240 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:44801
I20260709 13:04:54.073401 14675 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:44801 every 8 connection(s)
I20260709 13:04:54.080713 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:54.092984 14681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.096272 14680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.099242 14516 server_base.cc:1061] running on GCE node
W20260709 13:04:54.100962 14683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.102123 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:54.102370 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:54.102599 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602294102581 us; error 0 us; skew 500 ppm
I20260709 13:04:54.103179 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.106140 14516 webserver.cc:533] Webserver started at http://127.14.45.2:42119/ using document root <none> and password file <none>
I20260709 13:04:54.106714 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.106918 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.107220 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.108310 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "033717497dd94121afdf5a1b6ef37d0a"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-lfdf"
I20260709 13:04:54.114234 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:04:54.119313 14688 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.120486 14516 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:54.120927 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "033717497dd94121afdf5a1b6ef37d0a"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-lfdf"
I20260709 13:04:54.121306 14676 heartbeater.cc:344] Connected to a master server at 127.14.45.62:39391
I20260709 13:04:54.121281 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.121840 14676 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:54.123073 14676 heartbeater.cc:507] Master 127.14.45.62:39391 requested a full tablet report, sending...
I20260709 13:04:54.127182 14548 ts_manager.cc:194] Registered new tserver with Master: 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801)
I20260709 13:04:54.130951 14548 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49308
I20260709 13:04:54.163228 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.164609 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.167428 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:54.170585 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:54.170782 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.171101 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:54.171245 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.272086 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:46607
I20260709 13:04:54.272333 14750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:46607 every 8 connection(s)
I20260709 13:04:54.280936 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:54.289698 14754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.290979 14755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.294569 14751 heartbeater.cc:344] Connected to a master server at 127.14.45.62:39391
I20260709 13:04:54.295123 14751 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:54.296296 14751 heartbeater.cc:507] Master 127.14.45.62:39391 requested a full tablet report, sending...
I20260709 13:04:54.297188 14516 server_base.cc:1061] running on GCE node
W20260709 13:04:54.297317 14758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.298646 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:54.298888 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:54.298929 14548 ts_manager.cc:194] Registered new tserver with Master: 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:54.299141 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602294299118 us; error 0 us; skew 500 ppm
I20260709 13:04:54.299762 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.300756 14548 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49320
I20260709 13:04:54.303287 14516 webserver.cc:533] Webserver started at http://127.14.45.3:36421/ using document root <none> and password file <none>
I20260709 13:04:54.303857 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.304064 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.304337 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.305526 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "d436f97319e54eb691e869c30bb7d69d"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-lfdf"
I20260709 13:04:54.310846 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:54.314903 14762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.315869 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:04:54.316246 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "d436f97319e54eb691e869c30bb7d69d"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-lfdf"
I20260709 13:04:54.316643 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.331758 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.333122 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.335482 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:54.337781 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:54.338038 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:54.338308 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:54.338485 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.431005 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:38809
I20260709 13:04:54.431095 14824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:38809 every 8 connection(s)
I20260709 13:04:54.447052 14825 heartbeater.cc:344] Connected to a master server at 127.14.45.62:39391
I20260709 13:04:54.447513 14825 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:54.448303 14825 heartbeater.cc:507] Master 127.14.45.62:39391 requested a full tablet report, sending...
I20260709 13:04:54.450661 14548 ts_manager.cc:194] Registered new tserver with Master: d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:54.451141 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015905711s
I20260709 13:04:54.452718 14548 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49336
I20260709 13:04:54.516520 14548 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49340:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:54.521766 14548 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:54.666668 14790 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4f064fc9274a90b38698e67d5b0394 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.667795 14715 tablet_service.cc:1511] Processing CreateTablet for tablet 33111a18661448e292808d2c81bf5f12 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.660529 14714 tablet_service.cc:1511] Processing CreateTablet for tablet e557604675fb4fd0826a11cd44ab3325 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.660809 14713 tablet_service.cc:1511] Processing CreateTablet for tablet 9744f1796ee44238b0d2b0b6293c76f1 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.669400 14716 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4f064fc9274a90b38698e67d5b0394 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.672142 14712 tablet_service.cc:1511] Processing CreateTablet for tablet b9799d62a65b4a3d84d5a8d140a61720 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.666682 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 33111a18661448e292808d2c81bf5f12 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.676234 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4f064fc9274a90b38698e67d5b0394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.680094 14786 tablet_service.cc:1511] Processing CreateTablet for tablet b9799d62a65b4a3d84d5a8d140a61720 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.679241 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e557604675fb4fd0826a11cd44ab3325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.683744 14790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4f064fc9274a90b38698e67d5b0394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.685031 14787 tablet_service.cc:1511] Processing CreateTablet for tablet 9744f1796ee44238b0d2b0b6293c76f1 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.675325 14788 tablet_service.cc:1511] Processing CreateTablet for tablet e557604675fb4fd0826a11cd44ab3325 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.689244 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9799d62a65b4a3d84d5a8d140a61720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.690138 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9799d62a65b4a3d84d5a8d140a61720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.691937 14787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9744f1796ee44238b0d2b0b6293c76f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.693939 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e557604675fb4fd0826a11cd44ab3325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.693876 14711 tablet_service.cc:1511] Processing CreateTablet for tablet ccc46b1749694686ab473319f66201c1 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.696233 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9744f1796ee44238b0d2b0b6293c76f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.697479 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc46b1749694686ab473319f66201c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.698200 14785 tablet_service.cc:1511] Processing CreateTablet for tablet ccc46b1749694686ab473319f66201c1 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.700822 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc46b1749694686ab473319f66201c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.702991 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33111a18661448e292808d2c81bf5f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.708338 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33111a18661448e292808d2c81bf5f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.718675 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4f064fc9274a90b38698e67d5b0394 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.731372 14639 tablet_service.cc:1511] Processing CreateTablet for tablet e557604675fb4fd0826a11cd44ab3325 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.732226 14640 tablet_service.cc:1511] Processing CreateTablet for tablet 33111a18661448e292808d2c81bf5f12 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.752336 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4f064fc9274a90b38698e67d5b0394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.753247 14636 tablet_service.cc:1511] Processing CreateTablet for tablet ccc46b1749694686ab473319f66201c1 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.732352 14710 tablet_service.cc:1511] Processing CreateTablet for tablet 44dd8495bd184c88bba4dd3a22472dbd (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.754052 14638 tablet_service.cc:1511] Processing CreateTablet for tablet 9744f1796ee44238b0d2b0b6293c76f1 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.769960 14710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dd8495bd184c88bba4dd3a22472dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.750746 14637 tablet_service.cc:1511] Processing CreateTablet for tablet b9799d62a65b4a3d84d5a8d140a61720 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.781144 14635 tablet_service.cc:1511] Processing CreateTablet for tablet 44dd8495bd184c88bba4dd3a22472dbd (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.782650 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33111a18661448e292808d2c81bf5f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.786736 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc46b1749694686ab473319f66201c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.797256 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e557604675fb4fd0826a11cd44ab3325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.799861 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9744f1796ee44238b0d2b0b6293c76f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.801785 14635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dd8495bd184c88bba4dd3a22472dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.804177 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9799d62a65b4a3d84d5a8d140a61720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.811230 14784 tablet_service.cc:1511] Processing CreateTablet for tablet 44dd8495bd184c88bba4dd3a22472dbd (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.824137 14784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dd8495bd184c88bba4dd3a22472dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.827912 14634 tablet_service.cc:1511] Processing CreateTablet for tablet d6c81c94872e418d849dd0ab9b45625b (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.845274 14634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c81c94872e418d849dd0ab9b45625b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:54.859664 14595 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:54.864755 14709 tablet_service.cc:1511] Processing CreateTablet for tablet d6c81c94872e418d849dd0ab9b45625b (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.866324 14709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c81c94872e418d849dd0ab9b45625b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.880291 14633 tablet_service.cc:1511] Processing CreateTablet for tablet e30396e20ca74b4ea691bcabf475c249 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.882652 14633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30396e20ca74b4ea691bcabf475c249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.877626 14783 tablet_service.cc:1511] Processing CreateTablet for tablet d6c81c94872e418d849dd0ab9b45625b (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.892693 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c81c94872e418d849dd0ab9b45625b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.940980 14708 tablet_service.cc:1511] Processing CreateTablet for tablet e30396e20ca74b4ea691bcabf475c249 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.944756 14708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30396e20ca74b4ea691bcabf475c249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.950997 14782 tablet_service.cc:1511] Processing CreateTablet for tablet e30396e20ca74b4ea691bcabf475c249 (DEFAULT_TABLE table=test-workload [id=c6e0f291837e45bf98eee1aaec39fccd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.954183 14782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30396e20ca74b4ea691bcabf475c249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.963110 14843 tablet_bootstrap.cc:492] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.004218 14844 tablet_bootstrap.cc:492] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.024853 14845 tablet_bootstrap.cc:492] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.031656 14843 tablet_bootstrap.cc:654] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.046993 14845 tablet_bootstrap.cc:654] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.052482 14844 tablet_bootstrap.cc:654] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.054623 14845 tablet_bootstrap.cc:492] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.055174 14845 ts_tablet_manager.cc:1403] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.031s	user 0.003s	sys 0.009s
I20260709 13:04:55.058831 14845 raft_consensus.cc:359] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.060086 14845 raft_consensus.cc:385] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.060421 14845 raft_consensus.cc:740] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.061851 14843 tablet_bootstrap.cc:492] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.061301 14845 consensus_queue.cc:260] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.062354 14843 ts_tablet_manager.cc:1403] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.137s	user 0.007s	sys 0.013s
I20260709 13:04:55.064136 14844 tablet_bootstrap.cc:492] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.064831 14844 ts_tablet_manager.cc:1403] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.087s	user 0.005s	sys 0.013s
I20260709 13:04:55.065348 14843 raft_consensus.cc:359] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.066169 14843 raft_consensus.cc:385] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.066483 14843 raft_consensus.cc:740] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.067368 14843 consensus_queue.cc:260] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.069777 14844 raft_consensus.cc:359] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.070981 14844 raft_consensus.cc:385] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.071525 14844 raft_consensus.cc:740] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.072723 14844 consensus_queue.cc:260] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.077606 14751 heartbeater.cc:499] Master 127.14.45.62:39391 was elected leader, sending a full tablet report...
I20260709 13:04:55.077988 14825 heartbeater.cc:499] Master 127.14.45.62:39391 was elected leader, sending a full tablet report...
I20260709 13:04:55.084115 14843 ts_tablet_manager.cc:1434] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:04:55.085913 14843 tablet_bootstrap.cc:492] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.084599 14845 ts_tablet_manager.cc:1434] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.029s	user 0.014s	sys 0.009s
I20260709 13:04:55.094719 14676 heartbeater.cc:499] Master 127.14.45.62:39391 was elected leader, sending a full tablet report...
I20260709 13:04:55.095974 14845 tablet_bootstrap.cc:492] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.099771 14844 ts_tablet_manager.cc:1434] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 13:04:55.093730 14843 tablet_bootstrap.cc:654] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.101012 14844 tablet_bootstrap.cc:492] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.108338 14845 tablet_bootstrap.cc:654] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.109110 14844 tablet_bootstrap.cc:654] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.117393 14845 tablet_bootstrap.cc:492] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.121093 14845 ts_tablet_manager.cc:1403] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.002s
I20260709 13:04:55.120491 14844 tablet_bootstrap.cc:492] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.123162 14844 ts_tablet_manager.cc:1403] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.012s
I20260709 13:04:55.126235 14844 raft_consensus.cc:359] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.127159 14844 raft_consensus.cc:385] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.129694 14844 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.130631 14844 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.131783 14851 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.128966 14845 raft_consensus.cc:359] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.132360 14851 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.134588 14843 tablet_bootstrap.cc:492] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.135172 14843 ts_tablet_manager.cc:1403] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.016s
I20260709 13:04:55.138751 14843 raft_consensus.cc:359] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.139659 14843 raft_consensus.cc:385] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.140059 14843 raft_consensus.cc:740] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.141026 14843 consensus_queue.cc:260] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.142974 14851 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.144060 14843 ts_tablet_manager.cc:1434] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:04:55.145484 14843 tablet_bootstrap.cc:492] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.132380 14845 raft_consensus.cc:385] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.145977 14845 raft_consensus.cc:740] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.146837 14845 consensus_queue.cc:260] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.154240 14844 ts_tablet_manager.cc:1434] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.031s	user 0.014s	sys 0.001s
I20260709 13:04:55.154755 14843 tablet_bootstrap.cc:654] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.155501 14844 tablet_bootstrap.cc:492] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.163699 14844 tablet_bootstrap.cc:654] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.173391 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
W20260709 13:04:55.176366 14616 leader_election.cc:343] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.178081 14850 raft_consensus.cc:493] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.178660 14850 raft_consensus.cc:515] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.181855 14850 leader_election.cc:290] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.184502 14845 ts_tablet_manager.cc:1434] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.004s
W20260709 13:04:55.192631 14826 tablet.cc:2406] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:55.195007 14843 tablet_bootstrap.cc:492] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.195509 14843 ts_tablet_manager.cc:1403] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.004s
I20260709 13:04:55.209533 14845 tablet_bootstrap.cc:492] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.206214 14843 raft_consensus.cc:359] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.211692 14843 raft_consensus.cc:385] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.212602 14843 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.213594 14843 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.217011 14843 ts_tablet_manager.cc:1434] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:04:55.222688 14843 tablet_bootstrap.cc:492] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.217710 14844 tablet_bootstrap.cc:492] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.226202 14844 ts_tablet_manager.cc:1403] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.008s
I20260709 13:04:55.226814 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
W20260709 13:04:55.228544 14690 leader_election.cc:343] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.229874 14844 raft_consensus.cc:359] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.230947 14844 raft_consensus.cc:385] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.233917 14844 raft_consensus.cc:740] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.234714 14844 consensus_queue.cc:260] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.238313 14843 tablet_bootstrap.cc:654] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.242029 14844 ts_tablet_manager.cc:1434] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:04:55.238453 14845 tablet_bootstrap.cc:654] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.243095 14844 tablet_bootstrap.cc:492] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.252601 14844 tablet_bootstrap.cc:654] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.254973 14855 raft_consensus.cc:493] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.258908 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.257567 14855 raft_consensus.cc:515] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.263998 14855 leader_election.cc:290] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
W20260709 13:04:55.262398 14615 leader_election.cc:343] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.265998 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:55.266397 14615 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ad8512299ad481db24142e6102a8303; no voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:55.267544 14843 tablet_bootstrap.cc:492] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.267584 14855 raft_consensus.cc:2749] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:55.267695 14616 leader_election.cc:343] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.268157 14843 ts_tablet_manager.cc:1403] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.011s
I20260709 13:04:55.269624 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.271450 14800 raft_consensus.cc:2468] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 0.
I20260709 13:04:55.273001 14845 tablet_bootstrap.cc:492] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.272806 14615 leader_election.cc:304] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 033717497dd94121afdf5a1b6ef37d0a
I20260709 13:04:55.273530 14845 ts_tablet_manager.cc:1403] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.001s
I20260709 13:04:55.276520 14855 raft_consensus.cc:2804] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.277170 14855 raft_consensus.cc:493] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.277717 14855 raft_consensus.cc:3060] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.278750 14843 raft_consensus.cc:359] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.280126 14843 raft_consensus.cc:385] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.281767 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.282928 14651 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.284822 14689 leader_election.cc:304] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:55.285789 14850 raft_consensus.cc:2804] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.286242 14850 raft_consensus.cc:493] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.286857 14850 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.286791 14845 raft_consensus.cc:359] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.284519 14843 raft_consensus.cc:740] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.289211 14843 consensus_queue.cc:260] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.288110 14845 raft_consensus.cc:385] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.290776 14845 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.291869 14845 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.294123 14845 ts_tablet_manager.cc:1434] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:04:55.295135 14845 tablet_bootstrap.cc:492] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.296164 14850 raft_consensus.cc:515] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.292135 14855 raft_consensus.cc:515] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.300035 14850 leader_election.cc:290] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.300611 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:55.301503 14651 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.302855 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:55.307497 14849 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.308545 14849 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
W20260709 13:04:55.309001 14690 leader_election.cc:343] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.313289 14849 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.322140 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:55.322808 14726 raft_consensus.cc:3060] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.316918 14844 tablet_bootstrap.cc:492] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.329681 14855 leader_election.cc:290] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.332131 14843 ts_tablet_manager.cc:1434] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.064s	user 0.023s	sys 0.009s
I20260709 13:04:55.333312 14843 tablet_bootstrap.cc:492] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.337446 14726 raft_consensus.cc:2468] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 1.
I20260709 13:04:55.338902 14651 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 1.
I20260709 13:04:55.339385 14844 ts_tablet_manager.cc:1403] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.006s
I20260709 13:04:55.339273 14616 leader_election.cc:304] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:55.342152 14855 raft_consensus.cc:2804] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.342170 14689 leader_election.cc:304] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:55.343153 14855 raft_consensus.cc:697] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:04:55.344112 14845 tablet_bootstrap.cc:654] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.344060 14855 consensus_queue.cc:237] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.346417 14866 raft_consensus.cc:2804] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.347640 14866 raft_consensus.cc:697] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:04:55.346949 14849 raft_consensus.cc:493] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.348875 14849 raft_consensus.cc:515] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.351164 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:55.352749 14800 raft_consensus.cc:3060] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.355018 14849 leader_election.cc:290] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.372650 14800 raft_consensus.cc:2468] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 1.
I20260709 13:04:55.358469 14866 consensus_queue.cc:237] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.388559 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc46b1749694686ab473319f66201c1" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:55.386682 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:55.391364 14726 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:55.394825 14844 raft_consensus.cc:359] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.396778 14844 raft_consensus.cc:385] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.397269 14844 raft_consensus.cc:740] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.399082 14546 catalog_manager.cc:5697] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.399735 14844 consensus_queue.cc:260] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.403848 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc46b1749694686ab473319f66201c1" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
W20260709 13:04:55.399005 14765 leader_election.cc:343] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.406536 14765 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:55.407452 14849 raft_consensus.cc:2804] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.408030 14849 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.405076 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.408356 14849 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.409256 14651 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
W20260709 13:04:55.409765 14763 leader_election.cc:343] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.412209 14763 leader_election.cc:304] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d436f97319e54eb691e869c30bb7d69d; no voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303
I20260709 13:04:55.412635 14844 ts_tablet_manager.cc:1434] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 13:04:55.417719 14844 tablet_bootstrap.cc:492] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.421433 14845 tablet_bootstrap.cc:492] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.422086 14843 tablet_bootstrap.cc:654] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.422053 14845 ts_tablet_manager.cc:1403] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.035s
I20260709 13:04:55.426465 14845 raft_consensus.cc:359] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.427551 14845 raft_consensus.cc:385] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.427981 14845 raft_consensus.cc:740] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.429010 14845 consensus_queue.cc:260] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.429885 14871 raft_consensus.cc:2749] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.438177 14849 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.441593 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:55.442538 14651 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.454291 14844 tablet_bootstrap.cc:654] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.463428 14845 ts_tablet_manager.cc:1434] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.020s
I20260709 13:04:55.466683 14651 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 1.
I20260709 13:04:55.468066 14763 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:55.485328 14845 tablet_bootstrap.cc:492] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.491106 14874 raft_consensus.cc:2804] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.493285 14874 raft_consensus.cc:697] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:55.494437 14874 consensus_queue.cc:237] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.495412 14545 catalog_manager.cc:5697] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 1 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.497093 14843 tablet_bootstrap.cc:492] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.497707 14843 ts_tablet_manager.cc:1403] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.012s
I20260709 13:04:55.503577 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:55.504678 14849 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.501843 14843 raft_consensus.cc:359] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.505275 14843 raft_consensus.cc:385] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.505343 14726 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.505770 14843 raft_consensus.cc:740] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.508268 14843 consensus_queue.cc:260] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.511145 14843 ts_tablet_manager.cc:1434] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:04:55.512326 14843 tablet_bootstrap.cc:492] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.507413 14844 tablet_bootstrap.cc:492] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.514319 14844 ts_tablet_manager.cc:1403] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.006s
I20260709 13:04:55.516353 14726 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 1.
I20260709 13:04:55.521214 14844 raft_consensus.cc:359] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.522091 14844 raft_consensus.cc:385] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.522773 14844 raft_consensus.cc:740] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.524451 14844 consensus_queue.cc:260] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.528553 14843 tablet_bootstrap.cc:654] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.528916 14845 tablet_bootstrap.cc:654] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.530753 14874 raft_consensus.cc:493] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.536401 14844 ts_tablet_manager.cc:1434] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:04:55.537323 14546 catalog_manager.cc:5697] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 0 to 1, leader changed from <none> to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 1 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.539359 14844 tablet_bootstrap.cc:492] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.549319 14844 tablet_bootstrap.cc:654] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.531273 14874 raft_consensus.cc:515] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.557147 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.558753 14651 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:55.554318 14874 leader_election.cc:290] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.559968 14845 tablet_bootstrap.cc:492] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.562346 14845 ts_tablet_manager.cc:1403] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.008s
I20260709 13:04:55.560356 14763 leader_election.cc:304] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:55.563836 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:55.564713 14726 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:55.565824 14866 raft_consensus.cc:493] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.567036 14866 raft_consensus.cc:515] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.571260 14866 leader_election.cc:290] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809), 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801)
I20260709 13:04:55.572403 14843 tablet_bootstrap.cc:492] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.572577 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.572566 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.572353 14845 raft_consensus.cc:359] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.573436 14845 raft_consensus.cc:385] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.573884 14845 raft_consensus.cc:740] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
W20260709 13:04:55.574581 14690 leader_election.cc:343] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:55.575361 14689 leader_election.cc:343] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.574949 14845 consensus_queue.cc:260] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.575971 14689 leader_election.cc:304] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a; no voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:55.573149 14843 ts_tablet_manager.cc:1403] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.003s
I20260709 13:04:55.577010 14866 raft_consensus.cc:2749] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.584437 14845 ts_tablet_manager.cc:1434] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:04:55.585664 14845 tablet_bootstrap.cc:492] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.566859 14874 raft_consensus.cc:2804] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.586410 14874 raft_consensus.cc:493] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.586798 14874 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.587909 14843 raft_consensus.cc:359] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.588868 14843 raft_consensus.cc:385] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.589177 14843 raft_consensus.cc:740] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.590770 14844 tablet_bootstrap.cc:492] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.591336 14844 ts_tablet_manager.cc:1403] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.011s
I20260709 13:04:55.592268 14843 consensus_queue.cc:260] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.600914 14874 raft_consensus.cc:515] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.604426 14845 tablet_bootstrap.cc:654] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.604269 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:55.605257 14843 ts_tablet_manager.cc:1434] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.006s
I20260709 13:04:55.606196 14651 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.607209 14843 tablet_bootstrap.cc:492] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.607250 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:55.608011 14726 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.608429 14844 raft_consensus.cc:359] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.609202 14844 raft_consensus.cc:385] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.609508 14844 raft_consensus.cc:740] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.610303 14844 consensus_queue.cc:260] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.613494 14844 ts_tablet_manager.cc:1434] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 13:04:55.614058 14651 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 1.
I20260709 13:04:55.614660 14844 tablet_bootstrap.cc:492] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.615468 14763 leader_election.cc:304] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:55.616360 14874 leader_election.cc:290] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.616719 14849 raft_consensus.cc:2804] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.617301 14849 raft_consensus.cc:697] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:55.626341 14726 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 1.
I20260709 13:04:55.628355 14874 raft_consensus.cc:493] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.628876 14874 raft_consensus.cc:515] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.632077 14874 leader_election.cc:290] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.632788 14849 consensus_queue.cc:237] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.633395 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.634580 14651 raft_consensus.cc:2393] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d436f97319e54eb691e869c30bb7d69d in current term 1: Already voted for candidate 033717497dd94121afdf5a1b6ef37d0a in this term.
I20260709 13:04:55.636667 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:55.638674 14765 leader_election.cc:304] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d436f97319e54eb691e869c30bb7d69d; no voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303
I20260709 13:04:55.640151 14874 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.641228 14844 tablet_bootstrap.cc:654] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.650278 14845 tablet_bootstrap.cc:492] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.651206 14845 ts_tablet_manager.cc:1403] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.003s
I20260709 13:04:55.652648 14874 raft_consensus.cc:2749] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.653535 14866 raft_consensus.cc:493] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.654354 14866 raft_consensus.cc:515] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.656878 14866 leader_election.cc:290] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.657801 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc46b1749694686ab473319f66201c1" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.659466 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc46b1749694686ab473319f66201c1" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.659674 14651 raft_consensus.cc:2468] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.660322 14800 raft_consensus.cc:2468] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.661425 14843 tablet_bootstrap.cc:654] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.661190 14689 leader_election.cc:304] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:55.662130 14866 raft_consensus.cc:2804] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.662556 14866 raft_consensus.cc:493] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.662971 14866 raft_consensus.cc:3060] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.664428 14845 raft_consensus.cc:359] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.665287 14845 raft_consensus.cc:385] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.665663 14845 raft_consensus.cc:740] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.666080 14546 catalog_manager.cc:5697] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 0 to 1, leader changed from <none> to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 1 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.667341 14845 consensus_queue.cc:260] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.670332 14845 ts_tablet_manager.cc:1434] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:04:55.671511 14845 tablet_bootstrap.cc:492] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.672254 14866 raft_consensus.cc:515] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.673909 14844 tablet_bootstrap.cc:492] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.674415 14844 ts_tablet_manager.cc:1403] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.060s	user 0.005s	sys 0.012s
I20260709 13:04:55.678346 14844 raft_consensus.cc:359] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.679158 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc46b1749694686ab473319f66201c1" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:55.680119 14651 raft_consensus.cc:3060] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.679405 14844 raft_consensus.cc:385] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.681913 14844 raft_consensus.cc:740] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.682957 14844 consensus_queue.cc:260] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.686084 14844 ts_tablet_manager.cc:1434] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:04:55.687115 14844 tablet_bootstrap.cc:492] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.688300 14651 raft_consensus.cc:2468] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 1.
I20260709 13:04:55.690619 14689 leader_election.cc:304] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:55.689360 14866 leader_election.cc:290] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.691520 14850 raft_consensus.cc:2804] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.692044 14850 raft_consensus.cc:697] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:04:55.692703 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc46b1749694686ab473319f66201c1" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:55.692920 14845 tablet_bootstrap.cc:654] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.693275 14800 raft_consensus.cc:3060] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.693001 14850 consensus_queue.cc:237] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.701901 14844 tablet_bootstrap.cc:654] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.705961 14843 tablet_bootstrap.cc:492] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.706468 14843 ts_tablet_manager.cc:1403] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.012s
I20260709 13:04:55.713900 14845 tablet_bootstrap.cc:492] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.714287 14843 raft_consensus.cc:359] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.715088 14843 raft_consensus.cc:385] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.714664 14845 ts_tablet_manager.cc:1403] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.020s
I20260709 13:04:55.715422 14843 raft_consensus.cc:740] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.717308 14800 raft_consensus.cc:2468] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 1.
I20260709 13:04:55.717152 14843 consensus_queue.cc:260] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.720934 14843 ts_tablet_manager.cc:1434] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:55.722138 14843 tablet_bootstrap.cc:492] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.722726 14844 tablet_bootstrap.cc:492] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.723294 14844 ts_tablet_manager.cc:1403] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.007s
I20260709 13:04:55.726059 14844 raft_consensus.cc:359] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.726735 14844 raft_consensus.cc:385] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.725778 14548 catalog_manager.cc:5697] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 1 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.727022 14844 raft_consensus.cc:740] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.727764 14844 consensus_queue.cc:260] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:55.732621 14844 ts_tablet_manager.cc:1434] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:55.733537 14844 tablet_bootstrap.cc:492] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303: Bootstrap starting.
I20260709 13:04:55.728948 14845 raft_consensus.cc:359] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.733946 14845 raft_consensus.cc:385] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.734304 14845 raft_consensus.cc:740] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.735178 14845 consensus_queue.cc:260] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.738868 14843 tablet_bootstrap.cc:654] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.738987 14844 tablet_bootstrap.cc:654] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.750082 14845 ts_tablet_manager.cc:1434] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:04:55.751305 14845 tablet_bootstrap.cc:492] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.756487 14855 raft_consensus.cc:493] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.757107 14855 raft_consensus.cc:515] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.761512 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30396e20ca74b4ea691bcabf475c249" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.765375 14855 leader_election.cc:290] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.768747 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30396e20ca74b4ea691bcabf475c249" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
W20260709 13:04:55.769702 14615 leader_election.cc:343] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:55.772475 14616 leader_election.cc:343] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.773110 14616 leader_election.cc:304] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ad8512299ad481db24142e6102a8303; no voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:55.774670 14855 raft_consensus.cc:2749] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.781086 14845 tablet_bootstrap.cc:654] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.783221 14843 tablet_bootstrap.cc:492] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.783728 14843 ts_tablet_manager.cc:1403] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.019s
I20260709 13:04:55.786481 14843 raft_consensus.cc:359] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.787184 14843 raft_consensus.cc:385] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.787488 14843 raft_consensus.cc:740] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.788149 14843 consensus_queue.cc:260] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.790565 14843 ts_tablet_manager.cc:1434] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:55.791499 14843 tablet_bootstrap.cc:492] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a: Bootstrap starting.
I20260709 13:04:55.796494 14844 tablet_bootstrap.cc:492] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303: No bootstrap required, opened a new log
I20260709 13:04:55.796988 14844 ts_tablet_manager.cc:1403] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.038s
I20260709 13:04:55.798339 14843 tablet_bootstrap.cc:654] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.803068 14845 tablet_bootstrap.cc:492] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.803198 14844 raft_consensus.cc:359] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.803592 14845 ts_tablet_manager.cc:1403] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.004s
I20260709 13:04:55.804101 14844 raft_consensus.cc:385] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.804471 14844 raft_consensus.cc:740] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.806972 14845 raft_consensus.cc:359] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.807752 14845 raft_consensus.cc:385] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.808030 14845 raft_consensus.cc:740] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.809084 14844 consensus_queue.cc:260] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.809108 14845 consensus_queue.cc:260] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.811412 14844 ts_tablet_manager.cc:1434] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:55.814844 14843 tablet_bootstrap.cc:492] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a: No bootstrap required, opened a new log
I20260709 13:04:55.815826 14843 ts_tablet_manager.cc:1403] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 13:04:55.818553 14843 raft_consensus.cc:359] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.819320 14843 raft_consensus.cc:385] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.819638 14843 raft_consensus.cc:740] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.820012 14845 ts_tablet_manager.cc:1434] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:55.820281 14843 consensus_queue.cc:260] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.820998 14845 tablet_bootstrap.cc:492] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d: Bootstrap starting.
I20260709 13:04:55.822731 14843 ts_tablet_manager.cc:1434] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:55.832216 14845 tablet_bootstrap.cc:654] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.837206 14845 tablet_bootstrap.cc:492] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d: No bootstrap required, opened a new log
I20260709 13:04:55.837809 14845 ts_tablet_manager.cc:1403] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:04:55.839784 14845 raft_consensus.cc:359] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.840305 14845 raft_consensus.cc:385] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.840536 14845 raft_consensus.cc:740] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.841143 14845 consensus_queue.cc:260] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.842804 14845 ts_tablet_manager.cc:1434] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:04:55.856009 14850 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:55.861888 14595 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:55.874786 14850 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.914880 14899 raft_consensus.cc:493] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.915437 14899 raft_consensus.cc:515] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.917523 14899 leader_election.cc:290] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.918413 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.918728 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.919104 14651 raft_consensus.cc:2468] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.919580 14800 raft_consensus.cc:2468] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.920356 14689 leader_election.cc:304] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:55.921279 14899 raft_consensus.cc:2804] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.921648 14899 raft_consensus.cc:493] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.921998 14899 raft_consensus.cc:3060] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.926743 14899 raft_consensus.cc:515] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.928447 14899 leader_election.cc:290] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.929232 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:55.929648 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:55.929909 14651 raft_consensus.cc:3060] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.930248 14800 raft_consensus.cc:3060] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.937575 14651 raft_consensus.cc:2468] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 1.
I20260709 13:04:55.937599 14800 raft_consensus.cc:2468] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 1.
I20260709 13:04:55.938973 14689 leader_election.cc:304] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:55.939719 14899 raft_consensus.cc:2804] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.940248 14899 raft_consensus.cc:697] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:04:55.940966 14899 consensus_queue.cc:237] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.949096 14548 catalog_manager.cc:5697] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 1 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.959187 14849 raft_consensus.cc:493] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.959733 14849 raft_consensus.cc:515] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.960237 14855 consensus_queue.cc:1048] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.961829 14849 leader_election.cc:290] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:55.962383 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.962999 14651 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:55.963462 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:55.963814 14866 raft_consensus.cc:493] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.964258 14866 raft_consensus.cc:515] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.965205 14725 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:55.965690 14763 leader_election.cc:304] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:55.967121 14866 leader_election.cc:290] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.969519 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:55.970192 14800 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.972777 14690 leader_election.cc:304] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:55.973979 14849 raft_consensus.cc:2804] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.974484 14849 raft_consensus.cc:493] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.974962 14849 raft_consensus.cc:3060] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.975081 14866 raft_consensus.cc:2804] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.975520 14866 raft_consensus.cc:493] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.975870 14866 raft_consensus.cc:3060] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.971645 14855 consensus_queue.cc:1048] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.983011 14866 raft_consensus.cc:515] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:55.971668 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:55.986073 14866 leader_election.cc:290] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:55.986485 14651 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 0.
I20260709 13:04:55.987371 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:55.987936 14650 raft_consensus.cc:3060] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.988811 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:55.994772 14650 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 1.
I20260709 13:04:55.996255 14689 leader_election.cc:304] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:55.997599 14866 raft_consensus.cc:2804] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.998826 14866 raft_consensus.cc:697] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:04:55.994078 14849 raft_consensus.cc:515] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.000308 14800 raft_consensus.cc:2393] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 033717497dd94121afdf5a1b6ef37d0a in current term 1: Already voted for candidate d436f97319e54eb691e869c30bb7d69d in this term.
I20260709 13:04:56.000092 14866 consensus_queue.cc:237] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.027082 14874 raft_consensus.cc:493] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.027688 14874 raft_consensus.cc:515] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.035398 14874 leader_election.cc:290] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:56.036034 14874 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.048686 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30396e20ca74b4ea691bcabf475c249" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303" is_pre_election: true
I20260709 13:04:56.049726 14650 raft_consensus.cc:2468] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:56.050895 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:56.051803 14651 raft_consensus.cc:2393] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d436f97319e54eb691e869c30bb7d69d in current term 1: Already voted for candidate 033717497dd94121afdf5a1b6ef37d0a in this term.
I20260709 13:04:56.051678 14763 leader_election.cc:304] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:56.051901 14849 leader_election.cc:290] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:56.053071 14849 raft_consensus.cc:2804] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.053463 14849 raft_consensus.cc:493] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.053843 14849 raft_consensus.cc:3060] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.055231 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30396e20ca74b4ea691bcabf475c249" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:56.055928 14726 raft_consensus.cc:2468] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 0.
I20260709 13:04:56.058568 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:56.062548 14849 raft_consensus.cc:515] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.064180 14765 leader_election.cc:304] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d436f97319e54eb691e869c30bb7d69d; no voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303
I20260709 13:04:56.065202 14849 leader_election.cc:290] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:56.065677 14910 raft_consensus.cc:2749] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.065058 14548 catalog_manager.cc:5697] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 1 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.068296 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30396e20ca74b4ea691bcabf475c249" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:56.069020 14725 raft_consensus.cc:3060] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.072376 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30396e20ca74b4ea691bcabf475c249" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:56.073046 14651 raft_consensus.cc:3060] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.077586 14725 raft_consensus.cc:2468] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 1.
I20260709 13:04:56.079080 14765 leader_election.cc:304] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:56.080307 14651 raft_consensus.cc:2468] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 1.
I20260709 13:04:56.080245 14910 raft_consensus.cc:2804] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.081094 14910 raft_consensus.cc:697] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:56.082149 14910 consensus_queue.cc:237] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.095211 14548 catalog_manager.cc:5697] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 0 to 1, leader changed from <none> to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 1 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.098760 14910 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.124624 14907 raft_consensus.cc:493] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.125167 14907 raft_consensus.cc:515] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:56.128523 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a" is_pre_election: true
I20260709 13:04:56.128739 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d" is_pre_election: true
I20260709 13:04:56.129228 14726 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 0.
I20260709 13:04:56.129480 14799 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 0.
I20260709 13:04:56.130321 14907 leader_election.cc:290] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:56.130398 14616 leader_election.cc:304] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:56.131356 14907 raft_consensus.cc:2804] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.131780 14907 raft_consensus.cc:493] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.132093 14907 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.139088 14907 raft_consensus.cc:515] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:56.139900 14910 consensus_queue.cc:1048] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.141292 14907 leader_election.cc:290] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:56.142130 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:56.142722 14726 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.147315 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:56.148036 14799 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.149391 14726 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 1.
I20260709 13:04:56.150674 14616 leader_election.cc:304] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:56.151973 14908 raft_consensus.cc:2804] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.152467 14908 raft_consensus.cc:697] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:04:56.153291 14908 consensus_queue.cc:237] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:04:56.158666 14799 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 1.
I20260709 13:04:56.172407 14548 catalog_manager.cc:5697] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.174073 14910 consensus_queue.cc:1048] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.193216 14866 consensus_queue.cc:1048] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.208959 14899 consensus_queue.cc:1048] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.425781 14799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33111a18661448e292808d2c81bf5f12"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
mode: GRACEFUL
new_leader_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:44332
I20260709 13:04:56.426430 14799 raft_consensus.cc:606] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Received request to transfer leadership to TS 5ad8512299ad481db24142e6102a8303
I20260709 13:04:56.430209 14899 consensus_queue.cc:1048] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.432585 14799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
mode: GRACEFUL
new_leader_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:44332
I20260709 13:04:56.433317 14799 raft_consensus.cc:606] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Received request to transfer leadership to TS 5ad8512299ad481db24142e6102a8303
I20260709 13:04:56.449466 14866 consensus_queue.cc:1048] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.504719 14849 raft_consensus.cc:993] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: : Instructing follower 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:04:56.505326 14910 raft_consensus.cc:1081] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Signalling peer 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:04:56.507575 14650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:56948
I20260709 13:04:56.508289 14650 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.508674 14650 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.513345 14650 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.515456 14650 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 2 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:56.516229 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:56.516497 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:56.516839 14726 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.517251 14799 raft_consensus.cc:3055] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.517586 14799 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:56.518432 14799 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.519623 14799 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.523958 14726 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 2.
I20260709 13:04:56.524237 14799 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 2.
I20260709 13:04:56.525318 14616 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:56.526185 14908 raft_consensus.cc:2804] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.526680 14908 raft_consensus.cc:697] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:04:56.527475 14908 consensus_queue.cc:237] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.533923 14548 catalog_manager.cc:5697] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 1 to 2, leader changed from d436f97319e54eb691e869c30bb7d69d (127.14.45.3) to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.536586 14866 consensus_queue.cc:1048] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.538847 14910 consensus_queue.cc:1048] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.560484 14866 consensus_queue.cc:1048] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.566337 14910 consensus_queue.cc:1048] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.621161 14908 consensus_queue.cc:1048] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.632920 14907 consensus_queue.cc:1048] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.669909 14910 raft_consensus.cc:993] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: : Instructing follower 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:04:56.670418 14874 raft_consensus.cc:1081] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Signalling peer 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:04:56.672271 14650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33111a18661448e292808d2c81bf5f12"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:56948
I20260709 13:04:56.672855 14650 raft_consensus.cc:493] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.673239 14650 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.680109 14650 raft_consensus.cc:515] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.682276 14650 leader_election.cc:290] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 2 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:04:56.683339 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:56.683503 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:04:56.683957 14726 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.684154 14799 raft_consensus.cc:3055] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.684566 14799 raft_consensus.cc:740] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:56.685289 14799 consensus_queue.cc:260] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.686255 14799 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.690861 14799 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 2.
I20260709 13:04:56.690822 14726 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 2.
I20260709 13:04:56.692225 14616 leader_election.cc:304] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:04:56.692945 14904 raft_consensus.cc:2804] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.693419 14904 raft_consensus.cc:697] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:04:56.694214 14904 consensus_queue.cc:237] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:56.701140 14548 catalog_manager.cc:5697] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 1 to 2, leader changed from d436f97319e54eb691e869c30bb7d69d (127.14.45.3) to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.007616 14799 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.009210 14904 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.019115 14726 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.023001 14904 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.142096 14726 raft_consensus.cc:1275] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.143332 14904 consensus_queue.cc:1048] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.150781 14799 raft_consensus.cc:1275] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.152329 14904 consensus_queue.cc:1048] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:59.502806 14516 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:04:59.503650 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.527096 14725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
mode: GRACEFUL
new_leader_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:52774
I20260709 13:04:59.527660 14725 raft_consensus.cc:606] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Received request to transfer leadership to TS d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:59.539522 14651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
mode: GRACEFUL
new_leader_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:58226
I20260709 13:04:59.540058 14651 raft_consensus.cc:606] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Received request to transfer leadership to TS d436f97319e54eb691e869c30bb7d69d
I20260709 13:04:59.541342 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:59.541972 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:59.623539 14928 raft_consensus.cc:993] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: : Instructing follower d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:04:59.624068 14935 raft_consensus.cc:1081] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Signalling peer d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:04:59.625937 14799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:04:59.626785 14799 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.627137 14799 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.632041 14799 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:59.633767 14799 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 3 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:59.634649 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:59.634784 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:59.635205 14651 raft_consensus.cc:3055] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:59.635363 14725 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.635541 14651 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:04:59.636287 14651 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:59.637210 14651 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.643208 14725 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 3.
I20260709 13:04:59.644294 14651 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 3.
I20260709 13:04:59.644456 14765 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:59.645306 14910 raft_consensus.cc:2804] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.646466 14910 raft_consensus.cc:697] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:59.647120 14910 consensus_queue.cc:237] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:59.655995 14546 catalog_manager.cc:5697] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 2 to 3, leader changed from 5ad8512299ad481db24142e6102a8303 (127.14.45.1) to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 3 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.846197 14866 raft_consensus.cc:993] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: : Instructing follower d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:04:59.846648 14942 raft_consensus.cc:1081] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Signalling peer d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:04:59.848443 14799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:44322
I20260709 13:04:59.849009 14799 raft_consensus.cc:493] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.849367 14799 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.854353 14799 raft_consensus.cc:515] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:59.856350 14799 leader_election.cc:290] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 2 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:04:59.857161 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:04:59.857663 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:04:59.857919 14651 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.858345 14725 raft_consensus.cc:3055] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:59.858678 14725 raft_consensus.cc:740] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:04:59.859401 14725 consensus_queue.cc:260] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:59.860422 14725 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.863189 14651 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 2.
I20260709 13:04:59.864430 14763 leader_election.cc:304] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:04:59.865496 14910 raft_consensus.cc:2804] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:59.866210 14910 raft_consensus.cc:697] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:04:59.866343 14725 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 2.
I20260709 13:04:59.867069 14910 consensus_queue.cc:237] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:04:59.874312 14546 catalog_manager.cc:5697] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 1 to 2, leader changed from 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2) to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 2 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.034430 14725 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.035763 14910 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.048893 14651 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.050519 14936 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.391165 14650 raft_consensus.cc:1275] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.392592 14946 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.404724 14725 raft_consensus.cc:1275] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.406239 14946 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.542801 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:00.561301 14650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
mode: GRACEFUL
new_leader_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:58232
I20260709 13:05:00.562201 14650 raft_consensus.cc:606] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Received request to transfer leadership to TS 033717497dd94121afdf5a1b6ef37d0a
I20260709 13:05:00.568122 14650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33111a18661448e292808d2c81bf5f12"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
mode: GRACEFUL
new_leader_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:58232
I20260709 13:05:00.568667 14650 raft_consensus.cc:606] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Received request to transfer leadership to TS 033717497dd94121afdf5a1b6ef37d0a
I20260709 13:05:00.573779 14799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
mode: GRACEFUL
new_leader_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:44332
I20260709 13:05:00.574354 14799 raft_consensus.cc:606] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 LEADER]: Received request to transfer leadership to TS 033717497dd94121afdf5a1b6ef37d0a
I20260709 13:05:00.580027 14650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
mode: GRACEFUL
new_leader_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:58232
I20260709 13:05:00.580603 14650 raft_consensus.cc:606] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Received request to transfer leadership to TS 033717497dd94121afdf5a1b6ef37d0a
I20260709 13:05:00.585875 14799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
mode: GRACEFUL
new_leader_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:44332
I20260709 13:05:00.586437 14799 raft_consensus.cc:606] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Received request to transfer leadership to TS 033717497dd94121afdf5a1b6ef37d0a
I20260709 13:05:00.593222 14935 raft_consensus.cc:993] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: : Instructing follower 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.593674 14935 raft_consensus.cc:1081] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Signalling peer 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.595352 14725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33111a18661448e292808d2c81bf5f12"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:41898
I20260709 13:05:00.595949 14725 raft_consensus.cc:493] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.596349 14725 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.602475 14725 raft_consensus.cc:515] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.604027 14946 raft_consensus.cc:993] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: : Instructing follower 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.604354 14725 leader_election.cc:290] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 3 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:00.604509 14946 raft_consensus.cc:1081] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 LEADER]: Signalling peer 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.605633 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:00.605633 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33111a18661448e292808d2c81bf5f12" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:00.606457 14725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:41908
I20260709 13:05:00.606557 14799 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.606498 14650 raft_consensus.cc:3055] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.607136 14650 raft_consensus.cc:740] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:05:00.607126 14725 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.607760 14725 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.608222 14650 consensus_queue.cc:260] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.609143 14650 raft_consensus.cc:3060] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.613457 14650 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 3.
I20260709 13:05:00.613497 14799 raft_consensus.cc:2468] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 3.
I20260709 13:05:00.614105 14725 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.614598 14689 leader_election.cc:304] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:05:00.615417 14942 raft_consensus.cc:2804] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.616302 14725 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 4 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:00.616804 14942 raft_consensus.cc:697] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:00.617511 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:00.617621 14942 consensus_queue.cc:237] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.618023 14650 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.620635 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:00.621217 14799 raft_consensus.cc:3055] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:00.621554 14799 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:05:00.622421 14799 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.623553 14799 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.623813 14650 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 4.
I20260709 13:05:00.625391 14689 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:05:00.626227 14942 raft_consensus.cc:2804] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:00.626677 14942 raft_consensus.cc:697] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:00.626564 14545 catalog_manager.cc:5697] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 2 to 3, leader changed from 5ad8512299ad481db24142e6102a8303 (127.14.45.1) to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 3 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.627488 14942 consensus_queue.cc:237] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.629282 14799 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 4.
I20260709 13:05:00.645373 14545 catalog_manager.cc:5697] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 3 to 4, leader changed from d436f97319e54eb691e869c30bb7d69d (127.14.45.3) to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 4 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.662549 14954 raft_consensus.cc:993] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: : Instructing follower 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.662959 14935 raft_consensus.cc:1081] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Signalling peer 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.664516 14725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:41898
I20260709 13:05:00.665019 14725 raft_consensus.cc:493] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.665298 14725 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.669798 14725 raft_consensus.cc:515] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:05:00.671298 14725 leader_election.cc:290] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 2 election: Requested vote from peers d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809), 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801)
I20260709 13:05:00.672205 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:00.672452 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:00.672721 14799 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.673044 14650 raft_consensus.cc:3055] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.673322 14650 raft_consensus.cc:740] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:05:00.674225 14650 consensus_queue.cc:260] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:05:00.675113 14650 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.677126 14799 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 2.
I20260709 13:05:00.678128 14690 leader_election.cc:304] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:05:00.679018 14942 raft_consensus.cc:2804] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.679428 14942 raft_consensus.cc:697] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:00.680126 14650 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 2.
I20260709 13:05:00.680152 14942 consensus_queue.cc:237] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:05:00.686079 14954 raft_consensus.cc:993] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: : Instructing follower 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.686587 14935 raft_consensus.cc:1081] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Signalling peer 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.688206 14725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:41898
I20260709 13:05:00.688081 14545 catalog_manager.cc:5697] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 1 to 2, leader changed from 5ad8512299ad481db24142e6102a8303 (127.14.45.1) to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 2 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.688881 14725 raft_consensus.cc:493] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.689273 14725 raft_consensus.cc:3060] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.694820 14725 raft_consensus.cc:515] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.697217 14725 leader_election.cc:290] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 2 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:00.697335 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:00.697660 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9744f1796ee44238b0d2b0b6293c76f1" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:00.698015 14650 raft_consensus.cc:3055] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.698292 14799 raft_consensus.cc:3060] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.698396 14650 raft_consensus.cc:740] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:05:00.699172 14650 consensus_queue.cc:260] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.700043 14650 raft_consensus.cc:3060] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.702647 14799 raft_consensus.cc:2468] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 2.
I20260709 13:05:00.703639 14690 leader_election.cc:304] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:05:00.704383 14942 raft_consensus.cc:2804] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.704854 14942 raft_consensus.cc:697] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:00.705544 14650 raft_consensus.cc:2468] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 2.
I20260709 13:05:00.705674 14942 consensus_queue.cc:237] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.713119 14545 catalog_manager.cc:5697] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 1 to 2, leader changed from 5ad8512299ad481db24142e6102a8303 (127.14.45.1) to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 2 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.963279 14946 raft_consensus.cc:993] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: : Instructing follower 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.963773 14910 raft_consensus.cc:1081] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Signalling peer 033717497dd94121afdf5a1b6ef37d0a to start an election
I20260709 13:05:00.965462 14725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
 from {username='slave'} at 127.0.0.1:41908
I20260709 13:05:00.966081 14725 raft_consensus.cc:493] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.966477 14725 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.971125 14725 raft_consensus.cc:515] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.973079 14725 leader_election.cc:290] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 3 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:00.974071 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:00.974191 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "033717497dd94121afdf5a1b6ef37d0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:00.974581 14650 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.974764 14799 raft_consensus.cc:3055] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.975127 14799 raft_consensus.cc:740] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:05:00.975800 14799 consensus_queue.cc:260] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.976632 14799 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.979521 14650 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 3.
I20260709 13:05:00.980683 14689 leader_election.cc:304] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:05:00.981389 14942 raft_consensus.cc:2804] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.981535 14799 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 033717497dd94121afdf5a1b6ef37d0a in term 3.
I20260709 13:05:00.981854 14942 raft_consensus.cc:697] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Becoming Leader. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:00.982846 14942 consensus_queue.cc:237] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:00.990054 14545 catalog_manager.cc:5697] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a reported cstate change: term changed from 2 to 3, leader changed from d436f97319e54eb691e869c30bb7d69d (127.14.45.3) to 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2). New cstate: current_term: 3 leader_uuid: "033717497dd94121afdf5a1b6ef37d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.016004 14650 raft_consensus.cc:1275] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:01.017536 14942 consensus_queue.cc:1048] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:01.028479 14799 raft_consensus.cc:1275] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:01.029801 14651 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:01.031013 14955 consensus_queue.cc:1048] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:01.032469 14965 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:01.043419 14799 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:01.044592 14955 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:01.068513 14799 raft_consensus.cc:1275] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.070143 14942 consensus_queue.cc:1048] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.079301 14650 raft_consensus.cc:1275] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.080981 14942 consensus_queue.cc:1048] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.264230 14650 raft_consensus.cc:1275] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.265683 14942 consensus_queue.cc:1048] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.274127 14799 raft_consensus.cc:1275] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.275584 14965 consensus_queue.cc:1048] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.415215 14799 raft_consensus.cc:1275] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:01.416523 14965 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:01.427325 14650 raft_consensus.cc:1275] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Refusing update from remote peer 033717497dd94121afdf5a1b6ef37d0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:01.428795 14942 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.601037 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.608534 14725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
mode: GRACEFUL
new_leader_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:52774
I20260709 13:05:03.609239 14725 raft_consensus.cc:606] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Received request to transfer leadership to TS 5ad8512299ad481db24142e6102a8303
I20260709 13:05:03.612169 14725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
mode: GRACEFUL
new_leader_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:52774
I20260709 13:05:03.612703 14725 raft_consensus.cc:606] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Received request to transfer leadership to TS d436f97319e54eb691e869c30bb7d69d
I20260709 13:05:03.615290 14725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
mode: GRACEFUL
new_leader_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:52774
I20260709 13:05:03.615818 14725 raft_consensus.cc:606] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Received request to transfer leadership to TS 5ad8512299ad481db24142e6102a8303
I20260709 13:05:03.618305 14725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
mode: GRACEFUL
new_leader_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:52774
I20260709 13:05:03.618875 14725 raft_consensus.cc:606] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Received request to transfer leadership to TS d436f97319e54eb691e869c30bb7d69d
I20260709 13:05:03.621371 14725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
mode: GRACEFUL
new_leader_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:52774
I20260709 13:05:03.621922 14725 raft_consensus.cc:606] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 LEADER]: Received request to transfer leadership to TS 5ad8512299ad481db24142e6102a8303
I20260709 13:05:03.623052 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:03.623555 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:03.643036 14977 raft_consensus.cc:993] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: : Instructing follower 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:05:03.643555 14977 raft_consensus.cc:1081] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Signalling peer 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:05:03.645417 14651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:56940
I20260709 13:05:03.646076 14651 raft_consensus.cc:493] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.646492 14651 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.652186 14651 raft_consensus.cc:515] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:05:03.654434 14651 leader_election.cc:290] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 3 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:03.655407 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:05:03.655905 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f064fc9274a90b38698e67d5b0394" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:03.656481 14725 raft_consensus.cc:3055] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.656584 14800 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.656836 14725 raft_consensus.cc:740] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:03.657809 14725 consensus_queue.cc:260] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:05:03.659003 14725 raft_consensus.cc:3060] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.662978 14800 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 3.
I20260709 13:05:03.664330 14615 leader_election.cc:304] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:05:03.664781 14725 raft_consensus.cc:2468] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 3.
I20260709 13:05:03.666064 14978 raft_consensus.cc:2804] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:03.666939 14978 raft_consensus.cc:697] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 3 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:05:03.667802 14978 consensus_queue.cc:237] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } }
I20260709 13:05:03.675359 14548 catalog_manager.cc:5697] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 2 to 3, leader changed from 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2) to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.771577 14955 raft_consensus.cc:993] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: : Instructing follower 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:05:03.772037 14977 raft_consensus.cc:1081] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Signalling peer 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:05:03.773413 14651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:56940
I20260709 13:05:03.773983 14651 raft_consensus.cc:493] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.774263 14651 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.778961 14651 raft_consensus.cc:515] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.780423 14651 leader_election.cc:290] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 4 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:03.781616 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:05:03.781608 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9799d62a65b4a3d84d5a8d140a61720" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:03.782526 14725 raft_consensus.cc:3055] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:03.782554 14800 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.783073 14725 raft_consensus.cc:740] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:03.784003 14725 consensus_queue.cc:260] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.785125 14725 raft_consensus.cc:3060] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.789728 14800 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 4.
I20260709 13:05:03.790995 14615 leader_election.cc:304] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:05:03.791414 14725 raft_consensus.cc:2468] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 4.
I20260709 13:05:03.791755 14978 raft_consensus.cc:2804] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.792549 14978 raft_consensus.cc:697] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 4 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:05:03.793382 14978 consensus_queue.cc:237] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.800243 14548 catalog_manager.cc:5697] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 3 to 4, leader changed from 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2) to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 4 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.817116 14955 raft_consensus.cc:993] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: : Instructing follower 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:05:03.817615 14977 raft_consensus.cc:1081] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 LEADER]: Signalling peer 5ad8512299ad481db24142e6102a8303 to start an election
I20260709 13:05:03.819301 14651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325"
dest_uuid: "5ad8512299ad481db24142e6102a8303"
 from {username='slave'} at 127.0.0.1:56940
I20260709 13:05:03.819723 14651 raft_consensus.cc:493] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.819957 14651 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.824510 14651 raft_consensus.cc:515] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.825486 14955 raft_consensus.cc:993] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: : Instructing follower d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:05:03.826001 14977 raft_consensus.cc:1081] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Signalling peer d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:05:03.826066 14651 leader_election.cc:290] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 5 election: Requested vote from peers 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607), d436f97319e54eb691e869c30bb7d69d (127.14.45.3:38809)
I20260709 13:05:03.826793 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:05:03.827454 14725 raft_consensus.cc:3055] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.827049 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e557604675fb4fd0826a11cd44ab3325" candidate_uuid: "5ad8512299ad481db24142e6102a8303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
I20260709 13:05:03.827747 14725 raft_consensus.cc:740] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:03.827937 14800 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.827999 14799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:44322
I20260709 13:05:03.828600 14799 raft_consensus.cc:493] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.828541 14725 consensus_queue.cc:260] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.828997 14799 raft_consensus.cc:3060] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.829486 14725 raft_consensus.cc:3060] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.833428 14725 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 5.
I20260709 13:05:03.834761 14616 leader_election.cc:304] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 033717497dd94121afdf5a1b6ef37d0a, 5ad8512299ad481db24142e6102a8303; no voters: 
I20260709 13:05:03.834861 14800 raft_consensus.cc:2468] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad8512299ad481db24142e6102a8303 in term 5.
I20260709 13:05:03.835551 14978 raft_consensus.cc:2804] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.835515 14799 raft_consensus.cc:515] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.836190 14978 raft_consensus.cc:697] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 5 LEADER]: Becoming Leader. State: Replica: 5ad8512299ad481db24142e6102a8303, State: Running, Role: LEADER
I20260709 13:05:03.837069 14978 consensus_queue.cc:237] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.837615 14799 leader_election.cc:290] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 2 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:05:03.838614 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:03.838827 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44dd8495bd184c88bba4dd3a22472dbd" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:05:03.839182 14651 raft_consensus.cc:3060] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.839365 14725 raft_consensus.cc:3055] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.839746 14725 raft_consensus.cc:740] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:03.840447 14725 consensus_queue.cc:260] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.841645 14725 raft_consensus.cc:3060] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.845105 14651 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 2.
I20260709 13:05:03.845728 14548 catalog_manager.cc:5697] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 reported cstate change: term changed from 4 to 5, leader changed from 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2) to 5ad8512299ad481db24142e6102a8303 (127.14.45.1). New cstate: current_term: 5 leader_uuid: "5ad8512299ad481db24142e6102a8303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.846608 14763 leader_election.cc:304] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:05:03.847986 14910 raft_consensus.cc:2804] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.848033 14725 raft_consensus.cc:2468] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 2.
I20260709 13:05:03.852272 14910 raft_consensus.cc:697] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:05:03.853325 14910 consensus_queue.cc:237] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.861354 14548 catalog_manager.cc:5697] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 1 to 2, leader changed from 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2) to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 2 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.955832 14955 raft_consensus.cc:993] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: : Instructing follower d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:05:03.956415 14977 raft_consensus.cc:1081] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Signalling peer d436f97319e54eb691e869c30bb7d69d to start an election
I20260709 13:05:03.958390 14799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b"
dest_uuid: "d436f97319e54eb691e869c30bb7d69d"
 from {username='slave'} at 127.0.0.1:44322
I20260709 13:05:03.958982 14799 raft_consensus.cc:493] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.959345 14799 raft_consensus.cc:3060] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.964409 14799 raft_consensus.cc:515] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.966116 14799 leader_election.cc:290] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 2 election: Requested vote from peers 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801), 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2:46607)
I20260709 13:05:03.966969 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ad8512299ad481db24142e6102a8303"
I20260709 13:05:03.967223 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c81c94872e418d849dd0ab9b45625b" candidate_uuid: "d436f97319e54eb691e869c30bb7d69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "033717497dd94121afdf5a1b6ef37d0a"
I20260709 13:05:03.967445 14651 raft_consensus.cc:3060] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.967779 14725 raft_consensus.cc:3055] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.968043 14725 raft_consensus.cc:740] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 033717497dd94121afdf5a1b6ef37d0a, State: Running, Role: LEADER
I20260709 13:05:03.968698 14725 consensus_queue.cc:260] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.969715 14725 raft_consensus.cc:3060] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.971859 14651 raft_consensus.cc:2468] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 2.
I20260709 13:05:03.973022 14763 leader_election.cc:304] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad8512299ad481db24142e6102a8303, d436f97319e54eb691e869c30bb7d69d; no voters: 
I20260709 13:05:03.974087 14910 raft_consensus.cc:2804] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.974617 14910 raft_consensus.cc:697] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Becoming Leader. State: Replica: d436f97319e54eb691e869c30bb7d69d, State: Running, Role: LEADER
I20260709 13:05:03.975117 14725 raft_consensus.cc:2468] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d436f97319e54eb691e869c30bb7d69d in term 2.
I20260709 13:05:03.975474 14910 consensus_queue.cc:237] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } }
I20260709 13:05:03.984499 14548 catalog_manager.cc:5697] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d reported cstate change: term changed from 1 to 2, leader changed from 033717497dd94121afdf5a1b6ef37d0a (127.14.45.2) to d436f97319e54eb691e869c30bb7d69d (127.14.45.3). New cstate: current_term: 2 leader_uuid: "d436f97319e54eb691e869c30bb7d69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.061432 14725 raft_consensus.cc:1275] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.062842 14978 consensus_queue.cc:1048] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.074520 14799 raft_consensus.cc:1275] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.077561 14992 consensus_queue.cc:1048] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.195851 14725 raft_consensus.cc:1275] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:04.197326 14992 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.206913 14799 raft_consensus.cc:1275] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:04.208570 14978 consensus_queue.cc:1048] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.251729 14725 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 5 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:04.253073 14979 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:04.263159 14799 raft_consensus.cc:1275] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 5 FOLLOWER]: Refusing update from remote peer 5ad8512299ad481db24142e6102a8303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:04.264756 14997 consensus_queue.cc:1048] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d436f97319e54eb691e869c30bb7d69d" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:04.362779 14725 raft_consensus.cc:1275] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.364161 14910 consensus_queue.cc:1048] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.373324 14651 raft_consensus.cc:1275] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.374898 14910 consensus_queue.cc:1048] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.460394 14725 raft_consensus.cc:1275] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.461606 14910 consensus_queue.cc:1048] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "033717497dd94121afdf5a1b6ef37d0a" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.472258 14651 raft_consensus.cc:1275] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Refusing update from remote peer d436f97319e54eb691e869c30bb7d69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.473556 14910 consensus_queue.cc:1048] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad8512299ad481db24142e6102a8303" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.624455 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:04.630095 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
I20260709 13:05:04.659438 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:04.660321 14516 tablet_replica.cc:333] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.661252 14516 raft_consensus.cc:2243] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.661731 14516 raft_consensus.cc:2272] T 44dd8495bd184c88bba4dd3a22472dbd P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.665176 14516 tablet_replica.cc:333] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.665892 14516 raft_consensus.cc:2243] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.666401 14516 raft_consensus.cc:2272] T d6c81c94872e418d849dd0ab9b45625b P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.669055 14516 tablet_replica.cc:333] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.669559 14516 raft_consensus.cc:2243] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.670002 14516 raft_consensus.cc:2272] T ccc46b1749694686ab473319f66201c1 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.671599 14516 tablet_replica.cc:333] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.672089 14516 raft_consensus.cc:2243] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.672546 14516 raft_consensus.cc:2272] T 33111a18661448e292808d2c81bf5f12 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.674494 14516 tablet_replica.cc:333] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.674988 14516 raft_consensus.cc:2243] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:04.675071 14689 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:04.675455 14516 raft_consensus.cc:2272] T e30396e20ca74b4ea691bcabf475c249 P 5ad8512299ad481db24142e6102a8303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.677482 14516 tablet_replica.cc:333] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.678066 14516 raft_consensus.cc:2243] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.678777 14516 raft_consensus.cc:2272] T e557604675fb4fd0826a11cd44ab3325 P 5ad8512299ad481db24142e6102a8303 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:04.678790 14689 consensus_peers.cc:597] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a -> Peer 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801): Couldn't send request to peer 5ad8512299ad481db24142e6102a8303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.680763 14516 tablet_replica.cc:333] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.681321 14516 raft_consensus.cc:2243] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.682090 14516 raft_consensus.cc:2272] T 0a4f064fc9274a90b38698e67d5b0394 P 5ad8512299ad481db24142e6102a8303 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.683971 14516 tablet_replica.cc:333] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.684446 14516 raft_consensus.cc:2243] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.685117 14516 raft_consensus.cc:2272] T b9799d62a65b4a3d84d5a8d140a61720 P 5ad8512299ad481db24142e6102a8303 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.687006 14516 tablet_replica.cc:333] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303: stopping tablet replica
I20260709 13:05:04.687438 14516 raft_consensus.cc:2243] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.687840 14516 raft_consensus.cc:2272] T 9744f1796ee44238b0d2b0b6293c76f1 P 5ad8512299ad481db24142e6102a8303 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.786567 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
I20260709 13:05:04.807176 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
I20260709 13:05:04.832269 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:04.833101 14516 tablet_replica.cc:333] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.833822 14516 raft_consensus.cc:2243] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.834275 14516 raft_consensus.cc:2272] T e30396e20ca74b4ea691bcabf475c249 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.836154 14516 tablet_replica.cc:333] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.836691 14516 raft_consensus.cc:2243] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.837200 14516 raft_consensus.cc:2272] T 44dd8495bd184c88bba4dd3a22472dbd P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.839869 14516 tablet_replica.cc:333] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.840374 14516 raft_consensus.cc:2243] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.840826 14516 raft_consensus.cc:2272] T d6c81c94872e418d849dd0ab9b45625b P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.843298 14516 tablet_replica.cc:333] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.843858 14516 raft_consensus.cc:2243] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.844666 14516 raft_consensus.cc:2272] T ccc46b1749694686ab473319f66201c1 P 033717497dd94121afdf5a1b6ef37d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.846370 14516 tablet_replica.cc:333] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.846900 14516 raft_consensus.cc:2243] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.847617 14516 raft_consensus.cc:2272] T 33111a18661448e292808d2c81bf5f12 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.849197 14516 tablet_replica.cc:333] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.849670 14516 raft_consensus.cc:2243] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.850127 14516 raft_consensus.cc:2272] T e557604675fb4fd0826a11cd44ab3325 P 033717497dd94121afdf5a1b6ef37d0a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.852197 14516 tablet_replica.cc:333] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.852685 14516 raft_consensus.cc:2243] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.853061 14516 raft_consensus.cc:2272] T b9799d62a65b4a3d84d5a8d140a61720 P 033717497dd94121afdf5a1b6ef37d0a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.855051 14516 tablet_replica.cc:333] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.855522 14516 raft_consensus.cc:2243] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.855980 14516 raft_consensus.cc:2272] T 0a4f064fc9274a90b38698e67d5b0394 P 033717497dd94121afdf5a1b6ef37d0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.858253 14516 tablet_replica.cc:333] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a: stopping tablet replica
I20260709 13:05:04.858705 14516 raft_consensus.cc:2243] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.859465 14516 raft_consensus.cc:2272] T 9744f1796ee44238b0d2b0b6293c76f1 P 033717497dd94121afdf5a1b6ef37d0a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:04.874380 14763 consensus_peers.cc:597] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d -> Peer 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801): Couldn't send request to peer 5ad8512299ad481db24142e6102a8303. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:44801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.891189 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
I20260709 13:05:04.910032 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
I20260709 13:05:04.935344 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:04.936120 14516 tablet_replica.cc:333] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.937572 14516 raft_consensus.cc:2243] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:05:04.937955 14763 consensus_peers.cc:597] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d -> Peer 5ad8512299ad481db24142e6102a8303 (127.14.45.1:44801): Couldn't send request to peer 5ad8512299ad481db24142e6102a8303. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:44801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.938832 14516 raft_consensus.cc:2272] T e30396e20ca74b4ea691bcabf475c249 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.940544 14516 tablet_replica.cc:333] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.941010 14516 raft_consensus.cc:2243] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.941686 14516 raft_consensus.cc:2272] T 44dd8495bd184c88bba4dd3a22472dbd P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.944079 14516 tablet_replica.cc:333] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.944541 14516 raft_consensus.cc:2243] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.944936 14516 raft_consensus.cc:2272] T 33111a18661448e292808d2c81bf5f12 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.946576 14516 tablet_replica.cc:333] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.947007 14516 raft_consensus.cc:2243] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.947345 14516 raft_consensus.cc:2272] T 0a4f064fc9274a90b38698e67d5b0394 P d436f97319e54eb691e869c30bb7d69d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.949285 14516 tablet_replica.cc:333] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.949818 14516 raft_consensus.cc:2243] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.950212 14516 raft_consensus.cc:2272] T b9799d62a65b4a3d84d5a8d140a61720 P d436f97319e54eb691e869c30bb7d69d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.951985 14516 tablet_replica.cc:333] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.952414 14516 raft_consensus.cc:2243] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.952832 14516 raft_consensus.cc:2272] T 9744f1796ee44238b0d2b0b6293c76f1 P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.954794 14516 tablet_replica.cc:333] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.955276 14516 raft_consensus.cc:2243] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.955716 14516 raft_consensus.cc:2272] T e557604675fb4fd0826a11cd44ab3325 P d436f97319e54eb691e869c30bb7d69d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.957963 14516 tablet_replica.cc:333] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.958377 14516 raft_consensus.cc:2243] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.959022 14516 raft_consensus.cc:2272] T d6c81c94872e418d849dd0ab9b45625b P d436f97319e54eb691e869c30bb7d69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.960820 14516 tablet_replica.cc:333] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d: stopping tablet replica
I20260709 13:05:04.961380 14516 raft_consensus.cc:2243] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.961869 14516 raft_consensus.cc:2272] T ccc46b1749694686ab473319f66201c1 P d436f97319e54eb691e869c30bb7d69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.994202 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
I20260709 13:05:05.012459 14516 master.cc:562] Master@127.14.45.62:39391 shutting down...
I20260709 13:05:05.228719 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.229303 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.229676 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P f3a5097a1fe7468e8410bb5d26386bcf: stopping tablet replica
I20260709 13:05:05.250444 14516 master.cc:584] Master@127.14.45.62:39391 shutdown complete.
033717497dd94121afdf5a1b6ef37d0a  4
5ad8512299ad481db24142e6102a8303  4
d436f97319e54eb691e869c30bb7d69d  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12994 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:05.291839 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:42831
I20260709 13:05:05.292999 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:05.299289 15010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.300422 15011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.300957 15013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.301620 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:05.302484 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:05.302659 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:05.302856 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602305302842 us; error 0 us; skew 500 ppm
I20260709 13:05:05.303457 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:05.306254 14516 webserver.cc:533] Webserver started at http://127.14.45.62:41051/ using document root <none> and password file <none>
I20260709 13:05:05.306788 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:05.307001 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:05.307287 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:05.308387 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "466a4217647647d59a6a9db87dc2bb0c"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.313134 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:05:05.316761 15018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.317637 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:05.318040 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "466a4217647647d59a6a9db87dc2bb0c"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.318451 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.337008 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.338487 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.380290 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:42831
I20260709 13:05:05.380370 15069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:42831 every 8 connection(s)
I20260709 13:05:05.384457 15070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.393678 15070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c: Bootstrap starting.
I20260709 13:05:05.398259 15070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.402871 15070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c: No bootstrap required, opened a new log
I20260709 13:05:05.404911 15070 raft_consensus.cc:359] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "466a4217647647d59a6a9db87dc2bb0c" member_type: VOTER }
I20260709 13:05:05.405280 15070 raft_consensus.cc:385] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.405457 15070 raft_consensus.cc:740] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 466a4217647647d59a6a9db87dc2bb0c, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.406039 15070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "466a4217647647d59a6a9db87dc2bb0c" member_type: VOTER }
I20260709 13:05:05.406442 15070 raft_consensus.cc:399] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:05.406639 15070 raft_consensus.cc:493] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:05.406847 15070 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.411286 15070 raft_consensus.cc:515] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "466a4217647647d59a6a9db87dc2bb0c" member_type: VOTER }
I20260709 13:05:05.411775 15070 leader_election.cc:304] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 466a4217647647d59a6a9db87dc2bb0c; no voters: 
I20260709 13:05:05.412885 15070 leader_election.cc:290] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:05.413337 15073 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:05.415030 15073 raft_consensus.cc:697] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 1 LEADER]: Becoming Leader. State: Replica: 466a4217647647d59a6a9db87dc2bb0c, State: Running, Role: LEADER
I20260709 13:05:05.415792 15070 sys_catalog.cc:565] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:05.415824 15073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "466a4217647647d59a6a9db87dc2bb0c" member_type: VOTER }
I20260709 13:05:05.421228 15074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "466a4217647647d59a6a9db87dc2bb0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "466a4217647647d59a6a9db87dc2bb0c" member_type: VOTER } }
I20260709 13:05:05.421720 15075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 466a4217647647d59a6a9db87dc2bb0c. Latest consensus state: current_term: 1 leader_uuid: "466a4217647647d59a6a9db87dc2bb0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "466a4217647647d59a6a9db87dc2bb0c" member_type: VOTER } }
I20260709 13:05:05.421751 15074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:05.422451 15075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:05.425828 15081 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:05.431157 15081 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:05.433452 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:05.440155 15081 catalog_manager.cc:1383] Generated new cluster ID: 0e2a30fe413843529d5ac70a80686232
I20260709 13:05:05.440472 15081 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:05.460314 15081 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:05.461632 15081 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:05.475966 15081 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c: Generated new TSK 0
I20260709 13:05:05.476619 15081 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:05.500386 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:05.507175 15091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.508549 15092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.510880 14516 server_base.cc:1061] running on GCE node
W20260709 13:05:05.511258 15094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.512368 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:05.512586 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:05.512796 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602305512780 us; error 0 us; skew 500 ppm
I20260709 13:05:05.513423 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:05.516095 14516 webserver.cc:533] Webserver started at http://127.14.45.1:44787/ using document root <none> and password file <none>
I20260709 13:05:05.516614 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:05.516803 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:05.517125 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:05.518304 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.523667 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:05:05.527571 15099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.528576 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:05:05.528865 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.529117 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.551589 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.552866 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.554699 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:05.557334 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:05.557519 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.557713 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:05.557955 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:05.602603 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:45251
I20260709 13:05:05.602685 15161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:45251 every 8 connection(s)
I20260709 13:05:05.607721 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:05.615095 15166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.616285 15167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.619482 15169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.619727 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:05.621237 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:05.621632 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:05.621886 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602305621864 us; error 0 us; skew 500 ppm
I20260709 13:05:05.622664 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:05.625522 15162 heartbeater.cc:344] Connected to a master server at 127.14.45.62:42831
I20260709 13:05:05.626042 15162 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.626073 14516 webserver.cc:533] Webserver started at http://127.14.45.2:43509/ using document root <none> and password file <none>
I20260709 13:05:05.626837 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:05.627029 15162 heartbeater.cc:507] Master 127.14.45.62:42831 requested a full tablet report, sending...
I20260709 13:05:05.627169 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:05.627663 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:05.629176 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "e87745797c064543b215a278aac8a0ef"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.629691 15035 ts_manager.cc:194] Registered new tserver with Master: eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251)
I20260709 13:05:05.631676 15035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60918
I20260709 13:05:05.634466 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:05:05.638073 15174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.638890 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:05.639223 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "e87745797c064543b215a278aac8a0ef"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.639525 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.666253 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.667464 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.668968 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:05.671257 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:05.671489 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.671742 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:05.671914 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.713367 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:39237
I20260709 13:05:05.713485 15236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:39237 every 8 connection(s)
I20260709 13:05:05.718448 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:05.726233 15240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.727597 15241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.730654 15243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.730832 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:05.731462 15237 heartbeater.cc:344] Connected to a master server at 127.14.45.62:42831
I20260709 13:05:05.731869 15237 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.732232 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:05.732427 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:05.732630 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602305732597 us; error 0 us; skew 500 ppm
I20260709 13:05:05.732715 15237 heartbeater.cc:507] Master 127.14.45.62:42831 requested a full tablet report, sending...
I20260709 13:05:05.733239 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:05.734861 15035 ts_manager.cc:194] Registered new tserver with Master: e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:05.736115 14516 webserver.cc:533] Webserver started at http://127.14.45.3:43561/ using document root <none> and password file <none>
I20260709 13:05:05.736380 15035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60926
I20260709 13:05:05.736683 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:05.736922 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:05.737226 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:05.738783 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.743649 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:05.747213 15248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.748148 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:05:05.748476 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-lfdf"
I20260709 13:05:05.748764 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.771378 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.772584 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.774247 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:05.776552 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:05.776793 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.777042 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:05.777240 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.823441 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:38277
I20260709 13:05:05.823547 15310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:38277 every 8 connection(s)
I20260709 13:05:05.838445 15311 heartbeater.cc:344] Connected to a master server at 127.14.45.62:42831
I20260709 13:05:05.838886 15311 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.839665 15311 heartbeater.cc:507] Master 127.14.45.62:42831 requested a full tablet report, sending...
I20260709 13:05:05.841630 15035 ts_manager.cc:194] Registered new tserver with Master: 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:05.842015 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014880998s
I20260709 13:05:05.843225 15035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60938
I20260709 13:05:05.869390 15035 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60940:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:05.872617 15035 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:05.943931 15276 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8d5cb8150e454aa9a3b1ec476d44e9 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:05.947278 15275 tablet_service.cc:1511] Processing CreateTablet for tablet 7620299c81384bc9a15313595e1bc08f (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:05.947796 15276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8d5cb8150e454aa9a3b1ec476d44e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.950073 15274 tablet_service.cc:1511] Processing CreateTablet for tablet 5171c2a0b07847cda0cbc1b6a2f8087c (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:05.953823 15274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171c2a0b07847cda0cbc1b6a2f8087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.956095 15273 tablet_service.cc:1511] Processing CreateTablet for tablet 4941a612d8754e09b312fddcf1b13bbd (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:05.957486 15273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4941a612d8754e09b312fddcf1b13bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.958961 15126 tablet_service.cc:1511] Processing CreateTablet for tablet 7620299c81384bc9a15313595e1bc08f (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:05.959096 15127 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8d5cb8150e454aa9a3b1ec476d44e9 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:05.960391 15126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7620299c81384bc9a15313595e1bc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.960153 15123 tablet_service.cc:1511] Processing CreateTablet for tablet 2488d6b23c044454b4fcd0c2901f4e6a (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:05.962250 15124 tablet_service.cc:1511] Processing CreateTablet for tablet 4941a612d8754e09b312fddcf1b13bbd (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:05.962469 15272 tablet_service.cc:1511] Processing CreateTablet for tablet 2488d6b23c044454b4fcd0c2901f4e6a (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:05.964202 15123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2488d6b23c044454b4fcd0c2901f4e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.964435 15125 tablet_service.cc:1511] Processing CreateTablet for tablet 5171c2a0b07847cda0cbc1b6a2f8087c (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:05.965133 15124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4941a612d8754e09b312fddcf1b13bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.966766 15125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171c2a0b07847cda0cbc1b6a2f8087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.967344 15271 tablet_service.cc:1511] Processing CreateTablet for tablet 4e192c19bbe1432b93c4af291ec744d1 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:05.969650 15122 tablet_service.cc:1511] Processing CreateTablet for tablet 4e192c19bbe1432b93c4af291ec744d1 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:05.970247 15272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2488d6b23c044454b4fcd0c2901f4e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.970896 15275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7620299c81384bc9a15313595e1bc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.971011 15122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e192c19bbe1432b93c4af291ec744d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.977919 15268 tablet_service.cc:1511] Processing CreateTablet for tablet 89a277404a6c43c994c73a9e0e149a3c (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:05.979401 15268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a277404a6c43c994c73a9e0e149a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.982993 15270 tablet_service.cc:1511] Processing CreateTablet for tablet 699af4836d65482a8fa094f7f0afc1fb (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:05.984584 15270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699af4836d65482a8fa094f7f0afc1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.986927 15269 tablet_service.cc:1511] Processing CreateTablet for tablet b47bc623b4e0489d839d31859906c849 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:05.988348 15269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47bc623b4e0489d839d31859906c849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.991037 15267 tablet_service.cc:1511] Processing CreateTablet for tablet acc882af15c8479b86f8cfe8353a2897 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:05.992403 15267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc882af15c8479b86f8cfe8353a2897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.981387 15121 tablet_service.cc:1511] Processing CreateTablet for tablet 699af4836d65482a8fa094f7f0afc1fb (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:05.994903 15121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699af4836d65482a8fa094f7f0afc1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.997969 15120 tablet_service.cc:1511] Processing CreateTablet for tablet b47bc623b4e0489d839d31859906c849 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:05.999540 15127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8d5cb8150e454aa9a3b1ec476d44e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.001667 15202 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8d5cb8150e454aa9a3b1ec476d44e9 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:06.002045 15119 tablet_service.cc:1511] Processing CreateTablet for tablet 89a277404a6c43c994c73a9e0e149a3c (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:06.003317 15202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8d5cb8150e454aa9a3b1ec476d44e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.006457 15118 tablet_service.cc:1511] Processing CreateTablet for tablet acc882af15c8479b86f8cfe8353a2897 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:06.007745 15271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e192c19bbe1432b93c4af291ec744d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.007437 15201 tablet_service.cc:1511] Processing CreateTablet for tablet 7620299c81384bc9a15313595e1bc08f (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:06.008788 15201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7620299c81384bc9a15313595e1bc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.009557 15119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a277404a6c43c994c73a9e0e149a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.011576 15200 tablet_service.cc:1511] Processing CreateTablet for tablet 5171c2a0b07847cda0cbc1b6a2f8087c (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:06.013140 15118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc882af15c8479b86f8cfe8353a2897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.016481 15120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47bc623b4e0489d839d31859906c849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.017710 15200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171c2a0b07847cda0cbc1b6a2f8087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.031595 15199 tablet_service.cc:1511] Processing CreateTablet for tablet 4941a612d8754e09b312fddcf1b13bbd (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:06.033131 15199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4941a612d8754e09b312fddcf1b13bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.039613 15198 tablet_service.cc:1511] Processing CreateTablet for tablet 2488d6b23c044454b4fcd0c2901f4e6a (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:06.041098 15198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2488d6b23c044454b4fcd0c2901f4e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.055642 15197 tablet_service.cc:1511] Processing CreateTablet for tablet 4e192c19bbe1432b93c4af291ec744d1 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:06.057149 15197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e192c19bbe1432b93c4af291ec744d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.057055 15193 tablet_service.cc:1511] Processing CreateTablet for tablet acc882af15c8479b86f8cfe8353a2897 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:06.058519 15193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc882af15c8479b86f8cfe8353a2897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.059005 15196 tablet_service.cc:1511] Processing CreateTablet for tablet 699af4836d65482a8fa094f7f0afc1fb (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:06.060371 15196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699af4836d65482a8fa094f7f0afc1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.063064 15195 tablet_service.cc:1511] Processing CreateTablet for tablet b47bc623b4e0489d839d31859906c849 (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:06.064477 15195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47bc623b4e0489d839d31859906c849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.068735 15194 tablet_service.cc:1511] Processing CreateTablet for tablet 89a277404a6c43c994c73a9e0e149a3c (DEFAULT_TABLE table=test-workload [id=5ad5852828c24a769366604936939e56]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:06.070344 15194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a277404a6c43c994c73a9e0e149a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.118793 15326 tablet_bootstrap.cc:492] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.139678 15325 tablet_bootstrap.cc:492] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.145860 15326 tablet_bootstrap.cc:654] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.146616 15325 tablet_bootstrap.cc:654] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.180593 15327 tablet_bootstrap.cc:492] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.192916 15327 tablet_bootstrap.cc:654] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.194453 15325 tablet_bootstrap.cc:492] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.194447 15326 tablet_bootstrap.cc:492] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.195104 15326 ts_tablet_manager.cc:1403] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.014s
I20260709 13:05:06.195106 15325 ts_tablet_manager.cc:1403] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.013s
I20260709 13:05:06.198164 15326 raft_consensus.cc:359] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.198781 15326 raft_consensus.cc:385] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.198489 15325 raft_consensus.cc:359] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.199059 15326 raft_consensus.cc:740] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.199075 15327 tablet_bootstrap.cc:492] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.199304 15325 raft_consensus.cc:385] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.199664 15325 raft_consensus.cc:740] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.199831 15327 ts_tablet_manager.cc:1403] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:05:06.200012 15326 consensus_queue.cc:260] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.200474 15325 consensus_queue.cc:260] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.203222 15311 heartbeater.cc:499] Master 127.14.45.62:42831 was elected leader, sending a full tablet report...
I20260709 13:05:06.203516 15325 ts_tablet_manager.cc:1434] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:05:06.204521 15325 tablet_bootstrap.cc:492] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.206948 15162 heartbeater.cc:499] Master 127.14.45.62:42831 was elected leader, sending a full tablet report...
I20260709 13:05:06.207185 15327 raft_consensus.cc:359] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.208114 15327 raft_consensus.cc:385] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.208461 15327 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.209448 15327 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.211498 15325 tablet_bootstrap.cc:654] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.212220 15326 ts_tablet_manager.cc:1434] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:05:06.213572 15326 tablet_bootstrap.cc:492] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.221072 15326 tablet_bootstrap.cc:654] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.224236 15325 tablet_bootstrap.cc:492] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.224839 15325 ts_tablet_manager.cc:1403] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:05:06.224867 15327 ts_tablet_manager.cc:1434] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 13:05:06.225957 15237 heartbeater.cc:499] Master 127.14.45.62:42831 was elected leader, sending a full tablet report...
I20260709 13:05:06.228180 15325 raft_consensus.cc:359] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.228945 15325 raft_consensus.cc:385] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.229280 15325 raft_consensus.cc:740] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.230221 15325 consensus_queue.cc:260] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.232893 15325 ts_tablet_manager.cc:1434] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:05:06.233930 15326 tablet_bootstrap.cc:492] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.234072 15325 tablet_bootstrap.cc:492] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.234760 15326 ts_tablet_manager.cc:1403] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:05:06.237704 15326 raft_consensus.cc:359] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.238689 15326 raft_consensus.cc:385] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.239070 15326 raft_consensus.cc:740] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.240024 15326 consensus_queue.cc:260] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.241775 15325 tablet_bootstrap.cc:654] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.241780 15327 tablet_bootstrap.cc:492] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.242117 15326 ts_tablet_manager.cc:1434] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:05:06.243126 15326 tablet_bootstrap.cc:492] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.250075 15326 tablet_bootstrap.cc:654] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.250075 15327 tablet_bootstrap.cc:654] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.250403 15325 tablet_bootstrap.cc:492] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.251142 15325 ts_tablet_manager.cc:1403] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:05:06.254155 15325 raft_consensus.cc:359] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.254966 15325 raft_consensus.cc:385] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.255323 15325 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.256176 15325 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.258711 15325 ts_tablet_manager.cc:1434] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:05:06.259759 15325 tablet_bootstrap.cc:492] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.260425 15332 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.260912 15332 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.262907 15327 tablet_bootstrap.cc:492] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.263032 15326 tablet_bootstrap.cc:492] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.263604 15327 ts_tablet_manager.cc:1403] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:05:06.263695 15332 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.263604 15326 ts_tablet_manager.cc:1403] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:05:06.269225 15327 raft_consensus.cc:359] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.270362 15327 raft_consensus.cc:385] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.270754 15327 raft_consensus.cc:740] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.271703 15327 consensus_queue.cc:260] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.274158 15327 ts_tablet_manager.cc:1434] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:06.275256 15327 tablet_bootstrap.cc:492] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.276921 15325 tablet_bootstrap.cc:654] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.283866 15327 tablet_bootstrap.cc:654] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.284480 15326 raft_consensus.cc:359] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.285363 15326 raft_consensus.cc:385] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.285753 15326 raft_consensus.cc:740] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.289779 15326 consensus_queue.cc:260] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.291462 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.292148 15326 ts_tablet_manager.cc:1434] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:05:06.292447 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.293107 15212 raft_consensus.cc:2468] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 0.
I20260709 13:05:06.294939 15326 tablet_bootstrap.cc:492] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.302596 15326 tablet_bootstrap.cc:654] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:06.303040 15249 leader_election.cc:343] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.303869 15249 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.304805 15332 raft_consensus.cc:2804] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.305263 15332 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.305807 15332 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.318753 15327 tablet_bootstrap.cc:492] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.319769 15327 ts_tablet_manager.cc:1403] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.009s
I20260709 13:05:06.320103 15332 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.323118 15342 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.323709 15342 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.326308 15342 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.326529 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:06.327594 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
W20260709 13:05:06.329465 15249 leader_election.cc:343] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:06.330587 15249 leader_election.cc:343] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.330700 15332 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.330976 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.331811 15326 tablet_bootstrap.cc:492] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
W20260709 13:05:06.332566 15249 leader_election.cc:343] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.332402 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.332402 15326 ts_tablet_manager.cc:1403] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.006s
I20260709 13:05:06.333331 15212 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.333251 15249 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6; no voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.334801 15332 raft_consensus.cc:2749] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.335278 15325 tablet_bootstrap.cc:492] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.332261 15327 raft_consensus.cc:359] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.335863 15327 raft_consensus.cc:385] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.335930 15325 ts_tablet_manager.cc:1403] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.039s
I20260709 13:05:06.336369 15327 raft_consensus.cc:740] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.337283 15327 consensus_queue.cc:260] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.337466 15326 raft_consensus.cc:359] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.338335 15333 raft_consensus.cc:493] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.338367 15326 raft_consensus.cc:385] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.339150 15326 raft_consensus.cc:740] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.339072 15333 raft_consensus.cc:515] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.340875 15326 consensus_queue.cc:260] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.342841 15212 raft_consensus.cc:2468] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 1.
I20260709 13:05:06.344405 15249 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.345795 15332 raft_consensus.cc:2804] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.346397 15332 raft_consensus.cc:697] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:06.348713 15326 ts_tablet_manager.cc:1434] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:06.350169 15326 tablet_bootstrap.cc:492] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.351588 15333 leader_election.cc:290] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.347491 15332 consensus_queue.cc:237] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.356456 15327 ts_tablet_manager.cc:1434] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 13:05:06.357678 15327 tablet_bootstrap.cc:492] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.360215 15326 tablet_bootstrap.cc:654] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.368320 15327 tablet_bootstrap.cc:654] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.375020 15325 raft_consensus.cc:359] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.375631 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
W20260709 13:05:06.379431 15178 leader_election.cc:343] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.376214 15325 raft_consensus.cc:385] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.383659 15325 raft_consensus.cc:740] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.384670 15325 consensus_queue.cc:260] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.388149 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.387946 15034 catalog_manager.cc:5697] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.390269 15325 ts_tablet_manager.cc:1434] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
W20260709 13:05:06.390169 15175 leader_election.cc:343] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.391593 15325 tablet_bootstrap.cc:492] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.390846 15175 leader_election.cc:304] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.393532 15333 raft_consensus.cc:2749] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.395440 15326 tablet_bootstrap.cc:492] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.396054 15326 ts_tablet_manager.cc:1403] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.007s
I20260709 13:05:06.396473 15327 tablet_bootstrap.cc:492] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.397114 15327 ts_tablet_manager.cc:1403] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.001s
I20260709 13:05:06.399531 15325 tablet_bootstrap.cc:654] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.399722 15326 raft_consensus.cc:359] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.400705 15326 raft_consensus.cc:385] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.401126 15326 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.400862 15327 raft_consensus.cc:359] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.402092 15327 raft_consensus.cc:385] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.402606 15327 raft_consensus.cc:740] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.402163 15326 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.403867 15327 consensus_queue.cc:260] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.407099 15327 ts_tablet_manager.cc:1434] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:05:06.408165 15326 ts_tablet_manager.cc:1434] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:05:06.408339 15327 tablet_bootstrap.cc:492] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.409380 15326 tablet_bootstrap.cc:492] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.418179 15327 tablet_bootstrap.cc:654] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.419183 15326 tablet_bootstrap.cc:654] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.422544 15325 tablet_bootstrap.cc:492] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.423086 15325 ts_tablet_manager.cc:1403] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 13:05:06.426982 15325 raft_consensus.cc:359] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.428290 15325 raft_consensus.cc:385] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:06.428683 15083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:06.428750 15325 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.431034 15327 tablet_bootstrap.cc:492] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.431605 15327 ts_tablet_manager.cc:1403] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:05:06.430217 15325 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.434948 15325 ts_tablet_manager.cc:1434] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:05:06.435150 15327 raft_consensus.cc:359] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.436124 15327 raft_consensus.cc:385] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.436452 15325 tablet_bootstrap.cc:492] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.436511 15327 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.437716 15327 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.443051 15327 ts_tablet_manager.cc:1434] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:05:06.444321 15327 tablet_bootstrap.cc:492] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.447211 15326 tablet_bootstrap.cc:492] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.447796 15326 ts_tablet_manager.cc:1403] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.025s
I20260709 13:05:06.449709 15325 tablet_bootstrap.cc:654] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.451012 15326 raft_consensus.cc:359] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.451828 15326 raft_consensus.cc:385] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.452142 15326 raft_consensus.cc:740] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.453114 15326 consensus_queue.cc:260] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.455135 15327 tablet_bootstrap.cc:654] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.456211 15326 ts_tablet_manager.cc:1434] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:05:06.457242 15326 tablet_bootstrap.cc:492] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.464018 15326 tablet_bootstrap.cc:654] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.466291 15331 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.466820 15331 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.471817 15331 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.477560 15327 tablet_bootstrap.cc:492] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.478492 15327 ts_tablet_manager.cc:1403] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.007s
I20260709 13:05:06.485795 15327 raft_consensus.cc:359] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.486949 15327 raft_consensus.cc:385] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.487372 15327 raft_consensus.cc:740] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.488453 15327 consensus_queue.cc:260] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.494037 15325 tablet_bootstrap.cc:492] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.496491 15325 ts_tablet_manager.cc:1403] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.019s
I20260709 13:05:06.499733 15333 raft_consensus.cc:493] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.500370 15333 raft_consensus.cc:515] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.502101 15325 raft_consensus.cc:359] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.503199 15325 raft_consensus.cc:385] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.503630 15325 raft_consensus.cc:740] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.504477 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.504865 15325 consensus_queue.cc:260] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
W20260709 13:05:06.506603 15175 leader_election.cc:343] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.508599 15333 leader_election.cc:290] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.509341 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
W20260709 13:05:06.510933 15178 leader_election.cc:343] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.511473 15325 ts_tablet_manager.cc:1434] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:06.511387 15178 leader_election.cc:304] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.511713 15327 ts_tablet_manager.cc:1434] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:05:06.512629 15325 tablet_bootstrap.cc:492] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.512742 15333 raft_consensus.cc:2749] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.520002 15325 tablet_bootstrap.cc:654] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.525041 15331 raft_consensus.cc:493] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.525811 15331 raft_consensus.cc:515] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.526827 15327 tablet_bootstrap.cc:492] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.528704 15331 leader_election.cc:290] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.536634 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
W20260709 13:05:06.538412 15103 leader_election.cc:343] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.538631 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.539449 15285 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.540884 15103 leader_election.cc:304] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.541872 15331 raft_consensus.cc:2804] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.542273 15331 raft_consensus.cc:493] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.542668 15331 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.543545 15326 tablet_bootstrap.cc:492] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.543598 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.544173 15326 ts_tablet_manager.cc:1403] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.014s
I20260709 13:05:06.544224 15327 tablet_bootstrap.cc:654] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.545015 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
W20260709 13:05:06.546842 15100 leader_election.cc:343] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.547299 15100 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef
I20260709 13:05:06.547391 15326 raft_consensus.cc:359] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.548152 15326 raft_consensus.cc:385] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.548548 15326 raft_consensus.cc:740] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.552189 15325 tablet_bootstrap.cc:492] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.552935 15325 ts_tablet_manager.cc:1403] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.008s
I20260709 13:05:06.552675 15331 raft_consensus.cc:515] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.556067 15360 raft_consensus.cc:2749] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:06.556195 15100 leader_election.cc:343] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.556645 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.556720 15325 raft_consensus.cc:359] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.557257 15331 leader_election.cc:290] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.549592 15326 consensus_queue.cc:260] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.558333 15285 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.558416 15325 raft_consensus.cc:385] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.558909 15325 raft_consensus.cc:740] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.560065 15326 ts_tablet_manager.cc:1434] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:06.559762 15325 consensus_queue.cc:260] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.561056 15326 tablet_bootstrap.cc:492] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.558328 15327 tablet_bootstrap.cc:492] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.566367 15327 ts_tablet_manager.cc:1403] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.006s
I20260709 13:05:06.568228 15326 tablet_bootstrap.cc:654] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.570022 15325 ts_tablet_manager.cc:1434] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:05:06.569960 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.571481 15327 raft_consensus.cc:359] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.572201 15325 tablet_bootstrap.cc:492] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.572415 15327 raft_consensus.cc:385] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.572788 15327 raft_consensus.cc:740] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.571242 15360 raft_consensus.cc:493] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.574374 15100 leader_election.cc:343] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.574965 15285 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:06.575012 15327 consensus_queue.cc:260] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.577508 15327 ts_tablet_manager.cc:1434] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:06.574071 15360 raft_consensus.cc:515] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.579499 15325 tablet_bootstrap.cc:654] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.579741 15360 leader_election.cc:290] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.579491 15103 leader_election.cc:304] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: e87745797c064543b215a278aac8a0ef
I20260709 13:05:06.582242 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.584641 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.585616 15285 raft_consensus.cc:2468] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
W20260709 13:05:06.586025 15100 leader_election.cc:343] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.587342 15103 leader_election.cc:304] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: e87745797c064543b215a278aac8a0ef
I20260709 13:05:06.587601 15327 tablet_bootstrap.cc:492] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.587438 15360 raft_consensus.cc:2804] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.588207 15331 raft_consensus.cc:2804] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.588596 15331 raft_consensus.cc:493] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.588940 15331 raft_consensus.cc:3060] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.591192 15332 raft_consensus.cc:493] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.591699 15332 raft_consensus.cc:515] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.594321 15332 leader_election.cc:290] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.595839 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc882af15c8479b86f8cfe8353a2897" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.595839 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc882af15c8479b86f8cfe8353a2897" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.597386 15211 raft_consensus.cc:2468] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 0.
W20260709 13:05:06.598619 15249 leader_election.cc:343] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.599159 15249 leader_election.cc:304] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.599939 15332 raft_consensus.cc:2804] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.600425 15332 raft_consensus.cc:493] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.600855 15326 tablet_bootstrap.cc:492] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.600931 15332 raft_consensus.cc:3060] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.601390 15326 ts_tablet_manager.cc:1403] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.001s
I20260709 13:05:06.603127 15331 raft_consensus.cc:515] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.604130 15326 raft_consensus.cc:359] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.604803 15326 raft_consensus.cc:385] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.605077 15326 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.606036 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.605926 15326 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
W20260709 13:05:06.607761 15100 leader_election.cc:343] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.610451 15325 tablet_bootstrap.cc:492] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.615200 15325 ts_tablet_manager.cc:1403] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.008s
I20260709 13:05:06.617707 15326 ts_tablet_manager.cc:1434] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 13:05:06.618746 15326 tablet_bootstrap.cc:492] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.614039 15332 raft_consensus.cc:515] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.620741 15331 leader_election.cc:290] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.620961 15325 raft_consensus.cc:359] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.621829 15325 raft_consensus.cc:385] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.622960 15325 raft_consensus.cc:740] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.623068 15332 leader_election.cc:290] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.623778 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc882af15c8479b86f8cfe8353a2897" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.623701 15325 consensus_queue.cc:260] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.624377 15211 raft_consensus.cc:3060] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.625712 15325 ts_tablet_manager.cc:1434] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:05:06.626504 15326 tablet_bootstrap.cc:654] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.626601 15325 tablet_bootstrap.cc:492] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.621889 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.627343 15285 raft_consensus.cc:3060] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.621912 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc882af15c8479b86f8cfe8353a2897" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
W20260709 13:05:06.632296 15249 leader_election.cc:343] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.635368 15325 tablet_bootstrap.cc:654] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.636538 15211 raft_consensus.cc:2468] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 1.
I20260709 13:05:06.622390 15360 raft_consensus.cc:697] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:06.641682 15326 tablet_bootstrap.cc:492] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.643792 15326 ts_tablet_manager.cc:1403] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 13:05:06.643692 15285 raft_consensus.cc:2468] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:06.643955 15360 consensus_queue.cc:237] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.645326 15325 tablet_bootstrap.cc:492] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.645195 15103 leader_election.cc:304] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: e87745797c064543b215a278aac8a0ef
I20260709 13:05:06.620112 15327 tablet_bootstrap.cc:654] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.645901 15325 ts_tablet_manager.cc:1403] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.003s
I20260709 13:05:06.646786 15363 raft_consensus.cc:2804] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.647449 15363 raft_consensus.cc:697] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:06.648532 15363 consensus_queue.cc:237] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.649111 15325 raft_consensus.cc:359] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.649971 15325 raft_consensus.cc:385] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.650187 15249 leader_election.cc:304] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.650384 15325 raft_consensus.cc:740] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.651125 15326 raft_consensus.cc:359] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.651525 15332 raft_consensus.cc:2804] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.651844 15326 raft_consensus.cc:385] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.652041 15332 raft_consensus.cc:697] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:06.652161 15326 raft_consensus.cc:740] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.651620 15325 consensus_queue.cc:260] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.652918 15326 consensus_queue.cc:260] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.652889 15332 consensus_queue.cc:237] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.655385 15326 ts_tablet_manager.cc:1434] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:05:06.656291 15326 tablet_bootstrap.cc:492] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755: Bootstrap starting.
I20260709 13:05:06.660176 15333 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.660666 15333 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.662922 15333 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277), eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251)
I20260709 13:05:06.663602 15327 tablet_bootstrap.cc:492] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.664028 15327 ts_tablet_manager.cc:1403] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.001s
I20260709 13:05:06.664520 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.665146 15286 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 0.
I20260709 13:05:06.666529 15178 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:06.666671 15327 raft_consensus.cc:359] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.667282 15327 raft_consensus.cc:385] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.668650 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.670934 15327 raft_consensus.cc:740] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.671159 15137 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 0.
I20260709 13:05:06.671619 15327 consensus_queue.cc:260] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.673645 15327 ts_tablet_manager.cc:1434] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:06.675371 15327 tablet_bootstrap.cc:492] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.676100 15325 ts_tablet_manager.cc:1434] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.012s
I20260709 13:05:06.677484 15325 tablet_bootstrap.cc:492] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6: Bootstrap starting.
I20260709 13:05:06.682044 15327 tablet_bootstrap.cc:654] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.669216 15333 raft_consensus.cc:2804] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.670596 15326 tablet_bootstrap.cc:654] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.682236 15344 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.682557 15333 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.683100 15333 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.683125 15344 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.686343 15344 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.687631 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.688452 15137 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 0.
I20260709 13:05:06.690044 15325 tablet_bootstrap.cc:654] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.690161 15175 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.691896 15369 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.692480 15369 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.695519 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.696390 15286 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 0.
I20260709 13:05:06.698101 15331 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.698599 15331 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.699453 15369 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.700166 15364 raft_consensus.cc:493] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.700686 15364 raft_consensus.cc:515] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.700712 15331 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.702816 15325 tablet_bootstrap.cc:492] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6: No bootstrap required, opened a new log
I20260709 13:05:06.702996 15364 leader_election.cc:290] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.703356 15325 ts_tablet_manager.cc:1403] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:05:06.703750 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.704391 15211 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.705717 15100 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.706089 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.706142 15325 raft_consensus.cc:359] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.707039 15325 raft_consensus.cc:385] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.706089 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.707500 15325 raft_consensus.cc:740] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.707931 15211 raft_consensus.cc:2468] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.708019 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.708350 15325 consensus_queue.cc:260] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.708794 15284 raft_consensus.cc:2468] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.710090 15100 leader_election.cc:304] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.710539 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.710978 15325 ts_tablet_manager.cc:1434] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:06.710969 15331 raft_consensus.cc:2804] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.711172 15211 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 0.
I20260709 13:05:06.711468 15331 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.711858 15331 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.712118 15344 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.712405 15249 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:06.713038 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.713351 15369 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.713730 15369 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.713877 15137 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 0.
I20260709 13:05:06.714143 15369 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.707062 15286 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.712474 15344 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.718287 15344 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.718482 15364 raft_consensus.cc:2804] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.719926 15364 raft_consensus.cc:493] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.720381 15364 raft_consensus.cc:3060] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.722519 15369 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.725353 15331 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.731463 15331 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.725864 15369 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:06.726926 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:06.732426 15137 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.732509 15364 raft_consensus.cc:515] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.732321 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.734061 15212 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.736132 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.736884 15210 raft_consensus.cc:3060] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.740304 15137 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 1.
I20260709 13:05:06.742424 15249 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.746660 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.747593 15286 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.728932 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.750324 15369 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.755825 15369 raft_consensus.cc:697] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:06.757830 15369 consensus_queue.cc:237] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.759230 15375 raft_consensus.cc:493] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.782308 15364 leader_election.cc:290] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.788254 15331 raft_consensus.cc:493] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.799731 15331 raft_consensus.cc:515] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.790148 15212 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:06.804220 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.805100 15285 raft_consensus.cc:3060] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.807159 15333 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.814282 15100 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.815696 15364 raft_consensus.cc:2804] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.816305 15364 raft_consensus.cc:697] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:06.817714 15364 consensus_queue.cc:237] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.823688 15363 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.824391 15363 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.801508 15332 consensus_queue.cc:1048] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:05:06.829672 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.832109 15331 leader_election.cc:290] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.834165 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.835018 15284 raft_consensus.cc:2468] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.836706 15103 leader_election.cc:304] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.837857 15363 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.838639 15363 raft_consensus.cc:2804] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.839196 15363 raft_consensus.cc:493] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.839622 15363 raft_consensus.cc:3060] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.849154 15208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.795635 15375 raft_consensus.cc:515] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.851281 15208 raft_consensus.cc:2468] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 0.
I20260709 13:05:06.854650 15209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:06.857846 15100 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef
I20260709 13:05:06.859375 15331 raft_consensus.cc:2749] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.790194 15210 raft_consensus.cc:2468] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:06.893985 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:06.893920 15100 leader_election.cc:304] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:06.894640 15375 leader_election.cc:290] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.894994 15331 raft_consensus.cc:2804] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.880453 15286 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:06.864336 15344 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.879741 15285 raft_consensus.cc:2468] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:06.904615 15326 tablet_bootstrap.cc:492] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755: No bootstrap required, opened a new log
I20260709 13:05:06.905110 15326 ts_tablet_manager.cc:1403] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent bootstrapping tablet: real 0.249s	user 0.030s	sys 0.065s
I20260709 13:05:06.851864 15035 catalog_manager.cc:5697] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.911691 15211 raft_consensus.cc:2393] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91a41ab044d64b9c8b818b2f38fe92f6 in current term 1: Already voted for candidate e87745797c064543b215a278aac8a0ef in this term.
I20260709 13:05:06.924177 15326 raft_consensus.cc:359] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.924672 15344 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.924932 15326 raft_consensus.cc:385] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.925202 15331 raft_consensus.cc:697] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:06.925233 15326 raft_consensus.cc:740] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.926206 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:06.926875 15331 consensus_queue.cc:237] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.927345 15326 consensus_queue.cc:260] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.930469 15326 ts_tablet_manager.cc:1434] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:05:06.929323 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.918352 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.936439 15285 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.927366 15137 raft_consensus.cc:2393] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e87745797c064543b215a278aac8a0ef in current term 1: Already voted for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in this term.
I20260709 13:05:06.937600 15363 raft_consensus.cc:515] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.938712 15175 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.940364 15363 leader_election.cc:290] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:06.940572 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:06.940215 15344 raft_consensus.cc:2749] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.942238 15327 tablet_bootstrap.cc:492] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:06.942731 15327 ts_tablet_manager.cc:1403] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.268s	user 0.041s	sys 0.057s
I20260709 13:05:06.941797 15210 raft_consensus.cc:3060] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.945659 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:06.946292 15284 raft_consensus.cc:3060] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.950006 15137 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.954960 15286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:06.956126 15286 raft_consensus.cc:2393] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e87745797c064543b215a278aac8a0ef in current term 1: Already voted for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in this term.
I20260709 13:05:06.956328 15327 raft_consensus.cc:359] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.957031 15327 raft_consensus.cc:385] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.957629 15327 raft_consensus.cc:740] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.958304 15178 leader_election.cc:304] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:06.958577 15327 consensus_queue.cc:260] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:06.959460 15344 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.960651 15136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:06.961143 15327 ts_tablet_manager.cc:1434] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:05:06.961257 15136 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.962224 15327 tablet_bootstrap.cc:492] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: Bootstrap starting.
I20260709 13:05:06.962255 15285 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 1.
I20260709 13:05:06.963871 15178 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:06.965866 15377 raft_consensus.cc:2804] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.966605 15377 raft_consensus.cc:697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:06.967921 15344 raft_consensus.cc:2749] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.967505 15377 consensus_queue.cc:237] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:06.965317 15333 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 election: Requested vote from peers 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277), eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251)
I20260709 13:05:06.974222 15034 catalog_manager.cc:5697] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.991405 15369 consensus_queue.cc:1048] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.014367 15210 raft_consensus.cc:2468] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:07.016285 15100 leader_election.cc:304] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:07.030489 15369 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.031360 15284 raft_consensus.cc:2468] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 1.
I20260709 13:05:07.031181 15369 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.036425 15369 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:07.036933 15135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:07.034062 15331 raft_consensus.cc:2804] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.037726 15135 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 0.
I20260709 13:05:07.038074 15331 raft_consensus.cc:697] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.039027 15249 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:07.039779 15369 raft_consensus.cc:2804] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.038184 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:07.039494 15331 consensus_queue.cc:237] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.040256 15369 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.040789 15369 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.029313 15136 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 1.
W20260709 13:05:07.041445 15249 leader_election.cc:343] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.046347 15327 tablet_bootstrap.cc:654] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.046759 15369 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.051457 15369 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:07.053350 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:07.054009 15137 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.065358 15032 catalog_manager.cc:5697] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.069715 15137 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 1.
I20260709 13:05:07.071197 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:07.071413 15377 raft_consensus.cc:493] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.070055 15035 catalog_manager.cc:5697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 0 to 1, leader changed from <none> to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 1 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.072995 15377 raft_consensus.cc:515] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.075204 15377 leader_election.cc:290] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.076493 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:07.077334 15284 raft_consensus.cc:2393] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e87745797c064543b215a278aac8a0ef in current term 1: Already voted for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in this term.
I20260709 13:05:07.077708 15249 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
W20260709 13:05:07.078729 15249 leader_election.cc:343] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.079210 15342 raft_consensus.cc:2804] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.079720 15342 raft_consensus.cc:697] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:07.080438 15327 tablet_bootstrap.cc:492] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: No bootstrap required, opened a new log
I20260709 13:05:07.080925 15327 ts_tablet_manager.cc:1403] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.005s
I20260709 13:05:07.080567 15342 consensus_queue.cc:237] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.083580 15327 raft_consensus.cc:359] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.084292 15327 raft_consensus.cc:385] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.084582 15327 raft_consensus.cc:740] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.084651 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:07.085897 15327 consensus_queue.cc:260] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.086128 15175 leader_election.cc:304] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:07.087424 15377 raft_consensus.cc:3060] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.094002 15327 ts_tablet_manager.cc:1434] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:07.095611 15377 raft_consensus.cc:2749] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:07.106428 15034 catalog_manager.cc:5697] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.108588 15034 catalog_manager.cc:5697] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.110145 15034 catalog_manager.cc:5697] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.111289 15034 catalog_manager.cc:5697] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.125172 15035 catalog_manager.cc:5697] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.132233 15331 consensus_queue.cc:1048] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.133846 15331 consensus_queue.cc:1048] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.175518 15364 raft_consensus.cc:493] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.176012 15364 raft_consensus.cc:515] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.177824 15364 leader_election.cc:290] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.178699 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc882af15c8479b86f8cfe8353a2897" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:07.178964 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc882af15c8479b86f8cfe8353a2897" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:07.179343 15210 raft_consensus.cc:2393] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb3a251a153f4b53ad61dcc0b5ff7755 in current term 1: Already voted for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in this term.
I20260709 13:05:07.180557 15103 leader_election.cc:304] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef
I20260709 13:05:07.181257 15364 raft_consensus.cc:3060] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.186414 15364 raft_consensus.cc:2749] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:07.201099 15342 consensus_queue.cc:1048] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.214462 15369 consensus_queue.cc:1048] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.215894 15364 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.232033 15331 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.262495 15377 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.262934 15377 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.264755 15377 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.265726 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" is_pre_election: true
I20260709 13:05:07.266041 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:07.266454 15137 raft_consensus.cc:2393] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e87745797c064543b215a278aac8a0ef in current term 1: Already voted for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in this term.
I20260709 13:05:07.267463 15175 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:07.268163 15377 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.272469 15377 raft_consensus.cc:2749] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:07.279680 15379 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.280226 15369 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.300463 15369 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.300632 15360 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.384685 15360 consensus_queue.cc:1048] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.396955 15364 consensus_queue.cc:1048] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.417052 15212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:44662
I20260709 13:05:07.417668 15212 raft_consensus.cc:606] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:07.434484 15284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:40652
I20260709 13:05:07.434996 15284 raft_consensus.cc:606] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:07.443686 15284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:40652
I20260709 13:05:07.444207 15284 raft_consensus.cc:606] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:07.458353 15137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:49936
I20260709 13:05:07.459002 15137 raft_consensus.cc:606] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Received request to transfer leadership to TS e87745797c064543b215a278aac8a0ef
I20260709 13:05:07.462960 15342 raft_consensus.cc:993] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:07.462700 15363 consensus_queue.cc:1048] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.463532 15342 raft_consensus.cc:1081] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:07.465113 15285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
mode: GRACEFUL
new_leader_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:40652
I20260709 13:05:07.465482 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35166
I20260709 13:05:07.465797 15285 raft_consensus.cc:606] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Received request to transfer leadership to TS e87745797c064543b215a278aac8a0ef
I20260709 13:05:07.466141 15137 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.466531 15137 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.476239 15136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47bc623b4e0489d839d31859906c849"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:49936
I20260709 13:05:07.476879 15136 raft_consensus.cc:606] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Received request to transfer leadership to TS e87745797c064543b215a278aac8a0ef
I20260709 13:05:07.479290 15331 consensus_queue.cc:1048] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.483211 15136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:49936
I20260709 13:05:07.483829 15136 raft_consensus.cc:606] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Received request to transfer leadership to TS e87745797c064543b215a278aac8a0ef
I20260709 13:05:07.489874 15377 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.497901 15137 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.500897 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:07.501238 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.501547 15212 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.501881 15285 raft_consensus.cc:3055] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.502238 15285 raft_consensus.cc:740] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:07.502929 15285 consensus_queue.cc:260] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.503733 15285 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.505901 15137 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 2 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.507072 15212 raft_consensus.cc:2468] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 2.
I20260709 13:05:07.509073 15100 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:07.509923 15331 raft_consensus.cc:2804] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.510419 15331 raft_consensus.cc:697] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.511246 15331 consensus_queue.cc:237] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.516083 15377 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:07.516710 15342 consensus_queue.cc:1048] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.520036 15285 raft_consensus.cc:2468] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 2.
I20260709 13:05:07.519722 15034 catalog_manager.cc:5697] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 1 to 2, leader changed from 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.531904 15413 raft_consensus.cc:993] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:07.532495 15344 raft_consensus.cc:1081] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:07.534264 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35172
I20260709 13:05:07.534906 15137 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.535372 15137 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.536435 15369 raft_consensus.cc:993] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: : Instructing follower e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.536878 15369 raft_consensus.cc:1081] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Signalling peer e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.539165 15210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:42906
I20260709 13:05:07.540570 15210 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.540999 15210 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.542884 15137 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:07.544997 15137 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 2 election: Requested vote from peers 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:07.546566 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:07.546923 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.547278 15211 raft_consensus.cc:3055] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.547531 15285 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.547659 15211 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:07.548316 15210 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.548560 15211 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:07.549789 15211 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.554813 15210 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.555390 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.555987 15284 raft_consensus.cc:3055] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.556311 15284 raft_consensus.cc:740] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:07.557037 15284 consensus_queue.cc:260] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.557740 15284 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.559042 15285 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 2.
I20260709 13:05:07.560003 15103 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:07.560793 15331 raft_consensus.cc:2804] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.560802 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:07.561352 15331 raft_consensus.cc:697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.561563 15137 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.562227 15331 consensus_queue.cc:237] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:07.562599 15211 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 2.
I20260709 13:05:07.568166 15284 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.568284 15137 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.569216 15178 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:07.570006 15344 raft_consensus.cc:2804] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.570490 15344 raft_consensus.cc:697] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:07.570890 15035 catalog_manager.cc:5697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 1 to 2, leader changed from e87745797c064543b215a278aac8a0ef (127.14.45.2) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.571254 15344 consensus_queue.cc:237] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.578588 15032 catalog_manager.cc:5697] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 1 to 2, leader changed from 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 2 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.695942 15331 raft_consensus.cc:993] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.696482 15363 raft_consensus.cc:1081] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Signalling peer e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.698071 15211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:42908
I20260709 13:05:07.698884 15211 raft_consensus.cc:493] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.699292 15211 raft_consensus.cc:3060] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.703922 15211 raft_consensus.cc:515] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.705634 15211 leader_election.cc:290] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.706781 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:07.706781 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a277404a6c43c994c73a9e0e149a3c" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.707670 15137 raft_consensus.cc:3055] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.707688 15284 raft_consensus.cc:3060] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.708133 15137 raft_consensus.cc:740] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.708985 15137 consensus_queue.cc:260] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.710283 15137 raft_consensus.cc:3060] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.715011 15284 raft_consensus.cc:2468] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.716457 15178 leader_election.cc:304] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:07.716984 15137 raft_consensus.cc:2468] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.717298 15344 raft_consensus.cc:2804] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.717878 15344 raft_consensus.cc:697] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:07.718737 15344 consensus_queue.cc:237] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.725422 15032 catalog_manager.cc:5697] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 1 to 2, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 2 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.790607 15342 raft_consensus.cc:993] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:07.791142 15369 raft_consensus.cc:1081] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:07.792867 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35166
I20260709 13:05:07.793538 15137 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.794023 15137 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.795527 15364 raft_consensus.cc:993] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.796000 15331 raft_consensus.cc:1081] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Signalling peer e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.797724 15211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:42908
I20260709 13:05:07.798349 15211 raft_consensus.cc:493] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.798755 15211 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.800505 15137 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.802397 15137 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 2 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.803686 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.804081 15211 raft_consensus.cc:515] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.804375 15284 raft_consensus.cc:3055] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.804875 15284 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:07.805944 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:07.806032 15284 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.806918 15210 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.807195 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:07.807575 15211 leader_election.cc:290] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.807797 15137 raft_consensus.cc:3055] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.808162 15137 raft_consensus.cc:740] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.808202 15284 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.809208 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.809059 15137 consensus_queue.cc:260] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.809773 15285 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.810396 15137 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.815169 15284 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 2.
I20260709 13:05:07.815305 15210 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 2.
I20260709 13:05:07.816608 15103 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:07.817356 15137 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.817488 15331 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.817698 15285 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.818156 15331 raft_consensus.cc:697] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.818822 15175 leader_election.cc:304] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:07.819097 15331 consensus_queue.cc:237] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.820523 15344 raft_consensus.cc:2804] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.821029 15344 raft_consensus.cc:697] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:07.821921 15344 consensus_queue.cc:237] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.823125 15379 raft_consensus.cc:993] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.823598 15379 raft_consensus.cc:1081] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Signalling peer e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:07.825372 15210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b47bc623b4e0489d839d31859906c849"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:42908
I20260709 13:05:07.826081 15210 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.826566 15210 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.829275 15032 catalog_manager.cc:5697] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 1 to 2, leader changed from 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.832147 15035 catalog_manager.cc:5697] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 1 to 2, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 2 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.833926 15210 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.836179 15210 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:07.836805 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:07.837471 15137 raft_consensus.cc:3055] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.837893 15137 raft_consensus.cc:740] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:07.837826 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:07.838543 15285 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.838842 15137 consensus_queue.cc:260] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.840138 15137 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.846114 15285 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.847240 15178 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:07.847383 15137 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:07.848037 15344 raft_consensus.cc:2804] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.848517 15344 raft_consensus.cc:697] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:07.849252 15344 consensus_queue.cc:237] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:07.855716 15035 catalog_manager.cc:5697] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 1 to 2, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 2 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.013902 15210 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.015468 15331 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.015791 15285 raft_consensus.cc:1275] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.017171 15331 consensus_queue.cc:1048] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.028090 15284 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.033577 15211 raft_consensus.cc:1275] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.035037 15364 consensus_queue.cc:1048] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.036955 15364 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.123108 15137 raft_consensus.cc:1275] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.124605 15344 consensus_queue.cc:1048] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.137001 15284 raft_consensus.cc:1275] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.138756 15417 consensus_queue.cc:1048] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.211592 15284 raft_consensus.cc:1275] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.213032 15417 consensus_queue.cc:1048] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.222309 15137 raft_consensus.cc:1275] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.223860 15344 consensus_queue.cc:1048] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.229923 15284 raft_consensus.cc:1275] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.231722 15417 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.243104 15137 raft_consensus.cc:1275] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.245968 15413 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.260583 15284 raft_consensus.cc:1275] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.261915 15344 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.270918 15137 raft_consensus.cc:1275] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.273316 15417 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.340411 15211 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.341893 15364 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.350628 15284 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.352589 15379 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.526911 14516 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:10.527774 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.544356 15137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:49942
I20260709 13:05:10.544803 15137 raft_consensus.cc:606] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Received request to transfer leadership to TS 91a41ab044d64b9c8b818b2f38fe92f6
I20260709 13:05:10.547530 15137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:49942
I20260709 13:05:10.547996 15137 raft_consensus.cc:606] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Received request to transfer leadership to TS 91a41ab044d64b9c8b818b2f38fe92f6
I20260709 13:05:10.549175 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:10.549772 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:10.762244 15429 raft_consensus.cc:993] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:10.762775 15425 raft_consensus.cc:1081] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Signalling peer 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:10.764451 15284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:40146
I20260709 13:05:10.765331 15284 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.765779 15284 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.771893 15284 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:10.774242 15284 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:10.775595 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:10.776105 15137 raft_consensus.cc:3055] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.775970 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:10.776422 15137 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:10.776587 15211 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.777179 15137 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:10.778306 15137 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.782696 15211 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 3.
I20260709 13:05:10.783896 15249 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:10.784809 15369 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.785116 15137 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 3.
I20260709 13:05:10.786239 15369 raft_consensus.cc:697] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:10.787125 15369 consensus_queue.cc:237] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:10.793999 15035 catalog_manager.cc:5697] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 2 to 3, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.922461 15429 raft_consensus.cc:993] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:10.922902 15425 raft_consensus.cc:1081] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Signalling peer 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:10.924365 15284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:40146
I20260709 13:05:10.924829 15284 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.925138 15284 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.929224 15284 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:10.930677 15284 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:10.931582 15137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:10.932192 15137 raft_consensus.cc:3055] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.932415 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:10.932703 15137 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:10.933000 15211 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.933580 15137 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:10.934516 15137 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.937899 15211 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 3.
I20260709 13:05:10.938795 15137 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 3.
I20260709 13:05:10.938927 15249 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:10.939757 15369 raft_consensus.cc:2804] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.940230 15369 raft_consensus.cc:697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:10.941123 15369 consensus_queue.cc:237] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:10.950404 15035 catalog_manager.cc:5697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 2 to 3, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.230916 15137 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.232323 15369 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.242859 15211 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.245872 15369 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.430446 15137 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.431772 15369 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.441875 15211 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.443452 15443 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:11.550661 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:11.562701 15284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:40652
I20260709 13:05:11.563314 15284 raft_consensus.cc:606] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:11.571790 15284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:40652
I20260709 13:05:11.572283 15284 raft_consensus.cc:606] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:11.583652 15210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:44662
I20260709 13:05:11.584259 15210 raft_consensus.cc:606] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:11.589264 15210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:44662
I20260709 13:05:11.589846 15210 raft_consensus.cc:606] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:11.595139 15210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47bc623b4e0489d839d31859906c849"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
mode: GRACEFUL
new_leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:44662
I20260709 13:05:11.595666 15210 raft_consensus.cc:606] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Received request to transfer leadership to TS eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:11.645660 15445 raft_consensus.cc:993] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:11.646323 15417 raft_consensus.cc:1081] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:11.647971 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35172
I20260709 13:05:11.648506 15137 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.648854 15137 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.653209 15137 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.654738 15137 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 3 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:11.655592 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:11.655805 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:11.656211 15210 raft_consensus.cc:3055] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:11.656394 15284 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.656597 15210 raft_consensus.cc:740] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:11.657362 15210 consensus_queue.cc:260] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.658385 15210 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.660638 15284 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 3.
I20260709 13:05:11.661721 15103 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:11.662581 15446 raft_consensus.cc:2804] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.662983 15446 raft_consensus.cc:697] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:11.663812 15210 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 3.
I20260709 13:05:11.663688 15446 consensus_queue.cc:237] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.670922 15035 catalog_manager.cc:5697] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 2 to 3, leader changed from e87745797c064543b215a278aac8a0ef (127.14.45.2) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.853842 15369 raft_consensus.cc:993] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:11.854324 15443 raft_consensus.cc:1081] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:11.855948 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35166
I20260709 13:05:11.856539 15137 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.856923 15137 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:11.861642 15137 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.863700 15137 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 4 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:11.864355 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:11.864662 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:11.865027 15210 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:11.865159 15284 raft_consensus.cc:3055] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:11.865464 15284 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:11.866221 15284 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.867372 15284 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:11.871997 15210 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 4.
I20260709 13:05:11.873291 15100 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:11.873396 15284 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 4.
I20260709 13:05:11.874047 15446 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:11.874509 15446 raft_consensus.cc:697] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:11.875241 15446 consensus_queue.cc:237] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.881443 15035 catalog_manager.cc:5697] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 3 to 4, leader changed from 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 4 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.988075 15445 raft_consensus.cc:993] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:11.988534 15417 raft_consensus.cc:1081] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:11.990104 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35172
I20260709 13:05:11.990541 15137 raft_consensus.cc:493] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.990772 15137 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.995406 15137 raft_consensus.cc:515] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:11.996766 15137 leader_election.cc:290] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 3 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:11.997658 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:11.997900 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:11.998217 15210 raft_consensus.cc:3055] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:11.998435 15284 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.998553 15210 raft_consensus.cc:740] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:11.999644 15210 consensus_queue.cc:260] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:12.000720 15210 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:12.003084 15284 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 3.
I20260709 13:05:12.004030 15103 leader_election.cc:304] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:12.004709 15446 raft_consensus.cc:2804] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:12.005131 15446 raft_consensus.cc:697] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:12.005910 15446 consensus_queue.cc:237] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:12.006222 15210 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 3.
I20260709 13:05:12.012936 15035 catalog_manager.cc:5697] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 2 to 3, leader changed from e87745797c064543b215a278aac8a0ef (127.14.45.2) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.030395 15445 raft_consensus.cc:993] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:12.030941 15417 raft_consensus.cc:1081] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:12.032706 15137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b47bc623b4e0489d839d31859906c849"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35172
I20260709 13:05:12.033419 15137 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.033823 15137 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:12.035701 15369 raft_consensus.cc:993] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: : Instructing follower eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:12.036164 15443 raft_consensus.cc:1081] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Signalling peer eb3a251a153f4b53ad61dcc0b5ff7755 to start an election
I20260709 13:05:12.037863 15136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
 from {username='slave'} at 127.0.0.1:35166
I20260709 13:05:12.038419 15136 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.038821 15136 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.039944 15137 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:12.041960 15137 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 3 election: Requested vote from peers e87745797c064543b215a278aac8a0ef (127.14.45.2:39237), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:12.042919 15210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:12.043074 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:12.043567 15284 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:12.043567 15210 raft_consensus.cc:3055] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:12.044126 15210 raft_consensus.cc:740] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:12.045607 15136 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:12.045002 15210 consensus_queue.cc:260] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:12.047255 15210 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:12.048193 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:12.048748 15285 raft_consensus.cc:3055] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:12.048966 15136 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 4 election: Requested vote from peers 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:12.049063 15285 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:12.050045 15285 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:12.050953 15284 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 3.
I20260709 13:05:12.051247 15285 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.052764 15210 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 3.
I20260709 13:05:12.053747 15211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:12.053862 15100 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:12.054370 15211 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.055985 15446 raft_consensus.cc:2804] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:12.056494 15446 raft_consensus.cc:697] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:12.056679 15285 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 4.
I20260709 13:05:12.057843 15103 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755; no voters: 
I20260709 13:05:12.057391 15446 consensus_queue.cc:237] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:12.058578 15425 raft_consensus.cc:2804] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:12.059672 15425 raft_consensus.cc:697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Becoming Leader. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:12.060901 15211 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3a251a153f4b53ad61dcc0b5ff7755 in term 4.
I20260709 13:05:12.060508 15425 consensus_queue.cc:237] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:12.065208 15035 catalog_manager.cc:5697] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 2 to 3, leader changed from e87745797c064543b215a278aac8a0ef (127.14.45.2) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.076582 15035 catalog_manager.cc:5697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 reported cstate change: term changed from 3 to 4, leader changed from 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3) to eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1). New cstate: current_term: 4 leader_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.267963 15285 raft_consensus.cc:1275] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.269395 15425 consensus_queue.cc:1048] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.271934 15211 raft_consensus.cc:1275] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.273298 15446 consensus_queue.cc:1048] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.358808 15211 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.360602 15425 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:12.406339 15285 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.410713 15452 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:12.446352 15285 raft_consensus.cc:1275] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.447966 15425 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.453241 15211 raft_consensus.cc:1275] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.454841 15425 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.510447 15285 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.511955 15425 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:12.524176 15210 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.525727 15425 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:12.528677 15285 raft_consensus.cc:1275] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.531041 15452 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:12.546370 15210 raft_consensus.cc:1275] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Refusing update from remote peer eb3a251a153f4b53ad61dcc0b5ff7755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.547919 15465 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:14.745353 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:14.755247 15136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:49942
I20260709 13:05:14.756253 15136 raft_consensus.cc:606] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Received request to transfer leadership to TS e87745797c064543b215a278aac8a0ef
I20260709 13:05:14.759124 15136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:49942
I20260709 13:05:14.759646 15136 raft_consensus.cc:606] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Received request to transfer leadership to TS 91a41ab044d64b9c8b818b2f38fe92f6
I20260709 13:05:14.761976 15136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:49942
I20260709 13:05:14.762399 15136 raft_consensus.cc:606] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Received request to transfer leadership to TS e87745797c064543b215a278aac8a0ef
I20260709 13:05:14.764778 15136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
mode: GRACEFUL
new_leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:49942
I20260709 13:05:14.765223 15136 raft_consensus.cc:606] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Received request to transfer leadership to TS 91a41ab044d64b9c8b818b2f38fe92f6
I20260709 13:05:14.766187 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:14.766609 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:14.900058 15470 raft_consensus.cc:993] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:14.900599 15470 raft_consensus.cc:1081] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Signalling peer e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:14.902164 15212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:42908
I20260709 13:05:14.902643 15212 raft_consensus.cc:493] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.902992 15212 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.908034 15212 raft_consensus.cc:515] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:14.909837 15212 leader_election.cc:290] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:14.910698 15136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:14.910977 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e192c19bbe1432b93c4af291ec744d1" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:14.911638 15136 raft_consensus.cc:3055] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:14.911695 15285 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.912007 15136 raft_consensus.cc:740] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:14.912761 15136 consensus_queue.cc:260] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:14.913669 15136 raft_consensus.cc:3060] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.916590 15285 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 4.
I20260709 13:05:14.917912 15178 leader_election.cc:304] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:14.918916 15417 raft_consensus.cc:2804] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.919222 15136 raft_consensus.cc:2468] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 4.
I20260709 13:05:14.920547 15417 raft_consensus.cc:697] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 4 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:14.921479 15417 consensus_queue.cc:237] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:14.931239 15035 catalog_manager.cc:5697] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 3 to 4, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 4 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.933660 15465 raft_consensus.cc:993] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:14.934242 15470 raft_consensus.cc:1081] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Signalling peer 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:14.935923 15285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:40146
I20260709 13:05:14.936408 15285 raft_consensus.cc:493] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.936697 15285 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.942932 15285 raft_consensus.cc:515] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:14.945132 15285 leader_election.cc:290] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 5 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:14.945982 15136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:14.946219 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171c2a0b07847cda0cbc1b6a2f8087c" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:14.946659 15136 raft_consensus.cc:3055] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:14.946805 15212 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.947026 15136 raft_consensus.cc:740] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:14.947939 15136 consensus_queue.cc:260] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:14.949100 15136 raft_consensus.cc:3060] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.952203 15212 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 5.
I20260709 13:05:14.953462 15249 leader_election.cc:304] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:14.954341 15443 raft_consensus.cc:2804] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:14.954696 15136 raft_consensus.cc:2468] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 5.
I20260709 13:05:14.955742 15443 raft_consensus.cc:697] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:14.956578 15443 consensus_queue.cc:237] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:14.963879 15035 catalog_manager.cc:5697] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 4 to 5, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.212867 15465 raft_consensus.cc:993] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:15.213474 15470 raft_consensus.cc:1081] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Signalling peer e87745797c064543b215a278aac8a0ef to start an election
I20260709 13:05:15.214932 15212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f"
dest_uuid: "e87745797c064543b215a278aac8a0ef"
 from {username='slave'} at 127.0.0.1:42908
I20260709 13:05:15.215487 15212 raft_consensus.cc:493] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.215806 15212 raft_consensus.cc:3060] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.222023 15212 raft_consensus.cc:515] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:15.224045 15212 leader_election.cc:290] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:15.224767 15136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:15.225108 15285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7620299c81384bc9a15313595e1bc08f" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:15.225401 15136 raft_consensus.cc:3055] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.225586 15285 raft_consensus.cc:3060] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.225798 15136 raft_consensus.cc:740] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:15.226604 15136 consensus_queue.cc:260] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:15.227833 15136 raft_consensus.cc:3060] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.232165 15285 raft_consensus.cc:2468] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:15.233554 15178 leader_election.cc:304] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:15.234225 15136 raft_consensus.cc:2468] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:15.234395 15417 raft_consensus.cc:2804] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.234845 15417 raft_consensus.cc:697] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:15.235816 15417 consensus_queue.cc:237] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:15.244206 15035 catalog_manager.cc:5697] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 1 to 2, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 2 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.246695 15471 raft_consensus.cc:993] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: : Instructing follower 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:15.247171 15470 raft_consensus.cc:1081] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Signalling peer 91a41ab044d64b9c8b818b2f38fe92f6 to start an election
I20260709 13:05:15.248914 15284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9"
dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
 from {username='slave'} at 127.0.0.1:40146
I20260709 13:05:15.249423 15284 raft_consensus.cc:493] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.249672 15284 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.255323 15284 raft_consensus.cc:515] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:15.256796 15284 leader_election.cc:290] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 5 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:15.257665 15136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755"
I20260709 13:05:15.257927 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8d5cb8150e454aa9a3b1ec476d44e9" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:15.258282 15136 raft_consensus.cc:3055] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:15.258440 15212 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.258630 15136 raft_consensus.cc:740] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb3a251a153f4b53ad61dcc0b5ff7755, State: Running, Role: LEADER
I20260709 13:05:15.259492 15136 consensus_queue.cc:260] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:15.260876 15136 raft_consensus.cc:3060] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.265847 15212 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 5.
I20260709 13:05:15.267158 15249 leader_election.cc:304] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:15.267452 15136 raft_consensus.cc:2468] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 5.
I20260709 13:05:15.267899 15443 raft_consensus.cc:2804] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:15.268420 15443 raft_consensus.cc:697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:15.269263 15443 consensus_queue.cc:237] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } }
I20260709 13:05:15.275663 15035 catalog_manager.cc:5697] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 4 to 5, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.401466 15212 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:15.402813 15443 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.414330 15136 raft_consensus.cc:1275] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:15.416265 15486 consensus_queue.cc:1048] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:15.472430 15284 raft_consensus.cc:1275] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.473675 15417 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:15.484925 15136 raft_consensus.cc:1275] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.486410 15474 consensus_queue.cc:1048] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:15.623562 15284 raft_consensus.cc:1275] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:15.624774 15474 consensus_queue.cc:1048] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.635483 15136 raft_consensus.cc:1275] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:15.637015 15474 consensus_queue.cc:1048] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:15.715133 15158 debug-util.cc:398] Leaking SignalData structure 0x7b08001aece0 after lost signal to thread 14519
W20260709 13:05:15.715965 15158 debug-util.cc:398] Leaking SignalData structure 0x7b0800192940 after lost signal to thread 15069
W20260709 13:05:15.716851 15158 debug-util.cc:398] Leaking SignalData structure 0x7b08000e42a0 after lost signal to thread 15161
W20260709 13:05:15.717602 15158 debug-util.cc:398] Leaking SignalData structure 0x7b08001bcba0 after lost signal to thread 15236
W20260709 13:05:15.718472 15158 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8c20 after lost signal to thread 15310
I20260709 13:05:15.746577 15136 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:15.748152 15486 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.752023 15212 raft_consensus.cc:1275] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:15.753665 15486 consensus_queue.cc:1048] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.767369 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:15.777362 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
I20260709 13:05:15.819033 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:15.820037 14516 tablet_replica.cc:333] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.820977 14516 raft_consensus.cc:2243] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.821576 14516 raft_consensus.cc:2272] T acc882af15c8479b86f8cfe8353a2897 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.824558 14516 tablet_replica.cc:333] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.825399 14516 raft_consensus.cc:2243] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.825976 14516 raft_consensus.cc:2272] T 7620299c81384bc9a15313595e1bc08f P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.829334 14516 tablet_replica.cc:333] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.830178 14516 raft_consensus.cc:2243] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.831234 14516 raft_consensus.cc:2272] T 4941a612d8754e09b312fddcf1b13bbd P eb3a251a153f4b53ad61dcc0b5ff7755 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.833261 14516 tablet_replica.cc:333] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.833847 14516 raft_consensus.cc:2243] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.834271 14516 raft_consensus.cc:2272] T 5171c2a0b07847cda0cbc1b6a2f8087c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.836941 14516 tablet_replica.cc:333] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.837718 14516 raft_consensus.cc:2243] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.838883 14516 raft_consensus.cc:2272] T 2488d6b23c044454b4fcd0c2901f4e6a P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.841441 14516 tablet_replica.cc:333] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.842000 14516 raft_consensus.cc:2243] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.842835 14516 raft_consensus.cc:2272] T 699af4836d65482a8fa094f7f0afc1fb P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.844702 14516 tablet_replica.cc:333] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.845229 14516 raft_consensus.cc:2243] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.845685 14516 raft_consensus.cc:2272] T 4e192c19bbe1432b93c4af291ec744d1 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.848601 14516 tablet_replica.cc:333] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.849205 14516 raft_consensus.cc:2243] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.849716 14516 raft_consensus.cc:2272] T 89a277404a6c43c994c73a9e0e149a3c P eb3a251a153f4b53ad61dcc0b5ff7755 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.851814 14516 tablet_replica.cc:333] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.852286 14516 raft_consensus.cc:2243] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.852685 14516 raft_consensus.cc:2272] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.855041 14516 tablet_replica.cc:333] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755: stopping tablet replica
I20260709 13:05:15.855515 14516 raft_consensus.cc:2243] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.856287 14516 raft_consensus.cc:2272] T b47bc623b4e0489d839d31859906c849 P eb3a251a153f4b53ad61dcc0b5ff7755 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:15.884848 15249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:05:15.888309 15249 consensus_peers.cc:597] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:16.023319 15175 consensus_peers.cc:597] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:16.031128 15249 consensus_peers.cc:597] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:16.076776 15175 consensus_peers.cc:597] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:16.230957 15175 consensus_peers.cc:597] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:16.245481 15249 consensus_peers.cc:597] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:16.877070 14516 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15158)
I20260709 13:05:17.013684 15474 raft_consensus.cc:493] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.014515 15474 raft_consensus.cc:515] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.016551 15474 leader_election.cc:290] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:17.017903 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
W20260709 13:05:17.020532 15175 leader_election.cc:336] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.021039 15175 leader_election.cc:304] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.021912 15474 raft_consensus.cc:2749] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:17.088331 15480 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.088876 15480 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.090970 15480 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:17.092567 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:17.094985 15480 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
W20260709 13:05:17.095366 15249 leader_election.cc:336] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.095871 15249 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6; no voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.095674 15480 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.096653 15486 raft_consensus.cc:2749] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:17.097977 15480 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:17.099802 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
W20260709 13:05:17.102101 15249 leader_election.cc:336] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.102528 15249 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6; no voters: e87745797c064543b215a278aac8a0ef, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.103217 15480 raft_consensus.cc:2749] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:17.155750 15474 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.156380 15474 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.158591 15474 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:17.159885 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
W20260709 13:05:17.162798 15175 leader_election.cc:336] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.163234 15175 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e87745797c064543b215a278aac8a0ef; no voters: 91a41ab044d64b9c8b818b2f38fe92f6, eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.163916 15474 raft_consensus.cc:2749] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:17.165891 15474 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.166445 15474 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.168747 15474 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:17.169996 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:17.170617 15284 raft_consensus.cc:2468] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 2.
I20260709 13:05:17.171669 15178 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:17.172456 15474 raft_consensus.cc:2804] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:17.172804 15474 raft_consensus.cc:493] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
W20260709 13:05:17.172951 15175 leader_election.cc:336] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.173204 15474 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.178032 15480 raft_consensus.cc:493] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.178293 15474 raft_consensus.cc:515] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.178591 15480 raft_consensus.cc:515] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.180343 15474 leader_election.cc:290] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 3 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:17.181958 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2488d6b23c044454b4fcd0c2901f4e6a" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:17.182524 15284 raft_consensus.cc:3060] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.180464 15480 leader_election.cc:290] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:17.187793 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:17.188171 15284 raft_consensus.cc:2468] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 3.
I20260709 13:05:17.188429 15212 raft_consensus.cc:2468] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 1.
W20260709 13:05:17.188484 15175 leader_election.cc:336] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.189320 15178 leader_election.cc:304] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.190457 15474 raft_consensus.cc:2804] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:17.191569 15249 leader_election.cc:304] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:17.191582 15474 raft_consensus.cc:697] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 3 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:17.192462 15480 raft_consensus.cc:2804] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:17.192476 15249 leader_election.cc:336] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.193030 15480 raft_consensus.cc:493] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.193473 15480 raft_consensus.cc:3060] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.193181 15474 consensus_queue.cc:237] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.202014 15480 raft_consensus.cc:515] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.204236 15480 leader_election.cc:290] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 2 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:17.204373 15035 catalog_manager.cc:5697] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 2 to 3, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 3 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.205811 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a612d8754e09b312fddcf1b13bbd" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:17.206431 15212 raft_consensus.cc:3060] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:17.209472 15249 leader_election.cc:336] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.214560 15212 raft_consensus.cc:2468] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 2.
I20260709 13:05:17.215826 15249 leader_election.cc:304] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.216711 15480 raft_consensus.cc:2804] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.217176 15480 raft_consensus.cc:697] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:17.218065 15480 consensus_queue.cc:237] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.223074 15474 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.223760 15474 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.227625 15474 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:17.228116 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" is_pre_election: true
I20260709 13:05:17.228763 15284 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 3.
I20260709 13:05:17.230194 15178 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:17.231132 15474 raft_consensus.cc:2804] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:17.231614 15474 raft_consensus.cc:493] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.232092 15474 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:17.233650 15175 leader_election.cc:336] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.239387 15474 raft_consensus.cc:515] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.242139 15474 leader_election.cc:290] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3:38277)
I20260709 13:05:17.243430 15284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699af4836d65482a8fa094f7f0afc1fb" candidate_uuid: "e87745797c064543b215a278aac8a0ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "91a41ab044d64b9c8b818b2f38fe92f6"
I20260709 13:05:17.244020 15284 raft_consensus.cc:3060] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.243872 15034 catalog_manager.cc:5697] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 1 to 2, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:17.248005 15175 leader_election.cc:336] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.251641 15284 raft_consensus.cc:2468] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87745797c064543b215a278aac8a0ef in term 4.
I20260709 13:05:17.252929 15178 leader_election.cc:304] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.253944 15474 raft_consensus.cc:2804] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:17.254675 15474 raft_consensus.cc:697] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 4 LEADER]: Becoming Leader. State: Replica: e87745797c064543b215a278aac8a0ef, State: Running, Role: LEADER
I20260709 13:05:17.255566 15474 consensus_queue.cc:237] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.262255 15034 catalog_manager.cc:5697] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef reported cstate change: term changed from 3 to 4, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to e87745797c064543b215a278aac8a0ef (127.14.45.2). New cstate: current_term: 4 leader_uuid: "e87745797c064543b215a278aac8a0ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.320170 15480 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.320788 15480 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.322626 15480 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:17.324560 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef" is_pre_election: true
I20260709 13:05:17.325325 15212 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 3.
I20260709 13:05:17.327348 15249 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: 
I20260709 13:05:17.328438 15480 raft_consensus.cc:2804] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:17.328527 15249 leader_election.cc:336] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.328792 15480 raft_consensus.cc:493] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb3a251a153f4b53ad61dcc0b5ff7755)
I20260709 13:05:17.329280 15480 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.333976 15480 raft_consensus.cc:515] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.335445 15480 leader_election.cc:290] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 election: Requested vote from peers eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251), e87745797c064543b215a278aac8a0ef (127.14.45.2:39237)
I20260709 13:05:17.337316 15212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47bc623b4e0489d839d31859906c849" candidate_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e87745797c064543b215a278aac8a0ef"
I20260709 13:05:17.337920 15212 raft_consensus.cc:3060] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:17.339499 15249 leader_election.cc:336] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111)
I20260709 13:05:17.343228 15212 raft_consensus.cc:2468] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91a41ab044d64b9c8b818b2f38fe92f6 in term 4.
I20260709 13:05:17.344290 15249 leader_election.cc:304] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91a41ab044d64b9c8b818b2f38fe92f6, e87745797c064543b215a278aac8a0ef; no voters: eb3a251a153f4b53ad61dcc0b5ff7755
I20260709 13:05:17.345723 15480 raft_consensus.cc:2804] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:17.346566 15480 raft_consensus.cc:697] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 LEADER]: Becoming Leader. State: Replica: 91a41ab044d64b9c8b818b2f38fe92f6, State: Running, Role: LEADER
I20260709 13:05:17.347589 15480 consensus_queue.cc:237] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } }
I20260709 13:05:17.355201 15034 catalog_manager.cc:5697] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 reported cstate change: term changed from 3 to 4, leader changed from eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1) to 91a41ab044d64b9c8b818b2f38fe92f6 (127.14.45.3). New cstate: current_term: 4 leader_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3a251a153f4b53ad61dcc0b5ff7755" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.658113 15212 raft_consensus.cc:1275] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.659842 15486 consensus_queue.cc:1048] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:17.674609 15175 consensus_peers.cc:597] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:17.677774 15249 consensus_peers.cc:597] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.703492 15284 raft_consensus.cc:1275] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.705224 15474 consensus_queue.cc:1048] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.825098 15284 raft_consensus.cc:1275] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Refusing update from remote peer e87745797c064543b215a278aac8a0ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:17.826489 15501 consensus_queue.cc:1048] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "91a41ab044d64b9c8b818b2f38fe92f6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:17.840123 15175 consensus_peers.cc:597] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:17.853057 15249 consensus_peers.cc:597] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:17.877552 14516 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15158)
I20260709 13:05:17.877682 15212 raft_consensus.cc:1275] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Refusing update from remote peer 91a41ab044d64b9c8b818b2f38fe92f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:17.879295 15512 consensus_queue.cc:1048] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87745797c064543b215a278aac8a0ef" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:18.129464 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
I20260709 13:05:18.152088 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
I20260709 13:05:18.173678 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:18.174605 14516 tablet_replica.cc:333] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.175282 14516 raft_consensus.cc:2243] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.176201 14516 raft_consensus.cc:2272] T 699af4836d65482a8fa094f7f0afc1fb P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.178970 14516 tablet_replica.cc:333] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.179682 14516 raft_consensus.cc:2243] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.180176 14516 raft_consensus.cc:2272] T b47bc623b4e0489d839d31859906c849 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.183004 14516 tablet_replica.cc:333] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.183522 14516 raft_consensus.cc:2243] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.184196 14516 raft_consensus.cc:2272] T 7620299c81384bc9a15313595e1bc08f P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.185928 14516 tablet_replica.cc:333] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.186440 14516 raft_consensus.cc:2243] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.187080 14516 raft_consensus.cc:2272] T 89a277404a6c43c994c73a9e0e149a3c P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.188627 14516 tablet_replica.cc:333] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.189109 14516 raft_consensus.cc:2243] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.189848 14516 raft_consensus.cc:2272] T 4e192c19bbe1432b93c4af291ec744d1 P e87745797c064543b215a278aac8a0ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.191529 14516 tablet_replica.cc:333] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.192243 14516 raft_consensus.cc:2243] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.192776 14516 raft_consensus.cc:2272] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.194824 14516 tablet_replica.cc:333] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.195396 14516 raft_consensus.cc:2243] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.195816 14516 raft_consensus.cc:2272] T acc882af15c8479b86f8cfe8353a2897 P e87745797c064543b215a278aac8a0ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.197485 14516 tablet_replica.cc:333] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.198020 14516 raft_consensus.cc:2243] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.198414 14516 raft_consensus.cc:2272] T 4941a612d8754e09b312fddcf1b13bbd P e87745797c064543b215a278aac8a0ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.200534 14516 tablet_replica.cc:333] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.200994 14516 raft_consensus.cc:2243] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.201699 14516 raft_consensus.cc:2272] T 2488d6b23c044454b4fcd0c2901f4e6a P e87745797c064543b215a278aac8a0ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.203552 14516 tablet_replica.cc:333] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef: stopping tablet replica
I20260709 13:05:18.203998 14516 raft_consensus.cc:2243] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.204397 14516 raft_consensus.cc:2272] T 5171c2a0b07847cda0cbc1b6a2f8087c P e87745797c064543b215a278aac8a0ef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.234480 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
W20260709 13:05:18.239493 15249 consensus_peers.cc:597] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer eb3a251a153f4b53ad61dcc0b5ff7755 (127.14.45.1:45251): Couldn't send request to peer eb3a251a153f4b53ad61dcc0b5ff7755. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:18.255523 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
I20260709 13:05:18.282358 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:18.283180 14516 tablet_replica.cc:333] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.283988 14516 raft_consensus.cc:2243] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.284710 14516 raft_consensus.cc:2272] T 7620299c81384bc9a15313595e1bc08f P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.287143 14516 tablet_replica.cc:333] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.287736 14516 raft_consensus.cc:2243] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.288280 14516 raft_consensus.cc:2272] T 699af4836d65482a8fa094f7f0afc1fb P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.290552 14516 tablet_replica.cc:333] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.291096 14516 raft_consensus.cc:2243] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.291949 14516 raft_consensus.cc:2272] T 4941a612d8754e09b312fddcf1b13bbd P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:18.294149 15249 consensus_peers.cc:597] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 -> Peer e87745797c064543b215a278aac8a0ef (127.14.45.2:39237): Couldn't send request to peer e87745797c064543b215a278aac8a0ef. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:39237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.294734 14516 tablet_replica.cc:333] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.295279 14516 raft_consensus.cc:2243] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.295941 14516 raft_consensus.cc:2272] T acc882af15c8479b86f8cfe8353a2897 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.297547 14516 tablet_replica.cc:333] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.298133 14516 raft_consensus.cc:2243] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.298600 14516 raft_consensus.cc:2272] T 2488d6b23c044454b4fcd0c2901f4e6a P 91a41ab044d64b9c8b818b2f38fe92f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.300974 14516 tablet_replica.cc:333] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.301548 14516 raft_consensus.cc:2243] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.302320 14516 raft_consensus.cc:2272] T 5171c2a0b07847cda0cbc1b6a2f8087c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.303969 14516 tablet_replica.cc:333] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.304451 14516 raft_consensus.cc:2243] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.305202 14516 raft_consensus.cc:2272] T b47bc623b4e0489d839d31859906c849 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.307291 14516 tablet_replica.cc:333] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.307783 14516 raft_consensus.cc:2243] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.308213 14516 raft_consensus.cc:2272] T 4e192c19bbe1432b93c4af291ec744d1 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.309899 14516 tablet_replica.cc:333] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.310374 14516 raft_consensus.cc:2243] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.311125 14516 raft_consensus.cc:2272] T 7f8d5cb8150e454aa9a3b1ec476d44e9 P 91a41ab044d64b9c8b818b2f38fe92f6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.312851 14516 tablet_replica.cc:333] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6: stopping tablet replica
I20260709 13:05:18.313323 14516 raft_consensus.cc:2243] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.313831 14516 raft_consensus.cc:2272] T 89a277404a6c43c994c73a9e0e149a3c P 91a41ab044d64b9c8b818b2f38fe92f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.342792 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
I20260709 13:05:18.362537 14516 master.cc:562] Master@127.14.45.62:42831 shutting down...
I20260709 13:05:18.385829 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.386392 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.386732 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 466a4217647647d59a6a9db87dc2bb0c: stopping tablet replica
I20260709 13:05:18.406942 14516 master.cc:584] Master@127.14.45.62:42831 shutdown complete.
91a41ab044d64b9c8b818b2f38fe92f6  1
e87745797c064543b215a278aac8a0ef  4
eb3a251a153f4b53ad61dcc0b5ff7755  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (13157 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:18.448725 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:37417
I20260709 13:05:18.449899 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:18.455862 15521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.455895 15520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.456789 15523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:18.457957 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:18.458791 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:18.458966 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:18.459106 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602318459089 us; error 0 us; skew 500 ppm
I20260709 13:05:18.459565 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:18.462301 14516 webserver.cc:533] Webserver started at http://127.14.45.62:33231/ using document root <none> and password file <none>
I20260709 13:05:18.462905 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:18.463157 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:18.463395 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:18.464529 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.469334 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:05:18.472824 15528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.473598 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:18.473919 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.474237 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:18.484926 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:18.486302 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:18.526716 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:37417
I20260709 13:05:18.526826 15579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:37417 every 8 connection(s)
I20260709 13:05:18.530802 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:18.540562 15580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Bootstrap starting.
I20260709 13:05:18.545372 15580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.549978 15580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: No bootstrap required, opened a new log
I20260709 13:05:18.552222 15580 raft_consensus.cc:359] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" member_type: VOTER }
I20260709 13:05:18.552606 15580 raft_consensus.cc:385] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.552788 15580 raft_consensus.cc:740] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309d6534a0164bf3ab5f6a8a7f6a5a65, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.553267 15580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" member_type: VOTER }
I20260709 13:05:18.553679 15580 raft_consensus.cc:399] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:18.553912 15580 raft_consensus.cc:493] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:18.554132 15580 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.558378 15580 raft_consensus.cc:515] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" member_type: VOTER }
I20260709 13:05:18.558881 15580 leader_election.cc:304] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 309d6534a0164bf3ab5f6a8a7f6a5a65; no voters: 
I20260709 13:05:18.560007 15580 leader_election.cc:290] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:18.560544 15583 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.561923 15583 raft_consensus.cc:697] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 1 LEADER]: Becoming Leader. State: Replica: 309d6534a0164bf3ab5f6a8a7f6a5a65, State: Running, Role: LEADER
I20260709 13:05:18.562623 15583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" member_type: VOTER }
I20260709 13:05:18.563148 15580 sys_catalog.cc:565] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:18.567034 15585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 309d6534a0164bf3ab5f6a8a7f6a5a65. Latest consensus state: current_term: 1 leader_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" member_type: VOTER } }
I20260709 13:05:18.567715 15585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:18.567801 15584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309d6534a0164bf3ab5f6a8a7f6a5a65" member_type: VOTER } }
I20260709 13:05:18.568744 15584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:18.574150 15590 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:18.579417 15590 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:18.580700 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:18.588830 15590 catalog_manager.cc:1383] Generated new cluster ID: 38def84d56104e5b87492c4070450c9b
I20260709 13:05:18.589202 15590 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:18.615298 15590 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:18.616596 15590 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:18.636180 15590 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Generated new TSK 0
I20260709 13:05:18.636795 15590 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:18.647650 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:18.654421 15601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.654844 15602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.656513 15604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:18.657235 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:18.658061 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:18.658244 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:18.658360 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602318658349 us; error 0 us; skew 500 ppm
I20260709 13:05:18.658860 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:18.661353 14516 webserver.cc:533] Webserver started at http://127.14.45.1:41429/ using document root <none> and password file <none>
I20260709 13:05:18.661849 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:18.662012 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:18.662221 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:18.663239 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "fec10611791a4ab384f86b212249410e"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.667860 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:05:18.671237 15609 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.672050 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:18.672410 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "fec10611791a4ab384f86b212249410e"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.672717 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:18.691463 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:18.692809 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:18.694597 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:18.696925 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:18.697144 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.697384 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:18.697570 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.740705 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:46181
I20260709 13:05:18.740829 15671 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:46181 every 8 connection(s)
I20260709 13:05:18.745834 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:18.754079 15676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.755483 15677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.758949 15679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:18.759289 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:18.760490 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:18.760677 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:18.760910 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602318760883 us; error 0 us; skew 500 ppm
I20260709 13:05:18.761533 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:18.765471 15672 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37417
I20260709 13:05:18.765539 14516 webserver.cc:533] Webserver started at http://127.14.45.2:43729/ using document root <none> and password file <none>
I20260709 13:05:18.766002 15672 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:18.766258 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:18.766508 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:18.766780 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:18.766947 15672 heartbeater.cc:507] Master 127.14.45.62:37417 requested a full tablet report, sending...
I20260709 13:05:18.768033 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.769265 15545 ts_manager.cc:194] Registered new tserver with Master: fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:18.771185 15545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33330
I20260709 13:05:18.772982 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:18.777930 15684 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.778887 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:18.779178 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.779500 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:18.820533 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:18.821856 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:18.823423 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:18.825886 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:18.826136 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.826407 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:18.826610 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.871629 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:40695
I20260709 13:05:18.871757 15746 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:40695 every 8 connection(s)
I20260709 13:05:18.877025 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:18.884598 15750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:18.885250 15751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:18.887545 14516 server_base.cc:1061] running on GCE node
W20260709 13:05:18.887769 15753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:18.888944 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:18.889338 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:18.889624 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602318889601 us; error 0 us; skew 500 ppm
I20260709 13:05:18.890566 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:18.891638 15747 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37417
I20260709 13:05:18.892149 15747 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:18.893110 15747 heartbeater.cc:507] Master 127.14.45.62:37417 requested a full tablet report, sending...
I20260709 13:05:18.893870 14516 webserver.cc:533] Webserver started at http://127.14.45.3:44549/ using document root <none> and password file <none>
I20260709 13:05:18.894567 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:18.894837 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:18.895195 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:18.895784 15545 ts_manager.cc:194] Registered new tserver with Master: 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:18.896528 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "c1927141dc2540dab644a00fd6843fc6"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.897236 15545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33344
I20260709 13:05:18.902251 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:18.905918 15758 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.906819 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:05:18.907224 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "c1927141dc2540dab644a00fd6843fc6"
format_stamp: "Formatted at 2026-07-09 13:05:18 on dist-test-slave-lfdf"
I20260709 13:05:18.907541 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:18.925815 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:18.927021 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:18.928510 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:18.930861 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:18.931110 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.931352 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:18.931526 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:18.972954 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:35499
I20260709 13:05:18.973054 15820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:35499 every 8 connection(s)
I20260709 13:05:18.988078 15821 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37417
I20260709 13:05:18.988548 15821 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:18.989493 15821 heartbeater.cc:507] Master 127.14.45.62:37417 requested a full tablet report, sending...
I20260709 13:05:18.991544 15545 ts_manager.cc:194] Registered new tserver with Master: c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:18.991952 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015314835s
I20260709 13:05:18.992914 15545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33358
I20260709 13:05:19.020301 15545 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33360:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:19.026829 15545 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:19.250226 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 2587899a27f245e9b0ef17e109a8e540 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:19.250847 15635 tablet_service.cc:1511] Processing CreateTablet for tablet d53d726dd17e47aa93a8e89b12bb84c4 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:19.251825 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2587899a27f245e9b0ef17e109a8e540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.252805 15634 tablet_service.cc:1511] Processing CreateTablet for tablet 84e21e8d93b04fda8cbe6eff63c91d00 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:19.253578 15635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53d726dd17e47aa93a8e89b12bb84c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.254241 15634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e21e8d93b04fda8cbe6eff63c91d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.254072 15631 tablet_service.cc:1511] Processing CreateTablet for tablet 5155e26439a345ae8f836c6cc4f0ab34 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:19.254973 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 9b565f6448234458882c913c62c38ac0 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:19.255460 15631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5155e26439a345ae8f836c6cc4f0ab34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.256280 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b565f6448234458882c913c62c38ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.256553 15630 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2577557ef849f9bd90a2b23564a72e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:19.257441 15633 tablet_service.cc:1511] Processing CreateTablet for tablet a8b1fac517a64a4e9eaa1931a61e14dd (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:19.258004 15630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2577557ef849f9bd90a2b23564a72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.258810 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1fac517a64a4e9eaa1931a61e14dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.263440 15632 tablet_service.cc:1511] Processing CreateTablet for tablet e7a882c727204be4b66080704cceb833 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:19.265308 15632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a882c727204be4b66080704cceb833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.274578 15629 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7dd54a086d47c196a1227a925bbdff (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:19.276337 15629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7dd54a086d47c196a1227a925bbdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.282634 15712 tablet_service.cc:1511] Processing CreateTablet for tablet 2587899a27f245e9b0ef17e109a8e540 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:19.284425 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2587899a27f245e9b0ef17e109a8e540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.287310 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 9b565f6448234458882c913c62c38ac0 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:19.289034 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b565f6448234458882c913c62c38ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.295001 15710 tablet_service.cc:1511] Processing CreateTablet for tablet d53d726dd17e47aa93a8e89b12bb84c4 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:19.296550 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53d726dd17e47aa93a8e89b12bb84c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.298996 15709 tablet_service.cc:1511] Processing CreateTablet for tablet 84e21e8d93b04fda8cbe6eff63c91d00 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:19.300385 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e21e8d93b04fda8cbe6eff63c91d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.303181 15708 tablet_service.cc:1511] Processing CreateTablet for tablet a8b1fac517a64a4e9eaa1931a61e14dd (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:19.304629 15708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1fac517a64a4e9eaa1931a61e14dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.306912 15705 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2577557ef849f9bd90a2b23564a72e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:19.308359 15705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2577557ef849f9bd90a2b23564a72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.310917 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 5155e26439a345ae8f836c6cc4f0ab34 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:19.311283 15786 tablet_service.cc:1511] Processing CreateTablet for tablet 2587899a27f245e9b0ef17e109a8e540 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:19.312394 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5155e26439a345ae8f836c6cc4f0ab34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.312638 15786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2587899a27f245e9b0ef17e109a8e540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.314066 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 9b565f6448234458882c913c62c38ac0 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:19.314929 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7dd54a086d47c196a1227a925bbdff (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:19.315486 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b565f6448234458882c913c62c38ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.316236 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7dd54a086d47c196a1227a925bbdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.318856 15707 tablet_service.cc:1511] Processing CreateTablet for tablet e7a882c727204be4b66080704cceb833 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:19.320236 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a882c727204be4b66080704cceb833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.320119 15783 tablet_service.cc:1511] Processing CreateTablet for tablet 84e21e8d93b04fda8cbe6eff63c91d00 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:19.322036 15783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e21e8d93b04fda8cbe6eff63c91d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.318892 15784 tablet_service.cc:1511] Processing CreateTablet for tablet d53d726dd17e47aa93a8e89b12bb84c4 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:19.323581 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53d726dd17e47aa93a8e89b12bb84c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.323721 15628 tablet_service.cc:1511] Processing CreateTablet for tablet d1b41c8b77bb478d9a07b1fa9c45f64a (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:19.325039 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b41c8b77bb478d9a07b1fa9c45f64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.327320 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2577557ef849f9bd90a2b23564a72e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:19.331135 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2577557ef849f9bd90a2b23564a72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.332854 15703 tablet_service.cc:1511] Processing CreateTablet for tablet d1b41c8b77bb478d9a07b1fa9c45f64a (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:19.334841 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 5155e26439a345ae8f836c6cc4f0ab34 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:19.336175 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5155e26439a345ae8f836c6cc4f0ab34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.338860 15782 tablet_service.cc:1511] Processing CreateTablet for tablet a8b1fac517a64a4e9eaa1931a61e14dd (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:19.338958 15781 tablet_service.cc:1511] Processing CreateTablet for tablet e7a882c727204be4b66080704cceb833 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:19.341187 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1fac517a64a4e9eaa1931a61e14dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.346443 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a882c727204be4b66080704cceb833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.359637 15778 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7dd54a086d47c196a1227a925bbdff (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:19.361101 15778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7dd54a086d47c196a1227a925bbdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.378221 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b41c8b77bb478d9a07b1fa9c45f64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.387400 15836 tablet_bootstrap.cc:492] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:19.394976 15777 tablet_service.cc:1511] Processing CreateTablet for tablet d1b41c8b77bb478d9a07b1fa9c45f64a (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:19.396340 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b41c8b77bb478d9a07b1fa9c45f64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.401181 15836 tablet_bootstrap.cc:654] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.409901 15628 tablet_service.cc:1511] Processing CreateTablet for tablet 124c8d611c0e46e196764635f142c5f3 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:19.410713 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 95d881615f17486b87fb31ab586c91fd (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:19.411278 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124c8d611c0e46e196764635f142c5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.412184 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d881615f17486b87fb31ab586c91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.415634 15837 tablet_bootstrap.cc:492] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:19.422602 15837 tablet_bootstrap.cc:654] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.426447 15783 tablet_service.cc:1511] Processing CreateTablet for tablet 95d881615f17486b87fb31ab586c91fd (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:19.427917 15783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d881615f17486b87fb31ab586c91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.432595 15707 tablet_service.cc:1511] Processing CreateTablet for tablet 124c8d611c0e46e196764635f142c5f3 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:19.435968 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124c8d611c0e46e196764635f142c5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.466677 15632 tablet_service.cc:1511] Processing CreateTablet for tablet 95d881615f17486b87fb31ab586c91fd (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:19.468737 15632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d881615f17486b87fb31ab586c91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.473181 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 124c8d611c0e46e196764635f142c5f3 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:19.474654 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124c8d611c0e46e196764635f142c5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.475533 15629 tablet_service.cc:1511] Processing CreateTablet for tablet 356b3bbf62c44a84bc360356d580684d (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:19.476946 15629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b3bbf62c44a84bc360356d580684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.492306 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 356b3bbf62c44a84bc360356d580684d (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:19.493302 15783 tablet_service.cc:1511] Processing CreateTablet for tablet 356b3bbf62c44a84bc360356d580684d (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:19.493620 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b3bbf62c44a84bc360356d580684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.494581 15783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b3bbf62c44a84bc360356d580684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.496372 15636 tablet_service.cc:1511] Processing CreateTablet for tablet c36d0932529945e9a284405282d65321 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:19.497598 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0932529945e9a284405282d65321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.504897 15710 tablet_service.cc:1511] Processing CreateTablet for tablet c36d0932529945e9a284405282d65321 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:19.506271 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0932529945e9a284405282d65321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.521289 15781 tablet_service.cc:1511] Processing CreateTablet for tablet c36d0932529945e9a284405282d65321 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:19.523069 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0932529945e9a284405282d65321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.531813 15709 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1d6e542161416d9033cefcbd0c06e3 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:19.533141 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1d6e542161416d9033cefcbd0c06e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.534107 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1d6e542161416d9033cefcbd0c06e3 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:19.535429 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1d6e542161416d9033cefcbd0c06e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.538115 15633 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1d6e542161416d9033cefcbd0c06e3 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:19.544047 15837 tablet_bootstrap.cc:492] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:19.544533 15837 ts_tablet_manager.cc:1403] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.010s
I20260709 13:05:19.545104 15634 tablet_service.cc:1511] Processing CreateTablet for tablet 17999909d8e0416d88f73b762dbb4bd6 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:19.547331 15837 raft_consensus.cc:359] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.548043 15837 raft_consensus.cc:385] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.548359 15837 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.549067 15837 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.549094 15708 tablet_service.cc:1511] Processing CreateTablet for tablet 17999909d8e0416d88f73b762dbb4bd6 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:19.551244 15708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17999909d8e0416d88f73b762dbb4bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.551256 15836 tablet_bootstrap.cc:492] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:19.553377 15836 ts_tablet_manager.cc:1403] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.166s	user 0.024s	sys 0.046s
I20260709 13:05:19.564651 15836 raft_consensus.cc:359] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.567734 15836 raft_consensus.cc:385] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.570827 15840 tablet_bootstrap.cc:492] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:19.569672 15836 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
W20260709 13:05:19.576165 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:19.578877 15631 tablet_service.cc:1511] Processing CreateTablet for tablet fa29a3025a254b5ca5f1a66e394cec53 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:19.582077 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1d6e542161416d9033cefcbd0c06e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.582826 15634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17999909d8e0416d88f73b762dbb4bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.585575 15635 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1ddc8959ec401badd16f3610580c0b (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:19.587277 15703 tablet_service.cc:1511] Processing CreateTablet for tablet fa29a3025a254b5ca5f1a66e394cec53 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:19.589512 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa29a3025a254b5ca5f1a66e394cec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.596472 15635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1ddc8959ec401badd16f3610580c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.596344 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1ddc8959ec401badd16f3610580c0b (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:19.597757 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1ddc8959ec401badd16f3610580c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.598083 15631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa29a3025a254b5ca5f1a66e394cec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.604672 15628 tablet_service.cc:1511] Processing CreateTablet for tablet 493304a609d247829052517242c00e96 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:19.606338 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493304a609d247829052517242c00e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.607393 15837 ts_tablet_manager.cc:1434] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.063s	user 0.019s	sys 0.044s
I20260709 13:05:19.608446 15837 tablet_bootstrap.cc:492] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:19.610021 15747 heartbeater.cc:499] Master 127.14.45.62:37417 was elected leader, sending a full tablet report...
I20260709 13:05:19.609944 15705 tablet_service.cc:1511] Processing CreateTablet for tablet 493304a609d247829052517242c00e96 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:19.611243 15705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493304a609d247829052517242c00e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.620884 15837 tablet_bootstrap.cc:654] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.622409 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8c1e0ef68b4538925aca4c0e72487e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:19.623797 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8c1e0ef68b4538925aca4c0e72487e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.631512 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 493304a609d247829052517242c00e96 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:19.631374 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1ddc8959ec401badd16f3610580c0b (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:19.633097 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493304a609d247829052517242c00e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.632897 15781 tablet_service.cc:1511] Processing CreateTablet for tablet fa29a3025a254b5ca5f1a66e394cec53 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:19.633868 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1ddc8959ec401badd16f3610580c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.635213 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 17999909d8e0416d88f73b762dbb4bd6 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:19.636579 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17999909d8e0416d88f73b762dbb4bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.638043 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa29a3025a254b5ca5f1a66e394cec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.649039 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8c1e0ef68b4538925aca4c0e72487e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:19.650465 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8c1e0ef68b4538925aca4c0e72487e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.657215 15840 tablet_bootstrap.cc:654] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.646504 15836 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.690296 15837 tablet_bootstrap.cc:492] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:19.690860 15837 ts_tablet_manager.cc:1403] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.030s
I20260709 13:05:19.693094 15777 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8c1e0ef68b4538925aca4c0e72487e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:19.694415 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8c1e0ef68b4538925aca4c0e72487e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.694106 15837 raft_consensus.cc:359] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.694918 15837 raft_consensus.cc:385] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.695242 15837 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.696054 15837 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.714578 15634 tablet_service.cc:1511] Processing CreateTablet for tablet 3836f44d54d2426aa13fe94be57f8fcb (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:19.716549 15634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3836f44d54d2426aa13fe94be57f8fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.718784 15837 ts_tablet_manager.cc:1434] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:05:19.719738 15837 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:19.727228 15707 tablet_service.cc:1511] Processing CreateTablet for tablet 3836f44d54d2426aa13fe94be57f8fcb (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:19.732672 15836 ts_tablet_manager.cc:1434] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.178s	user 0.012s	sys 0.027s
I20260709 13:05:19.735606 15672 heartbeater.cc:499] Master 127.14.45.62:37417 was elected leader, sending a full tablet report...
I20260709 13:05:19.738054 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3836f44d54d2426aa13fe94be57f8fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.737267 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 3836f44d54d2426aa13fe94be57f8fcb (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:19.739588 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3836f44d54d2426aa13fe94be57f8fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.739741 15837 tablet_bootstrap.cc:654] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.741910 15841 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.742486 15841 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.750118 15635 tablet_service.cc:1511] Processing CreateTablet for tablet f4cc7c001b764df39f7b82f95bc198cc (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:19.762109 15836 tablet_bootstrap.cc:492] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:19.763571 15840 tablet_bootstrap.cc:492] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:19.764108 15840 ts_tablet_manager.cc:1403] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.194s	user 0.002s	sys 0.014s
I20260709 13:05:19.766146 15841 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:19.773296 15632 tablet_service.cc:1511] Processing CreateTablet for tablet a8f5c34f652e44ef80105d4e8021a365 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:19.773357 15710 tablet_service.cc:1511] Processing CreateTablet for tablet a8f5c34f652e44ef80105d4e8021a365 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:19.775388 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f5c34f652e44ef80105d4e8021a365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.775323 15840 raft_consensus.cc:359] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.776289 15840 raft_consensus.cc:385] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.776619 15840 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.786880 15777 tablet_service.cc:1511] Processing CreateTablet for tablet f4cc7c001b764df39f7b82f95bc198cc (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:19.788939 15785 tablet_service.cc:1511] Processing CreateTablet for tablet a8f5c34f652e44ef80105d4e8021a365 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:19.777423 15840 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.790331 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f5c34f652e44ef80105d4e8021a365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.792551 15837 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:19.793429 15837 ts_tablet_manager.cc:1403] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.008s
I20260709 13:05:19.793457 15635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cc7c001b764df39f7b82f95bc198cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.796790 15837 raft_consensus.cc:359] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.800576 15837 raft_consensus.cc:385] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.801048 15837 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.801939 15837 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.804245 15837 ts_tablet_manager.cc:1434] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:19.804710 15706 tablet_service.cc:1511] Processing CreateTablet for tablet f6940e9e6caf46bd88b8db528efa12e8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:19.805351 15837 tablet_bootstrap.cc:492] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:19.806221 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6940e9e6caf46bd88b8db528efa12e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.811861 15837 tablet_bootstrap.cc:654] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.816455 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:19.817001 15836 tablet_bootstrap.cc:654] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.817090 15781 tablet_service.cc:1511] Processing CreateTablet for tablet f6940e9e6caf46bd88b8db528efa12e8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:05:19.818321 15685 leader_election.cc:343] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.818511 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6940e9e6caf46bd88b8db528efa12e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.797210 15634 tablet_service.cc:1511] Processing CreateTablet for tablet f6940e9e6caf46bd88b8db528efa12e8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:19.798082 15632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f5c34f652e44ef80105d4e8021a365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.821532 15634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6940e9e6caf46bd88b8db528efa12e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.821779 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd1114f45e54146933cfc74bc32722f (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:19.823163 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd1114f45e54146933cfc74bc32722f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.819401 15633 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd1114f45e54146933cfc74bc32722f (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:19.827235 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd1114f45e54146933cfc74bc32722f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.829214 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd1114f45e54146933cfc74bc32722f (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:19.830695 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd1114f45e54146933cfc74bc32722f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.830716 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:19.831986 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cc7c001b764df39f7b82f95bc198cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:19.832711 15688 leader_election.cc:343] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.833191 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:19.834157 15841 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.848284 15841 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.848820 15841 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.849426 15629 tablet_service.cc:1511] Processing CreateTablet for tablet 3cde3f8ed1454b789014048b7d1e4af8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:19.850891 15629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde3f8ed1454b789014048b7d1e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.851068 15841 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:19.852826 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:19.854797 15688 leader_election.cc:343] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.856802 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:19.858796 15685 leader_election.cc:343] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.859458 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:19.859328 15703 tablet_service.cc:1511] Processing CreateTablet for tablet f4cc7c001b764df39f7b82f95bc198cc (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:19.861042 15841 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.866503 15843 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.867174 15843 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.879309 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cc7c001b764df39f7b82f95bc198cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.890841 15821 heartbeater.cc:499] Master 127.14.45.62:37417 was elected leader, sending a full tablet report...
I20260709 13:05:19.905225 15705 tablet_service.cc:1511] Processing CreateTablet for tablet 3cde3f8ed1454b789014048b7d1e4af8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:19.906826 15705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde3f8ed1454b789014048b7d1e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.914680 15843 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:19.916610 15837 tablet_bootstrap.cc:492] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:19.917356 15837 ts_tablet_manager.cc:1403] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.112s	user 0.028s	sys 0.021s
I20260709 13:05:19.917232 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 3cde3f8ed1454b789014048b7d1e4af8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:19.918833 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde3f8ed1454b789014048b7d1e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.919866 15840 ts_tablet_manager.cc:1434] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.155s	user 0.011s	sys 0.006s
I20260709 13:05:19.919661 15631 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:19.920869 15631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.923748 15837 raft_consensus.cc:359] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.924587 15837 raft_consensus.cc:385] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.924940 15837 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.925937 15837 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.929286 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:19.930760 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.932612 15837 ts_tablet_manager.cc:1434] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:19.933657 15837 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:19.920855 15840 tablet_bootstrap.cc:492] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:19.941310 15837 tablet_bootstrap.cc:654] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.942904 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:19.944357 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.944512 15836 tablet_bootstrap.cc:492] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:19.945039 15836 ts_tablet_manager.cc:1403] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.186s	user 0.005s	sys 0.010s
I20260709 13:05:19.945927 15841 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.946537 15841 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.980441 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:19.982733 15685 leader_election.cc:343] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.982486 15836 raft_consensus.cc:359] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.989615 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:19.990942 15849 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.991482 15849 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:19.992786 15628 tablet_service.cc:1511] Processing CreateTablet for tablet 76331ca323724c289906034e280e8274 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:05:19.994194 15688 leader_election.cc:343] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.994227 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76331ca323724c289906034e280e8274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.994647 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:19.983219 15836 raft_consensus.cc:385] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.974159 15841 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.008117 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 76331ca323724c289906034e280e8274 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:20.014585 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76331ca323724c289906034e280e8274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.997285 15836 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.996739 15849 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:20.001374 15841 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.044795 15840 tablet_bootstrap.cc:654] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.057525 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 76331ca323724c289906034e280e8274 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:20.059054 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76331ca323724c289906034e280e8274. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:20.050848 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54186.3us
I20260709 13:05:20.073935 15836 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.076524 15836 ts_tablet_manager.cc:1434] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.131s	user 0.005s	sys 0.005s
I20260709 13:05:20.077371 15837 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:20.089424 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:20.091463 15610 leader_election.cc:343] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.093576 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:20.094334 15722 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:20.095671 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:20.096297 15632 tablet_service.cc:1511] Processing CreateTablet for tablet 000b7a022df94c229b7580329401d5f2 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:20.096982 15843 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.097395 15843 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.097851 15843 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.078035 15837 ts_tablet_manager.cc:1403] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.145s	user 0.013s	sys 0.006s
I20260709 13:05:20.077692 15836 tablet_bootstrap.cc:492] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:20.101466 15837 raft_consensus.cc:359] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.102496 15837 raft_consensus.cc:385] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.103037 15837 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.104163 15632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000b7a022df94c229b7580329401d5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.103899 15837 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.109371 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:20.113610 15762 leader_election.cc:343] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.116715 15837 ts_tablet_manager.cc:1434] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:05:20.119505 15837 tablet_bootstrap.cc:492] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:20.126068 15837 tablet_bootstrap.cc:654] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.129274 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 000b7a022df94c229b7580329401d5f2 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:20.131112 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000b7a022df94c229b7580329401d5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.134301 15777 tablet_service.cc:1511] Processing CreateTablet for tablet 000b7a022df94c229b7580329401d5f2 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:20.135752 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000b7a022df94c229b7580329401d5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.135579 15843 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.138742 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:20.139391 15722 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.141166 15703 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5d97766ab4411805e543ed41f9f38 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:20.142638 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5d97766ab4411805e543ed41f9f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.151273 15722 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:20.152719 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:20.155478 15628 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5d97766ab4411805e543ed41f9f38 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:20.156862 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5d97766ab4411805e543ed41f9f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.158746 15843 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.158957 15836 tablet_bootstrap.cc:654] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.159366 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:20.160871 15610 leader_election.cc:343] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.159368 15843 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.162539 15843 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:20.163429 15843 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.172689 15780 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5d97766ab4411805e543ed41f9f38 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:20.173308 15631 tablet_service.cc:1511] Processing CreateTablet for tablet 95371a1d960048e7af7796052350a058 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:20.174153 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5d97766ab4411805e543ed41f9f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.174726 15631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95371a1d960048e7af7796052350a058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.187822 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 95371a1d960048e7af7796052350a058 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:20.188419 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 95371a1d960048e7af7796052350a058 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:20.189193 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95371a1d960048e7af7796052350a058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.189877 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95371a1d960048e7af7796052350a058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.189867 15629 tablet_service.cc:1511] Processing CreateTablet for tablet c6d6772bfc824de6a5a77d8362f09c57 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:20.192231 15629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d6772bfc824de6a5a77d8362f09c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.198786 15837 tablet_bootstrap.cc:492] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:20.199311 15837 ts_tablet_manager.cc:1403] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.008s
I20260709 13:05:20.202608 15837 raft_consensus.cc:359] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.203305 15837 raft_consensus.cc:385] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.203605 15837 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.216022 15840 tablet_bootstrap.cc:492] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:20.216575 15840 ts_tablet_manager.cc:1403] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.296s	user 0.012s	sys 0.000s
I20260709 13:05:20.216779 15703 tablet_service.cc:1511] Processing CreateTablet for tablet c6d6772bfc824de6a5a77d8362f09c57 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:20.218417 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d6772bfc824de6a5a77d8362f09c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.218577 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:20.212127 15837 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:20.227950 15760 leader_election.cc:343] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.228554 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:20.229681 15849 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.229836 15837 ts_tablet_manager.cc:1434] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:05:20.230836 15837 tablet_bootstrap.cc:492] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:20.234086 15863 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.234681 15863 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.237818 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:20.239324 15611 leader_election.cc:343] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.239516 15836 tablet_bootstrap.cc:492] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:20.237851 15840 raft_consensus.cc:359] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.240607 15840 raft_consensus.cc:385] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.240338 15544 catalog_manager.cc:5697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.240944 15840 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.241858 15840 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.243651 15837 tablet_bootstrap.cc:654] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.246727 15840 ts_tablet_manager.cc:1434] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:05:20.247730 15840 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:20.252151 15777 tablet_service.cc:1511] Processing CreateTablet for tablet c6d6772bfc824de6a5a77d8362f09c57 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:20.253496 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d6772bfc824de6a5a77d8362f09c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.239990 15836 ts_tablet_manager.cc:1403] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.163s	user 0.006s	sys 0.012s
I20260709 13:05:20.257813 15705 tablet_service.cc:1511] Processing CreateTablet for tablet 5622436c83fb41fa8923df2295b99818 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:20.259145 15705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5622436c83fb41fa8923df2295b99818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.260703 15836 raft_consensus.cc:359] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.261912 15836 raft_consensus.cc:385] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.262210 15836 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.262537 15858 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.262894 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:20.262992 15858 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.263404 15836 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.265720 15858 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:05:20.266455 15610 leader_election.cc:343] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.266891 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:20.265507 15707 tablet_service.cc:1511] Processing CreateTablet for tablet d1a58d7b48604275b9a01c8113841008 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:20.267812 15861 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.268087 15836 ts_tablet_manager.cc:1434] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:05:20.268309 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:20.268718 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a58d7b48604275b9a01c8113841008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.268996 15836 tablet_bootstrap.cc:492] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Bootstrap starting.
W20260709 13:05:20.269623 15688 leader_election.cc:343] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.261528 15863 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.275367 15840 tablet_bootstrap.cc:654] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.276298 15706 tablet_service.cc:1511] Processing CreateTablet for tablet a9dc71c1b2c74ae3a9bd46fccb533628 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:20.276577 15629 tablet_service.cc:1511] Processing CreateTablet for tablet a9dc71c1b2c74ae3a9bd46fccb533628 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:20.277652 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc71c1b2c74ae3a9bd46fccb533628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.278407 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:20.279772 15685 leader_election.cc:343] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.280221 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:20.280959 15858 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.281222 15703 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab1a40028dd4bd8989c0eef484214fb (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:20.282648 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab1a40028dd4bd8989c0eef484214fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.284722 15840 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:20.284904 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 5622436c83fb41fa8923df2295b99818 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:20.285221 15840 ts_tablet_manager.cc:1403] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:05:20.285254 15780 tablet_service.cc:1511] Processing CreateTablet for tablet d1a58d7b48604275b9a01c8113841008 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:20.285562 15779 tablet_service.cc:1511] Processing CreateTablet for tablet a9dc71c1b2c74ae3a9bd46fccb533628 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:20.286252 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5622436c83fb41fa8923df2295b99818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.286443 15629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc71c1b2c74ae3a9bd46fccb533628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.287176 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc71c1b2c74ae3a9bd46fccb533628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.288991 15840 raft_consensus.cc:359] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.290088 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a58d7b48604275b9a01c8113841008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.293496 15840 raft_consensus.cc:385] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.293850 15840 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.294776 15840 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.291153 15858 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.296767 15858 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.297349 15840 ts_tablet_manager.cc:1434] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:05:20.292152 15836 tablet_bootstrap.cc:654] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.298889 15858 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.292608 15631 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab1a40028dd4bd8989c0eef484214fb (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:20.300276 15631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab1a40028dd4bd8989c0eef484214fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.300602 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:20.301221 15796 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:20.302402 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:20.303403 15858 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.303768 15858 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.304073 15858 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.306157 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:20.307592 15688 leader_election.cc:343] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.316002 15858 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.317898 15840 tablet_bootstrap.cc:492] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:20.323971 15632 tablet_service.cc:1511] Processing CreateTablet for tablet d1a58d7b48604275b9a01c8113841008 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:20.331921 15628 tablet_service.cc:1511] Processing CreateTablet for tablet 5622436c83fb41fa8923df2295b99818 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:20.336069 15634 tablet_service.cc:1511] Processing CreateTablet for tablet e43d98ec23cf48ff888ae5baaae1b949 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:20.336416 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab1a40028dd4bd8989c0eef484214fb (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:20.337761 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab1a40028dd4bd8989c0eef484214fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.338650 15704 tablet_service.cc:1511] Processing CreateTablet for tablet e43d98ec23cf48ff888ae5baaae1b949 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:20.339883 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43d98ec23cf48ff888ae5baaae1b949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.341951 15632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a58d7b48604275b9a01c8113841008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.350284 15779 tablet_service.cc:1511] Processing CreateTablet for tablet e43d98ec23cf48ff888ae5baaae1b949 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:20.351637 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43d98ec23cf48ff888ae5baaae1b949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.325137 15840 tablet_bootstrap.cc:654] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.357645 15635 tablet_service.cc:1511] Processing CreateTablet for tablet b106b4017dc84b21a7c6f58814593886 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:20.364413 15634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43d98ec23cf48ff888ae5baaae1b949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.368060 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5622436c83fb41fa8923df2295b99818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.370388 15706 tablet_service.cc:1511] Processing CreateTablet for tablet b106b4017dc84b21a7c6f58814593886 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:20.371069 15836 tablet_bootstrap.cc:492] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:20.371554 15836 ts_tablet_manager.cc:1403] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.000s
I20260709 13:05:20.374037 15635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b106b4017dc84b21a7c6f58814593886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.371590 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b106b4017dc84b21a7c6f58814593886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.387475 15858 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.387633 15836 raft_consensus.cc:359] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.388113 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:20.388222 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:20.388865 15796 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:20.389792 15688 leader_election.cc:343] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.395870 15837 tablet_bootstrap.cc:492] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:20.396193 15796 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:20.396418 15837 ts_tablet_manager.cc:1403] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.166s	user 0.021s	sys 0.015s
I20260709 13:05:20.397534 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:20.398469 15858 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.398845 15836 raft_consensus.cc:385] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.399260 15836 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.399679 15858 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:20.399665 15837 raft_consensus.cc:359] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.400560 15837 raft_consensus.cc:385] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.400370 15836 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.401005 15837 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.400730 15858 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.402159 15837 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.402959 15836 ts_tablet_manager.cc:1434] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:05:20.403987 15836 tablet_bootstrap.cc:492] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:20.404806 15837 ts_tablet_manager.cc:1434] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:20.409193 15837 tablet_bootstrap.cc:492] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:20.411010 15780 tablet_service.cc:1511] Processing CreateTablet for tablet b106b4017dc84b21a7c6f58814593886 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:20.412437 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b106b4017dc84b21a7c6f58814593886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.417761 15849 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.419133 15849 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.419269 15631 tablet_service.cc:1511] Processing CreateTablet for tablet b4aeec01bdbb47c8bd447ebc7aa8075c (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:20.420120 15706 tablet_service.cc:1511] Processing CreateTablet for tablet b4aeec01bdbb47c8bd447ebc7aa8075c (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:20.421221 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aeec01bdbb47c8bd447ebc7aa8075c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.421298 15849 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:20.421993 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:20.422897 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:20.424295 15762 leader_election.cc:343] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.424360 15722 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:20.426079 15631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aeec01bdbb47c8bd447ebc7aa8075c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.426553 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:20.427634 15849 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.428025 15849 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.427827 15777 tablet_service.cc:1511] Processing CreateTablet for tablet b4aeec01bdbb47c8bd447ebc7aa8075c (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:20.428390 15849 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.429128 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aeec01bdbb47c8bd447ebc7aa8075c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.435935 15849 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.439277 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:20.440958 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:20.441663 15722 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:20.441936 15762 leader_election.cc:343] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.443414 15635 tablet_service.cc:1511] Processing CreateTablet for tablet 5a80ac95da7b40e8b9e155cdaf8a7739 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:20.423362 15837 tablet_bootstrap.cc:654] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.446738 15705 tablet_service.cc:1511] Processing CreateTablet for tablet 5a80ac95da7b40e8b9e155cdaf8a7739 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:20.449842 15849 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:20.451627 15634 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1a63ae20354b95b7bd0e7365b598f8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:20.447392 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 5a80ac95da7b40e8b9e155cdaf8a7739 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:20.453209 15705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a80ac95da7b40e8b9e155cdaf8a7739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.456424 15836 tablet_bootstrap.cc:654] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.459228 15722 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:20.458932 15545 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.471031 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:20.471514 15635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a80ac95da7b40e8b9e155cdaf8a7739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.472697 15849 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.474421 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a80ac95da7b40e8b9e155cdaf8a7739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.475381 15840 tablet_bootstrap.cc:492] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:20.475934 15840 ts_tablet_manager.cc:1403] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.001s
I20260709 13:05:20.475415 15628 tablet_service.cc:1511] Processing CreateTablet for tablet 1dabdbaded914a498e98f6a03182ab7e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:20.477406 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dabdbaded914a498e98f6a03182ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.479204 15840 raft_consensus.cc:359] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.479403 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1a63ae20354b95b7bd0e7365b598f8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:20.484150 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1a63ae20354b95b7bd0e7365b598f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.485971 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 1dabdbaded914a498e98f6a03182ab7e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:20.487389 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dabdbaded914a498e98f6a03182ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.488736 15703 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1a63ae20354b95b7bd0e7365b598f8 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:20.480137 15840 raft_consensus.cc:385] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.489894 15840 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.490195 15634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1a63ae20354b95b7bd0e7365b598f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.498792 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 1dabdbaded914a498e98f6a03182ab7e (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:20.500577 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dabdbaded914a498e98f6a03182ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.493435 15863 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.501950 15863 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.502552 15632 tablet_service.cc:1511] Processing CreateTablet for tablet 931130cafbad4fe6ad371c4a32da2678 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:20.503897 15632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931130cafbad4fe6ad371c4a32da2678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.504185 15863 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.505887 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:20.507458 15610 leader_election.cc:343] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.508960 15707 tablet_service.cc:1511] Processing CreateTablet for tablet 931130cafbad4fe6ad371c4a32da2678 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:20.514123 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:20.513839 15840 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.515393 15837 tablet_bootstrap.cc:492] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:20.515859 15837 ts_tablet_manager.cc:1403] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.107s	user 0.002s	sys 0.011s
W20260709 13:05:20.516852 15611 leader_election.cc:343] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.517344 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:20.518497 15863 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.518426 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 931130cafbad4fe6ad371c4a32da2678 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:20.519299 15629 tablet_service.cc:1511] Processing CreateTablet for tablet 17db433a32844f26aa2fe7c2d4e4bf66 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:20.519996 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931130cafbad4fe6ad371c4a32da2678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.520529 15629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db433a32844f26aa2fe7c2d4e4bf66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.531175 15837 raft_consensus.cc:359] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.533401 15837 raft_consensus.cc:385] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.534245 15837 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.535964 15837 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.539860 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1a63ae20354b95b7bd0e7365b598f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.547356 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 17db433a32844f26aa2fe7c2d4e4bf66 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:20.550536 15837 ts_tablet_manager.cc:1434] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:20.535434 15849 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:20.554698 15837 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:20.556596 15836 tablet_bootstrap.cc:492] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:20.557188 15836 ts_tablet_manager.cc:1403] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.000s
I20260709 13:05:20.557869 15777 tablet_service.cc:1511] Processing CreateTablet for tablet 17db433a32844f26aa2fe7c2d4e4bf66 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:20.557202 15849 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.560585 15836 raft_consensus.cc:359] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.561386 15836 raft_consensus.cc:385] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.561805 15836 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.562903 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db433a32844f26aa2fe7c2d4e4bf66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.562747 15836 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.563344 15863 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.566193 15836 ts_tablet_manager.cc:1434] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:05:20.566239 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931130cafbad4fe6ad371c4a32da2678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.567322 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db433a32844f26aa2fe7c2d4e4bf66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.568753 15840 ts_tablet_manager.cc:1434] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.092s	user 0.017s	sys 0.008s
I20260709 13:05:20.576499 15633 tablet_service.cc:1511] Processing CreateTablet for tablet 260cdec1e9ff4f2e92f7db3917710d4c (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:20.577200 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 260cdec1e9ff4f2e92f7db3917710d4c (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:20.578485 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260cdec1e9ff4f2e92f7db3917710d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.578497 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260cdec1e9ff4f2e92f7db3917710d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.582325 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 260cdec1e9ff4f2e92f7db3917710d4c (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:20.586845 15709 tablet_service.cc:1511] Processing CreateTablet for tablet f24ffe6bbf294850b0b75309859cae27 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:20.588343 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24ffe6bbf294850b0b75309859cae27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.585460 15637 tablet_service.cc:1511] Processing CreateTablet for tablet f24ffe6bbf294850b0b75309859cae27 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:20.591107 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24ffe6bbf294850b0b75309859cae27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.591912 15837 tablet_bootstrap.cc:654] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.598219 15782 tablet_service.cc:1511] Processing CreateTablet for tablet f24ffe6bbf294850b0b75309859cae27 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:20.601706 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260cdec1e9ff4f2e92f7db3917710d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.607368 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24ffe6bbf294850b0b75309859cae27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.614315 15636 tablet_service.cc:1511] Processing CreateTablet for tablet e9f64c9d13524994bf43ee72f72781ee (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:20.615823 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f64c9d13524994bf43ee72f72781ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.633536 15706 tablet_service.cc:1511] Processing CreateTablet for tablet e9f64c9d13524994bf43ee72f72781ee (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:20.634889 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f64c9d13524994bf43ee72f72781ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.626573 15836 tablet_bootstrap.cc:492] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:20.650629 15840 tablet_bootstrap.cc:492] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
W20260709 13:05:20.654430 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:20.671206 15837 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:20.671710 15837 ts_tablet_manager.cc:1403] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.012s
I20260709 13:05:20.678094 15849 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.678610 15849 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.678669 15544 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.681954 15837 raft_consensus.cc:359] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.682665 15837 raft_consensus.cc:385] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.683017 15837 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.682700 15779 tablet_service.cc:1511] Processing CreateTablet for tablet e9f64c9d13524994bf43ee72f72781ee (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:20.684017 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f64c9d13524994bf43ee72f72781ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.689815 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6e933897cb4278b93a8cca027153ac (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:20.692718 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:20.693373 15647 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:20.694746 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:20.695763 15876 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.696182 15876 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.696507 15876 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.698752 15836 tablet_bootstrap.cc:654] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.686352 15837 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.702842 15837 ts_tablet_manager.cc:1434] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:05:20.709906 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6e933897cb4278b93a8cca027153ac (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:20.711431 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6e933897cb4278b93a8cca027153ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.712410 15876 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.728930 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:20.729543 15647 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.734987 15703 tablet_service.cc:1511] Processing CreateTablet for tablet 6b555226593f4046be916b50c89b97ed (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:20.737114 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b555226593f4046be916b50c89b97ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.744199 15876 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:20.742040 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6e933897cb4278b93a8cca027153ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.749761 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 6b555226593f4046be916b50c89b97ed (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:20.751175 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b555226593f4046be916b50c89b97ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.751269 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6e933897cb4278b93a8cca027153ac (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:20.742808 15837 tablet_bootstrap.cc:492] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:20.745457 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:20.752735 15721 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:20.753523 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6e933897cb4278b93a8cca027153ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.746462 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:20.754112 15720 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.760865 15843 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.761405 15843 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.763495 15843 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.765377 15836 tablet_bootstrap.cc:492] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:20.765980 15836 ts_tablet_manager.cc:1403] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.155s	user 0.009s	sys 0.005s
I20260709 13:05:20.766379 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:20.766992 15721 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:20.768164 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:20.747535 15647 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:20.729775 15633 tablet_service.cc:1511] Processing CreateTablet for tablet 6b555226593f4046be916b50c89b97ed (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:20.769658 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b555226593f4046be916b50c89b97ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.772012 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5ce40a7af94aa0a543c078bc1fe630 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:20.773335 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ce40a7af94aa0a543c078bc1fe630. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:20.749210 15610 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.773317 15707 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5ce40a7af94aa0a543c078bc1fe630 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:20.773768 15836 raft_consensus.cc:359] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.726423 15840 tablet_bootstrap.cc:654] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.742431 15849 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:20.774701 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ce40a7af94aa0a543c078bc1fe630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.776332 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:20.776980 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5ce40a7af94aa0a543c078bc1fe630 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:20.777284 15849 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.777544 15843 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.777920 15849 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:20.778107 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ce40a7af94aa0a543c078bc1fe630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.778225 15843 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.778613 15843 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.778883 15849 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.781538 15836 raft_consensus.cc:385] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.781895 15836 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.784207 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:20.783586 15840 tablet_bootstrap.cc:492] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
W20260709 13:05:20.793891 15610 leader_election.cc:343] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.794178 15840 ts_tablet_manager.cc:1403] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.000s
I20260709 13:05:20.794697 15720 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:20.797688 15840 raft_consensus.cc:359] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.798843 15840 raft_consensus.cc:385] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.800028 15840 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.800338 15863 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.801661 15863 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.801901 15843 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.803229 15840 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.808207 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:20.799764 15837 tablet_bootstrap.cc:654] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:20.810539 15610 leader_election.cc:343] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.809474 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:20.811478 15721 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.811260 15545 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.803836 15863 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.819284 15721 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:20.807200 15636 tablet_service.cc:1511] Processing CreateTablet for tablet d084942b6c014c78b9a4ece4089fb430 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:20.825524 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084942b6c014c78b9a4ece4089fb430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.825994 15633 tablet_service.cc:1511] Processing CreateTablet for tablet 264ae6fa375a4fc39d6970b0c40cfd72 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:20.827292 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ae6fa375a4fc39d6970b0c40cfd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.807461 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:20.830123 15795 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:20.831418 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:20.833330 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 264ae6fa375a4fc39d6970b0c40cfd72 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:20.834208 15858 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.834534 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ae6fa375a4fc39d6970b0c40cfd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.837858 15628 tablet_service.cc:1511] Processing CreateTablet for tablet f3fb28c93eda43e09b6d9552f89d12ba (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:20.839309 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3fb28c93eda43e09b6d9552f89d12ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.841053 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 264ae6fa375a4fc39d6970b0c40cfd72 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:20.842204 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ae6fa375a4fc39d6970b0c40cfd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.842751 15704 tablet_service.cc:1511] Processing CreateTablet for tablet f3fb28c93eda43e09b6d9552f89d12ba (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:20.844151 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3fb28c93eda43e09b6d9552f89d12ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.849625 15863 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.850386 15863 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.850759 15863 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.820456 15709 tablet_service.cc:1511] Processing CreateTablet for tablet d084942b6c014c78b9a4ece4089fb430 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:20.821471 15840 ts_tablet_manager.cc:1434] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:05:20.854558 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084942b6c014c78b9a4ece4089fb430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.854755 15840 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:20.800647 15836 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.820072 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:20.842792 15785 tablet_service.cc:1511] Processing CreateTablet for tablet d084942b6c014c78b9a4ece4089fb430 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:20.859697 15720 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:20.860216 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084942b6c014c78b9a4ece4089fb430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.861119 15840 tablet_bootstrap.cc:654] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.803835 15843 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.862897 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:20.863687 15843 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.864148 15843 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:20.865168 15843 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.857471 15863 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.880764 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:20.881350 15721 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.897610 15840 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:20.898154 15840 ts_tablet_manager.cc:1403] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:05:20.898672 15544 catalog_manager.cc:5697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.901063 15840 raft_consensus.cc:359] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.901863 15840 raft_consensus.cc:385] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.902151 15840 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
W20260709 13:05:20.902913 15688 consensus_peers.cc:597] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.905978 15721 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:20.907225 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:20.908123 15843 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.908613 15843 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:20.909461 15843 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.915753 15836 ts_tablet_manager.cc:1434] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:05:20.917157 15836 tablet_bootstrap.cc:492] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:20.919723 15837 tablet_bootstrap.cc:492] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:20.924248 15837 ts_tablet_manager.cc:1403] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.007s
I20260709 13:05:20.923151 15779 tablet_service.cc:1511] Processing CreateTablet for tablet f3fb28c93eda43e09b6d9552f89d12ba (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:20.924851 15863 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:20.925729 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3fb28c93eda43e09b6d9552f89d12ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.925833 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:20.926491 15795 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.928473 15837 raft_consensus.cc:359] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.902906 15840 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.931452 15840 ts_tablet_manager.cc:1434] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:05:20.931740 15837 raft_consensus.cc:385] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.932067 15837 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.932710 15837 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.934188 15840 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:20.936877 15837 ts_tablet_manager.cc:1434] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:05:20.943137 15837 tablet_bootstrap.cc:492] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:20.943912 15795 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:20.945251 15836 tablet_bootstrap.cc:654] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.942224 15840 tablet_bootstrap.cc:654] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.948745 15837 tablet_bootstrap.cc:654] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.965250 15544 catalog_manager.cc:5697] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.975385 15636 tablet_service.cc:1511] Processing CreateTablet for tablet dbf56bc1c60545828ec946a02bb6cf8b (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:20.979116 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf56bc1c60545828ec946a02bb6cf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.986804 15841 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.992801 15841 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:20.997187 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:20.999989 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:21.001595 15685 leader_election.cc:343] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.002620 15688 leader_election.cc:343] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.003198 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.004405 15858 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.983901 15709 tablet_service.cc:1511] Processing CreateTablet for tablet dbf56bc1c60545828ec946a02bb6cf8b (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:21.013574 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf56bc1c60545828ec946a02bb6cf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.005537 15841 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.026903 15779 tablet_service.cc:1511] Processing CreateTablet for tablet dbf56bc1c60545828ec946a02bb6cf8b (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:21.028520 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf56bc1c60545828ec946a02bb6cf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.031370 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 00f37d51951a494996e57f1247bd69ee (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:21.033059 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f37d51951a494996e57f1247bd69ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.033941 15863 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.034554 15863 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.036978 15863 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.037509 15836 tablet_bootstrap.cc:492] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.038043 15836 ts_tablet_manager.cc:1403] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.121s	user 0.030s	sys 0.024s
I20260709 13:05:21.038570 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.040287 15706 tablet_service.cc:1511] Processing CreateTablet for tablet 00f37d51951a494996e57f1247bd69ee (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:21.040859 15836 raft_consensus.cc:359] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.041458 15706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f37d51951a494996e57f1247bd69ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.041548 15836 raft_consensus.cc:385] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.041918 15836 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.042623 15836 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.044781 15836 ts_tablet_manager.cc:1434] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:21.044999 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 6317639150e3411184bf3cbb49ba1154 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:21.045732 15836 tablet_bootstrap.cc:492] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
W20260709 13:05:21.042635 15611 leader_election.cc:343] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.047241 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6317639150e3411184bf3cbb49ba1154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.047045 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.047703 15795 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.049015 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:21.049139 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 00f37d51951a494996e57f1247bd69ee (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:21.050160 15843 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.050369 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f37d51951a494996e57f1247bd69ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.050539 15843 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.050997 15843 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.051983 15836 tablet_bootstrap.cc:654] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:21.057897 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:21.061769 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 6317639150e3411184bf3cbb49ba1154 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:21.063073 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6317639150e3411184bf3cbb49ba1154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.065210 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 6317639150e3411184bf3cbb49ba1154 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:21.066586 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6317639150e3411184bf3cbb49ba1154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.073920 15633 tablet_service.cc:1511] Processing CreateTablet for tablet 641dda60c3af4cf59874ffb47ae0ec1f (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:21.075436 15633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641dda60c3af4cf59874ffb47ae0ec1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.075459 15707 tablet_service.cc:1511] Processing CreateTablet for tablet 641dda60c3af4cf59874ffb47ae0ec1f (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:21.079684 15707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641dda60c3af4cf59874ffb47ae0ec1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.080322 15843 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.084180 15777 tablet_service.cc:1511] Processing CreateTablet for tablet 641dda60c3af4cf59874ffb47ae0ec1f (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:21.085510 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641dda60c3af4cf59874ffb47ae0ec1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.085928 15849 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.086292 15628 tablet_service.cc:1511] Processing CreateTablet for tablet b40bb44d33b449189eb6c71fbb47dca4 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:21.086395 15849 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.087388 15628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40bb44d33b449189eb6c71fbb47dca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.088454 15849 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.088436 15709 tablet_service.cc:1511] Processing CreateTablet for tablet b40bb44d33b449189eb6c71fbb47dca4 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:21.090342 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40bb44d33b449189eb6c71fbb47dca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.090435 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.091935 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:21.093278 15760 leader_election.cc:343] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.094027 15762 leader_election.cc:343] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.094441 15762 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.095541 15849 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.096141 15780 tablet_service.cc:1511] Processing CreateTablet for tablet b40bb44d33b449189eb6c71fbb47dca4 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:21.097244 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40bb44d33b449189eb6c71fbb47dca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.100109 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 2555c9ee274d4274a4cf64af7f5c3609 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:21.100997 15703 tablet_service.cc:1511] Processing CreateTablet for tablet 2555c9ee274d4274a4cf64af7f5c3609 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:21.102365 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2555c9ee274d4274a4cf64af7f5c3609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.107582 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:05:21.109126 15611 leader_election.cc:343] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.109555 15781 tablet_service.cc:1511] Processing CreateTablet for tablet 2555c9ee274d4274a4cf64af7f5c3609 (DEFAULT_TABLE table=test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:21.110850 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2555c9ee274d4274a4cf64af7f5c3609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.116145 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:21.126546 15795 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.133354 15795 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.134567 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:21.135461 15863 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.136183 15863 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:21.136247 15849 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.137159 15863 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.110999 15840 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.101313 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2555c9ee274d4274a4cf64af7f5c3609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.142102 15840 ts_tablet_manager.cc:1403] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.208s	user 0.048s	sys 0.053s
I20260709 13:05:21.125875 15843 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.151294 15837 tablet_bootstrap.cc:492] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.159225 15837 ts_tablet_manager.cc:1403] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.216s	user 0.023s	sys 0.035s
I20260709 13:05:21.153353 15840 raft_consensus.cc:359] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.169477 15840 raft_consensus.cc:385] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.171412 15840 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.173983 15837 raft_consensus.cc:359] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.174961 15836 tablet_bootstrap.cc:492] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.175393 15836 ts_tablet_manager.cc:1403] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.065s
I20260709 13:05:21.173427 15840 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.171537 15545 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.182119 15836 raft_consensus.cc:359] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.185706 15837 raft_consensus.cc:385] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.185896 15836 raft_consensus.cc:385] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.186143 15837 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.186335 15836 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.186868 15837 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.187225 15836 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.188714 15837 ts_tablet_manager.cc:1434] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
I20260709 13:05:21.191566 15836 ts_tablet_manager.cc:1434] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:21.192513 15836 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.193405 15876 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.197763 15837 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.199549 15840 ts_tablet_manager.cc:1434] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.002s
I20260709 13:05:21.200524 15840 tablet_bootstrap.cc:492] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.203680 15837 tablet_bootstrap.cc:654] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.206647 15840 tablet_bootstrap.cc:654] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.206779 15836 tablet_bootstrap.cc:654] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.218191 15849 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.221906 15837 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.222415 15837 ts_tablet_manager.cc:1403] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:05:21.225402 15836 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.225164 15837 raft_consensus.cc:359] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.225878 15836 ts_tablet_manager.cc:1403] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.003s
I20260709 13:05:21.225852 15837 raft_consensus.cc:385] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.226418 15837 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.228649 15837 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.230695 15837 ts_tablet_manager.cc:1434] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:21.231518 15837 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.236207 15836 raft_consensus.cc:359] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.236933 15836 raft_consensus.cc:385] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.237237 15836 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.237886 15836 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.238565 15840 tablet_bootstrap.cc:492] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.239245 15840 ts_tablet_manager.cc:1403] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.008s
I20260709 13:05:21.239666 15837 tablet_bootstrap.cc:654] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.239869 15836 ts_tablet_manager.cc:1434] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:05:21.240897 15836 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.248063 15836 tablet_bootstrap.cc:654] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.251327 15837 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.251955 15837 ts_tablet_manager.cc:1403] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:05:21.252072 15840 raft_consensus.cc:359] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.252756 15840 raft_consensus.cc:385] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.252993 15840 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.253614 15840 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.256135 15840 ts_tablet_manager.cc:1434] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:21.257182 15840 tablet_bootstrap.cc:492] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.268278 15840 tablet_bootstrap.cc:654] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.264982 15837 raft_consensus.cc:359] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.269416 15837 raft_consensus.cc:385] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.269790 15837 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.270605 15837 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.272588 15837 ts_tablet_manager.cc:1434] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:21.273490 15837 tablet_bootstrap.cc:492] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.280032 15837 tablet_bootstrap.cc:654] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.287680 15836 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.288162 15836 ts_tablet_manager.cc:1403] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.024s
I20260709 13:05:21.290907 15836 raft_consensus.cc:359] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.291639 15836 raft_consensus.cc:385] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.291054 15863 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.291929 15836 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.292591 15836 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.293825 15840 tablet_bootstrap.cc:492] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.294551 15836 ts_tablet_manager.cc:1434] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:21.295437 15836 tablet_bootstrap.cc:492] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.300011 15840 ts_tablet_manager.cc:1403] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.002s
I20260709 13:05:21.301781 15836 tablet_bootstrap.cc:654] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.307773 15837 tablet_bootstrap.cc:492] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.308333 15837 ts_tablet_manager.cc:1403] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.009s
I20260709 13:05:21.307488 15840 raft_consensus.cc:359] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.310734 15840 raft_consensus.cc:385] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.312397 15840 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.313154 15837 raft_consensus.cc:359] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.314282 15837 raft_consensus.cc:385] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.314692 15837 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.314472 15840 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.315871 15837 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.318240 15837 ts_tablet_manager.cc:1434] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:21.319192 15837 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.323433 15841 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.324004 15841 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.325528 15837 tablet_bootstrap.cc:654] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.326334 15841 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.330265 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.330946 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:21.331411 15840 ts_tablet_manager.cc:1434] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:05:21.332491 15840 tablet_bootstrap.cc:492] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.332795 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:21.335216 15685 leader_election.cc:343] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.336858 15610 consensus_peers.cc:597] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:21.338094 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:21.339612 15858 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.339797 15836 tablet_bootstrap.cc:492] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.339937 15840 tablet_bootstrap.cc:654] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.340372 15836 ts_tablet_manager.cc:1403] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.003s
I20260709 13:05:21.341133 15861 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.340180 15858 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.343150 15858 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.343364 15837 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.343434 15836 raft_consensus.cc:359] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.343972 15837 ts_tablet_manager.cc:1403] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 13:05:21.344138 15836 raft_consensus.cc:385] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.344424 15836 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.345126 15836 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.346571 15837 raft_consensus.cc:359] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.347208 15837 raft_consensus.cc:385] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.347373 15836 ts_tablet_manager.cc:1434] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:21.347474 15837 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.348282 15836 tablet_bootstrap.cc:492] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.348196 15837 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.350135 15837 ts_tablet_manager.cc:1434] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:21.352993 15840 tablet_bootstrap.cc:492] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.353477 15840 ts_tablet_manager.cc:1403] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:05:21.354629 15836 tablet_bootstrap.cc:654] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.356549 15840 raft_consensus.cc:359] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.357371 15840 raft_consensus.cc:385] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.357661 15840 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.358736 15840 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.361937 15840 ts_tablet_manager.cc:1434] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:21.363329 15840 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.368213 15837 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.362985 15858 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.371786 15861 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.372929 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:21.373587 15647 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.374183 15861 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.374624 15861 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.375085 15837 tablet_bootstrap.cc:654] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.376756 15861 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.378392 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.379216 15722 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.379333 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.380044 15796 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.380812 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.382582 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:21.398784 15861 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.399641 15861 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.399730 15858 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.400074 15861 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.402261 15840 tablet_bootstrap.cc:654] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.402113 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:21.405114 15685 leader_election.cc:343] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.409469 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:21.412699 15861 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.416301 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:21.417085 15722 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.422600 15861 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.431393 15837 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.431952 15837 ts_tablet_manager.cc:1403] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.012s
I20260709 13:05:21.436334 15722 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.436124 15837 raft_consensus.cc:359] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.437628 15837 raft_consensus.cc:385] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.438025 15837 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.438923 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.438788 15837 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.439792 15861 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.440305 15861 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:21.421689 15858 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.441762 15861 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.442462 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:21.442742 15837 ts_tablet_manager.cc:1434] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:21.443039 15795 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.445438 15858 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:21.450888 15795 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.451395 15858 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.452527 15837 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.460892 15836 tablet_bootstrap.cc:492] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.461367 15836 ts_tablet_manager.cc:1403] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.113s	user 0.028s	sys 0.025s
I20260709 13:05:21.461530 15840 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.461997 15840 ts_tablet_manager.cc:1403] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.003s
I20260709 13:05:21.463963 15836 raft_consensus.cc:359] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.464651 15836 raft_consensus.cc:385] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.465094 15836 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.464573 15840 raft_consensus.cc:359] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.465484 15840 raft_consensus.cc:385] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.465803 15840 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.465881 15836 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.466506 15840 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.468408 15837 tablet_bootstrap.cc:654] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.468741 15836 ts_tablet_manager.cc:1434] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:21.469220 15840 ts_tablet_manager.cc:1434] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:21.469972 15836 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.470094 15840 tablet_bootstrap.cc:492] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.472041 15542 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.476190 15840 tablet_bootstrap.cc:654] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.476619 15836 tablet_bootstrap.cc:654] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.477555 15905 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.478130 15905 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.482064 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.483014 15647 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:21.484783 15905 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.486347 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.488313 15720 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:21.486848 15762 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.490090 15876 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.490605 15876 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.491086 15876 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.492561 15544 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.516052 15876 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.516748 15905 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.518049 15905 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.518512 15858 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.518983 15858 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.520947 15858 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.522323 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.522411 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:21.523262 15720 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.524698 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:21.524946 15762 leader_election.cc:343] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.525527 15795 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:21.525792 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.526225 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:21.526961 15646 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.527693 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.528937 15858 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.529850 15841 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.530368 15841 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.532617 15841 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.534111 15837 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.534461 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.534718 15837 ts_tablet_manager.cc:1403] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.003s
I20260709 13:05:21.534884 15905 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:05:21.536082 15685 leader_election.cc:343] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.536775 15876 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.537886 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.539237 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.540153 15720 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
W20260709 13:05:21.540818 15688 leader_election.cc:343] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.541464 15760 leader_election.cc:343] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.544035 15836 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.543980 15760 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.544265 15858 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.544556 15836 ts_tablet_manager.cc:1403] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.075s	user 0.034s	sys 0.034s
I20260709 13:05:21.544484 15646 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:21.546204 15762 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.545444 15688 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.547075 15905 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.547303 15841 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.547823 15905 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.547857 15836 raft_consensus.cc:359] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.548334 15905 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:21.548689 15836 raft_consensus.cc:385] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.549005 15836 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.549237 15905 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.549681 15836 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.551908 15840 tablet_bootstrap.cc:492] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.552088 15836 ts_tablet_manager.cc:1434] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:21.543100 15837 raft_consensus.cc:359] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.552459 15837 raft_consensus.cc:385] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.552919 15840 ts_tablet_manager.cc:1403] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.023s
I20260709 13:05:21.553344 15837 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.554128 15837 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.555719 15840 raft_consensus.cc:359] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.556572 15837 ts_tablet_manager.cc:1434] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:05:21.556533 15840 raft_consensus.cc:385] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.552983 15836 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.559095 15837 tablet_bootstrap.cc:492] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.562732 15836 tablet_bootstrap.cc:654] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.567015 15840 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.568233 15840 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.569964 15861 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.571301 15840 ts_tablet_manager.cc:1434] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 13:05:21.572633 15840 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.580698 15840 tablet_bootstrap.cc:654] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.581945 15858 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.581799 15863 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.582454 15858 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.585668 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.586593 15646 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:21.587706 15863 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.588050 15688 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.588227 15863 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.589046 15841 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.589531 15841 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.589918 15841 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.590832 15863 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.592675 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:21.594303 15611 leader_election.cc:343] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.596374 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:21.598496 15610 leader_election.cc:343] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.599190 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:21.600497 15861 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.604092 15840 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.604817 15840 ts_tablet_manager.cc:1403] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.013s
I20260709 13:05:21.617913 15840 raft_consensus.cc:359] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.608727 15841 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.609512 15858 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.613267 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.618914 15840 raft_consensus.cc:385] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.619387 15840 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.581501 15837 tablet_bootstrap.cc:654] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:21.620110 15685 leader_election.cc:343] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.620505 15840 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.623734 15543 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.631832 15840 ts_tablet_manager.cc:1434] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:05:21.633165 15840 tablet_bootstrap.cc:492] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.635622 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:21.637405 15685 leader_election.cc:343] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.638299 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:21.638931 15646 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.641773 15840 tablet_bootstrap.cc:654] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.643337 15858 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.643873 15858 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.646967 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:21.648643 15688 leader_election.cc:343] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.649561 15858 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.650920 15890 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.651469 15890 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.654335 15890 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.655369 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.655381 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.656208 15795 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:21.656637 15720 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.658875 15841 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.658960 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:21.660327 15858 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.660751 15858 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.661160 15858 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.662887 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.663359 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.663630 15795 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.665242 15890 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.665654 15890 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.666112 15890 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:21.668895 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:21.671854 15840 tablet_bootstrap.cc:492] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.672350 15840 ts_tablet_manager.cc:1403] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.011s
I20260709 13:05:21.672420 15647 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.673826 15858 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.676970 15840 raft_consensus.cc:359] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.677671 15840 raft_consensus.cc:385] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.678531 15840 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.679337 15840 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.680622 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:05:21.682468 15688 leader_election.cc:343] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.682956 15890 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.690913 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:21.685086 15840 ts_tablet_manager.cc:1434] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:21.679782 15837 tablet_bootstrap.cc:492] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.691716 15796 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.691918 15837 ts_tablet_manager.cc:1403] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.003s
I20260709 13:05:21.692314 15840 tablet_bootstrap.cc:492] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.685352 15858 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.685715 15836 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.686100 15841 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.694990 15930 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.695261 15841 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.695493 15930 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.687640 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:21.697773 15841 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.698014 15795 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.698597 15836 ts_tablet_manager.cc:1403] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.146s	user 0.042s	sys 0.064s
I20260709 13:05:21.690853 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:21.701442 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.702008 15720 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.701460 15836 raft_consensus.cc:359] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.702339 15794 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:21.702512 15836 raft_consensus.cc:385] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.702903 15836 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.703527 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.703665 15836 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.705204 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:21.705912 15841 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.705953 15836 ts_tablet_manager.cc:1434] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:05:21.706054 15685 leader_election.cc:343] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.706362 15841 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.697680 15930 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.706722 15841 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.707132 15836 tablet_bootstrap.cc:492] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.707224 15837 raft_consensus.cc:359] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.707955 15837 raft_consensus.cc:385] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.708209 15837 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.709342 15837 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.710422 15793 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.712972 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.714214 15836 tablet_bootstrap.cc:654] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:21.715046 15688 leader_election.cc:343] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.715479 15841 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.711544 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.718065 15645 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:21.718518 15841 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.713181 15840 tablet_bootstrap.cc:654] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.719518 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:21.720196 15794 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.715601 15688 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.721973 15890 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.724196 15720 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.726318 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.684898 15646 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:21.721678 15795 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:21.728299 15890 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.728557 15841 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.734274 15837 ts_tablet_manager.cc:1434] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:05:21.736824 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:21.737090 15688 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:21.737454 15646 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.738005 15841 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.738417 15890 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:21.739302 15841 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:21.739130 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:21.739498 15890 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.740006 15930 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.740069 15796 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.740572 15930 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:21.741459 15930 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.745820 15837 tablet_bootstrap.cc:492] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.748528 15841 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.760228 15836 tablet_bootstrap.cc:492] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.760510 15840 tablet_bootstrap.cc:492] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.760772 15836 ts_tablet_manager.cc:1403] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.005s
I20260709 13:05:21.761170 15840 ts_tablet_manager.cc:1403] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.010s
I20260709 13:05:21.761473 15794 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:21.762655 15646 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:21.762729 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:21.763705 15841 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.764624 15841 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:21.763934 15836 raft_consensus.cc:359] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.764169 15840 raft_consensus.cc:359] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.765331 15836 raft_consensus.cc:385] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.765659 15840 raft_consensus.cc:385] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.765899 15836 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.765846 15841 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.766413 15840 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.768988 15840 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.767163 15836 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.771302 15840 ts_tablet_manager.cc:1434] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:05:21.771730 15836 ts_tablet_manager.cc:1434] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:05:21.772214 15840 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.772748 15836 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.790083 15890 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.790690 15905 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:05:21.790632 15890 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.791441 15905 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.793850 15876 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.794464 15876 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.795550 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.795511 15890 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.796448 15720 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.796772 15876 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.797343 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:21.797092 15543 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.798097 15905 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.798025 15794 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:21.808243 15836 tablet_bootstrap.cc:654] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.821182 15837 tablet_bootstrap.cc:654] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.801469 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.813875 15840 tablet_bootstrap.cc:654] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.800642 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.799247 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.837342 15647 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:05:21.801103 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.838137 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.839445 15836 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.839907 15836 ts_tablet_manager.cc:1403] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.002s
I20260709 13:05:21.840142 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.841424 15876 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.842417 15876 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.849267 15930 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.850226 15930 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.853693 15905 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.829555 15545 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.854454 15905 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.855516 15545 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.859799 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.863123 15836 raft_consensus.cc:359] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.805112 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.863855 15905 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.863873 15836 raft_consensus.cc:385] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.864590 15840 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:21.864684 15836 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.865186 15840 ts_tablet_manager.cc:1403] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.013s
I20260709 13:05:21.865090 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.865442 15836 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.867554 15836 ts_tablet_manager.cc:1434] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:21.868968 15836 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.872140 15841 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.875641 15930 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.877195 15863 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.876798 15543 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.878583 15876 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.879624 15840 raft_consensus.cc:359] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.880362 15840 raft_consensus.cc:385] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.880654 15840 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.881326 15840 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.881970 15836 tablet_bootstrap.cc:654] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.883592 15840 ts_tablet_manager.cc:1434] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:21.875461 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:21.885335 15905 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.887027 15837 tablet_bootstrap.cc:492] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:21.887594 15837 ts_tablet_manager.cc:1403] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.004s
I20260709 13:05:21.888453 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.889148 15647 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:21.890936 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:21.892468 15685 leader_election.cc:343] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.892705 15876 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.893319 15876 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.893811 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:21.894315 15890 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.894716 15890 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.895076 15890 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.896255 15930 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.896344 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.896685 15930 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:21.898412 15762 leader_election.cc:343] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.897163 15930 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:21.900480 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 95478.4us
I20260709 13:05:21.900915 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.901614 15722 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:21.902822 15760 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:21.904412 15905 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.904843 15905 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.905210 15905 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.911206 15793 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.915009 15890 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.916009 15863 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.914582 15930 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.921285 15930 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.921648 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:21.922380 15836 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:21.922283 15721 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.922794 15836 ts_tablet_manager.cc:1403] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.012s
I20260709 13:05:21.924485 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:21.925171 15647 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.931150 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:21.932690 15685 leader_election.cc:343] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.921087 15905 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.943315 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:21.943994 15795 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.943266 15890 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:21.951820 15795 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.952893 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:21.955489 15722 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.957042 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:21.957455 15930 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.953042 15721 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:21.884585 15840 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:21.959108 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:21.959547 15849 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.960163 15849 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.961468 15905 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.962023 15890 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.964965 15890 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:21.962474 15849 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:21.963165 15722 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:21.964087 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:21.964826 15837 raft_consensus.cc:359] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.964826 15836 raft_consensus.cc:359] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:21.966449 15762 leader_election.cc:343] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.971050 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:21.977190 15647 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:21.979566 15890 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.981295 15836 raft_consensus.cc:385] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.982307 15836 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.982524 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:21.982965 15836 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.983407 15930 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.985074 15836 ts_tablet_manager.cc:1434] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.000s
I20260709 13:05:21.985009 15930 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:21.985637 15840 tablet_bootstrap.cc:654] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.985709 15760 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:21.981246 15837 raft_consensus.cc:385] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.986181 15930 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.986776 15837 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.987287 15849 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.987509 15837 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:21.988474 15721 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:21.990599 15837 ts_tablet_manager.cc:1434] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:05:21.991777 15837 tablet_bootstrap.cc:492] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:21.992051 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:21.986316 15836 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:21.987852 15849 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:21.993784 15905 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.994210 15905 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.994558 15905 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.994585 15849 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:22.002382 15762 leader_election.cc:343] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.962194 15876 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:22.015399 15836 tablet_bootstrap.cc:654] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.019688 15905 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.024204 15836 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:22.024659 15836 ts_tablet_manager.cc:1403] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.001s
I20260709 13:05:22.028156 15905 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:22.028906 15837 tablet_bootstrap.cc:654] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.024472 15542 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.035631 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:22.036747 15836 raft_consensus.cc:359] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.032290 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:22.037729 15836 raft_consensus.cc:385] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.038813 15836 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
W20260709 13:05:22.041851 15762 leader_election.cc:343] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.043576 15836 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.045279 15545 catalog_manager.cc:5697] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.038841 15721 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.052628 15836 ts_tablet_manager.cc:1434] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:05:22.053817 15836 tablet_bootstrap.cc:492] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:22.054005 15840 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:22.054473 15840 ts_tablet_manager.cc:1403] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.170s	user 0.020s	sys 0.004s
I20260709 13:05:22.057842 15837 tablet_bootstrap.cc:492] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.058316 15837 ts_tablet_manager.cc:1403] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.001s
I20260709 13:05:22.061525 15837 raft_consensus.cc:359] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.062270 15836 tablet_bootstrap.cc:654] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.062284 15837 raft_consensus.cc:385] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.062809 15837 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.063431 15837 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.065003 15721 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:22.065498 15837 ts_tablet_manager.cc:1434] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:22.066488 15837 tablet_bootstrap.cc:492] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.066648 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:22.066915 15905 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.068233 15849 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.068796 15849 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:22.069969 15849 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.072715 15837 tablet_bootstrap.cc:654] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.061681 15840 raft_consensus.cc:359] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.094184 15840 raft_consensus.cc:385] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.094808 15840 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.084563 15543 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.106051 15876 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.115016 15837 tablet_bootstrap.cc:492] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.115474 15837 ts_tablet_manager.cc:1403] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.024s
I20260709 13:05:22.117189 15840 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.119412 15840 ts_tablet_manager.cc:1434] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:05:22.119340 15837 raft_consensus.cc:359] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.120384 15840 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:22.120584 15837 raft_consensus.cc:385] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.120896 15837 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.121590 15837 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.121361 15545 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.123508 15837 ts_tablet_manager.cc:1434] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:22.124322 15837 tablet_bootstrap.cc:492] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.129933 15837 tablet_bootstrap.cc:654] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:22.133599 15685 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.135062 15647 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.141302 15840 tablet_bootstrap.cc:654] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.157785 15840 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:22.158241 15840 ts_tablet_manager.cc:1403] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 13:05:22.161274 15858 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.161108 15840 raft_consensus.cc:359] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.165504 15840 raft_consensus.cc:385] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.166010 15840 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.166827 15840 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.169433 15836 tablet_bootstrap.cc:492] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:22.173112 15930 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.173116 15836 ts_tablet_manager.cc:1403] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.120s	user 0.022s	sys 0.040s
I20260709 13:05:22.175784 15837 tablet_bootstrap.cc:492] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.176240 15837 ts_tablet_manager.cc:1403] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.022s
I20260709 13:05:22.176965 15836 raft_consensus.cc:359] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.177634 15836 raft_consensus.cc:385] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.177949 15836 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.178560 15836 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.178844 15837 raft_consensus.cc:359] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.179903 15837 raft_consensus.cc:385] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.180146 15837 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.180725 15837 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.182652 15837 ts_tablet_manager.cc:1434] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:22.183544 15837 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.188311 15836 ts_tablet_manager.cc:1434] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:22.189707 15836 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:22.171764 15858 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.189864 15837 tablet_bootstrap.cc:654] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.195977 15930 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.196938 15836 tablet_bootstrap.cc:654] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.196565 15930 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.206890 15858 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.169574 15840 ts_tablet_manager.cc:1434] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:22.214877 15840 tablet_bootstrap.cc:492] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:22.248601 15890 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.249347 15890 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.278107 15971 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:05:22.282480 15843 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.290652 15843 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.290092 15930 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.286350 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.300266 15721 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:22.296132 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.291860 15890 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:05:22.303416 15610 leader_election.cc:343] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.291798 15841 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.322382 15905 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.323228 15905 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.316387 15837 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.317031 15836 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:22.319465 15843 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.320372 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:22.326179 15836 ts_tablet_manager.cc:1403] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.137s	user 0.037s	sys 0.043s
I20260709 13:05:22.327643 15905 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:22.325510 15837 ts_tablet_manager.cc:1403] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.142s	user 0.047s	sys 0.021s
I20260709 13:05:22.328408 15840 tablet_bootstrap.cc:654] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.330756 15841 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.336205 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:22.336970 15645 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:22.337317 15841 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.338135 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:22.334987 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46339.9us
I20260709 13:05:22.338835 15795 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:22.340204 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:22.340632 15843 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:22.341324 15688 leader_election.cc:343] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.341094 15843 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.341470 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:22.341120 15876 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.342803 15876 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.343173 15876 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.343348 15843 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.343940 15843 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.345572 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.348475 15721 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:22.349674 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:22.351436 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.351643 15863 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.350167 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.352063 15863 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.352557 15863 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.354507 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:22.356032 15861 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.356545 15861 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.356910 15861 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:22.350653 15688 leader_election.cc:343] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.352046 15721 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:22.356048 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.367184 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.368002 15721 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 1: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:05:22.363272 15863 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.366194 15837 raft_consensus.cc:359] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.370942 15837 raft_consensus.cc:385] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.371232 15837 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.371421 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:22.371856 15837 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.372933 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.373807 15843 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.375880 15837 ts_tablet_manager.cc:1434] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:05:22.377305 15837 tablet_bootstrap.cc:492] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.377954 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:22.370675 15863 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.382684 15836 raft_consensus.cc:359] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:22.383523 15685 leader_election.cc:343] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.383899 15836 raft_consensus.cc:385] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.383585 15905 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.384114 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.384357 15836 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
W20260709 13:05:22.385381 15685 leader_election.cc:343] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.386049 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.387179 15974 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.387602 15858 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.389308 15837 tablet_bootstrap.cc:654] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.391769 15843 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.394023 15840 tablet_bootstrap.cc:492] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:22.394565 15840 ts_tablet_manager.cc:1403] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.006s
I20260709 13:05:22.385329 15836 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:22.396152 15610 leader_election.cc:343] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.397142 15647 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.398702 15876 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.401525 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:22.402055 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:22.402971 15721 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.404678 15836 ts_tablet_manager.cc:1434] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260709 13:05:22.406754 15876 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:22.394954 15861 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.408222 15645 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:22.408756 15861 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.408403 15840 raft_consensus.cc:359] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.409346 15840 raft_consensus.cc:385] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.409757 15840 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.410871 15840 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.411470 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:22.414597 15836 tablet_bootstrap.cc:492] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:22.412817 15905 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:22.416667 15837 tablet_bootstrap.cc:492] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.417191 15837 ts_tablet_manager.cc:1403] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.005s
I20260709 13:05:22.427026 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:22.427760 15722 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.427942 15721 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:22.429013 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:22.422266 15796 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 1: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:05:22.430106 15719 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 1: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:05:22.430716 15840 ts_tablet_manager.cc:1434] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:05:22.431738 15861 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.433107 15645 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.434537 15722 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:22.440769 15760 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:22.442363 15876 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.442086 15837 raft_consensus.cc:359] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.442873 15876 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:22.443791 15876 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.444326 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:22.445928 15861 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.442889 15837 raft_consensus.cc:385] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.446892 15837 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.448971 15840 tablet_bootstrap.cc:492] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:22.447540 15837 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.453269 15837 ts_tablet_manager.cc:1434] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:05:22.454275 15837 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.473488 15836 tablet_bootstrap.cc:654] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.479674 15837 tablet_bootstrap.cc:654] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.516088 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:05:22.525796 15685 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.538466 15863 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:22.540812 15974 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.560439 15843 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.561067 15843 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:22.562358 15843 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.565095 15974 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.574631 15974 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.576884 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.582098 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:22.586077 15685 leader_election.cc:343] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:22.588277 15688 leader_election.cc:343] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.589469 15688 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.592006 15858 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.594810 15849 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.595211 15858 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.605932 15840 tablet_bootstrap.cc:700] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Time spent opening tablet: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:05:22.607513 15840 tablet_bootstrap.cc:654] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.611768 15849 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.612565 15849 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:22.639012 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 188749us
I20260709 13:05:22.640556 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.639492 15849 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:22.667304 15542 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.693885 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:22.704421 15849 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:22.706195 15762 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.707458 15849 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.713165 15796 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.715735 15863 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.716173 15974 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.716956 15974 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.721000 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:22.721886 15974 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.724145 15837 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.724906 15837 ts_tablet_manager.cc:1403] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.271s	user 0.017s	sys 0.009s
W20260709 13:05:22.730100 15688 leader_election.cc:343] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.732755 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.731498 15837 raft_consensus.cc:359] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.733635 15837 raft_consensus.cc:385] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:22.735953 15685 leader_election.cc:343] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.736941 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.738338 15974 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.734012 15837 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.756079 15836 tablet_bootstrap.cc:492] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:22.756765 15836 ts_tablet_manager.cc:1403] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.351s	user 0.009s	sys 0.016s
I20260709 13:05:22.757788 15837 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.764468 15836 raft_consensus.cc:359] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.765273 15836 raft_consensus.cc:385] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.765524 15836 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.780493 15836 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.782884 15836 ts_tablet_manager.cc:1434] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
W20260709 13:05:22.782389 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:22.784492 15836 tablet_bootstrap.cc:492] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:22.786942 15837 ts_tablet_manager.cc:1434] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:05:22.800700 15837 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.805620 15840 tablet_bootstrap.cc:492] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:22.806438 15840 ts_tablet_manager.cc:1403] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.358s	user 0.034s	sys 0.020s
I20260709 13:05:22.812722 15840 raft_consensus.cc:359] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.813668 15840 raft_consensus.cc:385] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.814085 15840 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.814860 15840 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.816829 15837 tablet_bootstrap.cc:654] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.817178 15840 ts_tablet_manager.cc:1434] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:22.816888 15986 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.817830 15986 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.818640 15840 tablet_bootstrap.cc:492] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:22.813768 15836 tablet_bootstrap.cc:654] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.822211 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.823035 15718 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:22.825101 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:22.826258 15973 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.826704 15973 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.827086 15973 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.837069 15543 catalog_manager.cc:5697] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.839545 15840 tablet_bootstrap.cc:654] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.842141 15986 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:22.855377 15849 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.855954 15849 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.856938 15840 tablet_bootstrap.cc:492] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:22.857422 15840 ts_tablet_manager.cc:1403] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 13:05:22.859403 15837 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:22.859892 15837 ts_tablet_manager.cc:1403] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.026s
I20260709 13:05:22.860392 15840 raft_consensus.cc:359] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.861171 15840 raft_consensus.cc:385] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.861459 15840 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.863256 15840 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.863866 15836 tablet_bootstrap.cc:492] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:22.864377 15836 ts_tablet_manager.cc:1403] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.017s
I20260709 13:05:22.865163 15837 raft_consensus.cc:359] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.865916 15837 raft_consensus.cc:385] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.866223 15837 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.867146 15837 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.867297 15836 raft_consensus.cc:359] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.867975 15836 raft_consensus.cc:385] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.868289 15836 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.868973 15840 ts_tablet_manager.cc:1434] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:05:22.870203 15840 tablet_bootstrap.cc:492] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:22.871660 15837 ts_tablet_manager.cc:1434] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:22.872782 15837 tablet_bootstrap.cc:492] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:22.868983 15836 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.875145 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:22.877434 15849 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:22.878162 15836 ts_tablet_manager.cc:1434] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:05:22.879347 15836 tablet_bootstrap.cc:492] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:22.879370 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:22.880445 15722 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:22.882431 15840 tablet_bootstrap.cc:654] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.882357 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.885996 15876 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.879347 15837 tablet_bootstrap.cc:654] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.889983 15836 tablet_bootstrap.cc:654] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.901091 15973 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.909883 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.910666 15796 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:22.914805 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:22.915506 15795 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.918402 15858 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.918959 15858 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:22.922926 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:22.923363 15858 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:05:22.924957 15685 leader_election.cc:343] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.932789 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:22.933403 15718 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.974542 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:22.975998 15688 leader_election.cc:343] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.976454 15688 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:22.977173 15858 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.983315 15794 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.992645 15876 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.993562 15876 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.995527 15849 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.997920 15795 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:22.999938 15718 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.000368 15973 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.001993 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.003575 15973 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.004164 15973 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.005175 15973 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.006217 15837 tablet_bootstrap.cc:492] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.006711 15837 ts_tablet_manager.cc:1403] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.134s	user 0.044s	sys 0.022s
I20260709 13:05:23.010363 15837 raft_consensus.cc:359] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.011138 15837 raft_consensus.cc:385] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.011467 15837 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.012329 15837 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.014937 15836 tablet_bootstrap.cc:492] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.015612 15836 ts_tablet_manager.cc:1403] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.043s
I20260709 13:05:23.014937 15840 tablet_bootstrap.cc:492] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.018392 15840 ts_tablet_manager.cc:1403] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.059s
I20260709 13:05:23.018909 15836 raft_consensus.cc:359] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.019804 15836 raft_consensus.cc:385] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.020107 15836 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.020860 15836 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.024456 15837 ts_tablet_manager.cc:1434] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:05:23.025784 15837 tablet_bootstrap.cc:492] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.027165 15836 ts_tablet_manager.cc:1434] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:23.028275 15836 tablet_bootstrap.cc:492] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.021456 15840 raft_consensus.cc:359] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.030992 15840 raft_consensus.cc:385] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.031304 15840 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.032073 15840 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.034236 15836 tablet_bootstrap.cc:654] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.041519 15544 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.049572 15836 tablet_bootstrap.cc:492] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.050143 15836 ts_tablet_manager.cc:1403] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 13:05:23.050201 15840 ts_tablet_manager.cc:1434] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:05:23.051431 15840 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.053220 15836 raft_consensus.cc:359] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.053982 15836 raft_consensus.cc:385] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.054288 15836 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.054994 15836 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.056919 15836 ts_tablet_manager.cc:1434] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:23.057957 15836 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.058782 15840 tablet_bootstrap.cc:654] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.064486 15836 tablet_bootstrap.cc:654] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.070595 15840 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.071126 15840 ts_tablet_manager.cc:1403] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:05:23.074366 15840 raft_consensus.cc:359] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.075116 15840 raft_consensus.cc:385] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.075400 15840 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.076263 15840 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.082897 15840 ts_tablet_manager.cc:1434] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:23.083990 15840 tablet_bootstrap.cc:492] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.088744 15840 tablet_bootstrap.cc:654] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.094934 15836 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.095458 15836 ts_tablet_manager.cc:1403] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.014s
I20260709 13:05:23.096545 15837 tablet_bootstrap.cc:654] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.098490 15836 raft_consensus.cc:359] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.099257 15836 raft_consensus.cc:385] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.099558 15836 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.100315 15836 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.106671 15836 ts_tablet_manager.cc:1434] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:23.107964 15836 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.109289 15974 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.109822 15974 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.112082 15974 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.113164 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.113677 15973 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.114058 15644 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:23.114269 15973 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.115821 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.116680 15973 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:05:23.117292 15685 leader_election.cc:343] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.118175 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.118817 15837 tablet_bootstrap.cc:492] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.119313 15837 ts_tablet_manager.cc:1403] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.007s
I20260709 13:05:23.119940 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.120632 15722 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.120064 15836 tablet_bootstrap.cc:654] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.121860 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.122315 15837 raft_consensus.cc:359] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.123029 15837 raft_consensus.cc:385] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.123351 15837 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.119236 15974 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.124469 15986 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.124657 15840 tablet_bootstrap.cc:492] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.124997 15986 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.125293 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.125415 15986 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.125411 15840 ts_tablet_manager.cc:1403] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.013s
W20260709 13:05:23.127108 15610 leader_election.cc:343] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.128079 15973 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.124529 15974 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.130012 15974 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.130462 15840 raft_consensus.cc:359] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.131531 15840 raft_consensus.cc:385] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.131919 15840 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.132761 15840 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.136744 15840 ts_tablet_manager.cc:1434] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:05:23.138228 15840 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.140456 15974 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.140686 15843 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.147970 15840 tablet_bootstrap.cc:654] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.142771 15986 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.149250 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.124097 15837 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.150889 15930 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.151602 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:23.151434 15930 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.152143 15644 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.150810 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.154093 15718 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:23.155985 15685 leader_election.cc:343] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.159523 15930 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.162112 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.163089 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:23.164429 15688 leader_election.cc:343] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:23.165040 15685 leader_election.cc:343] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.165479 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:23.166249 15858 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.168147 15837 ts_tablet_manager.cc:1434] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.002s
I20260709 13:05:23.170763 15837 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.148144 15974 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.171073 15986 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.176733 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.177378 15794 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.178625 15837 tablet_bootstrap.cc:654] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.163094 15718 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.182329 15836 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.183002 15836 ts_tablet_manager.cc:1403] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.044s
I20260709 13:05:23.182861 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.184036 15843 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.184695 15843 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.185817 15843 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.188570 15836 raft_consensus.cc:359] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.192646 15837 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.193493 15644 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:23.195133 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.196503 15974 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.197096 15974 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:23.198120 15974 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.189628 15836 raft_consensus.cc:385] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.204047 15836 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.204511 15837 ts_tablet_manager.cc:1403] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
I20260709 13:05:23.205078 15836 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.208359 15836 ts_tablet_manager.cc:1434] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:05:23.211308 15837 raft_consensus.cc:359] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.213363 15837 raft_consensus.cc:385] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.214455 15837 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.209987 15836 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.215873 15837 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.219292 15542 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.223582 15836 tablet_bootstrap.cc:654] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.229308 15794 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.232718 15837 ts_tablet_manager.cc:1434] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:05:23.233855 15837 tablet_bootstrap.cc:492] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.235385 15836 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.235880 15836 ts_tablet_manager.cc:1403] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.009s
I20260709 13:05:23.239117 15836 raft_consensus.cc:359] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.239800 15836 raft_consensus.cc:385] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.240072 15836 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.240530 15837 tablet_bootstrap.cc:654] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.240886 15836 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.243301 15836 ts_tablet_manager.cc:1434] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:23.244262 15836 tablet_bootstrap.cc:492] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.248044 15544 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.265475 15836 tablet_bootstrap.cc:654] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.276724 15974 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.286768 15974 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.291416 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:23.293754 15685 leader_election.cc:343] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.295137 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.296280 15644 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:23.301098 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.302359 15930 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.302861 15930 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.303304 15930 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.308705 15876 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.309429 15876 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.311617 15837 tablet_bootstrap.cc:492] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.312137 15837 ts_tablet_manager.cc:1403] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.012s
I20260709 13:05:23.314942 15837 raft_consensus.cc:359] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.315610 15837 raft_consensus.cc:385] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.289611 15974 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.315891 15837 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.316759 15837 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.319223 15837 ts_tablet_manager.cc:1434] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:23.320292 15837 tablet_bootstrap.cc:492] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.321724 15836 tablet_bootstrap.cc:492] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.322305 15836 ts_tablet_manager.cc:1403] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.078s	user 0.028s	sys 0.023s
I20260709 13:05:23.325114 15836 raft_consensus.cc:359] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.325829 15836 raft_consensus.cc:385] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.326061 15837 tablet_bootstrap.cc:654] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.326210 15836 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.326997 15836 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.329375 15836 ts_tablet_manager.cc:1434] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:23.315781 15840 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.330209 15840 ts_tablet_manager.cc:1403] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.192s	user 0.055s	sys 0.037s
I20260709 13:05:23.330982 15836 tablet_bootstrap.cc:492] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.332862 15840 raft_consensus.cc:359] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.336030 15876 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:23.333531 15840 raft_consensus.cc:385] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.339527 15840 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.340425 15836 tablet_bootstrap.cc:654] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.342856 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.343148 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.343528 15722 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:23.343700 15644 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:23.344672 15760 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:23.348099 15849 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.348528 15849 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.348867 15849 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.366309 15974 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.367039 15974 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.375512 15974 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.377270 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.378044 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.376648 15843 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.379666 15843 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.383667 15843 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.385828 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.386543 15718 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.387866 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:05:23.385788 15685 leader_election.cc:343] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.389991 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:23.391458 15610 leader_election.cc:343] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.394340 16025 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.394716 16025 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.395037 16025 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.395560 15930 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.399056 15861 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.399535 15861 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.400182 15836 tablet_bootstrap.cc:492] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.400641 15836 ts_tablet_manager.cc:1403] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.032s
I20260709 13:05:23.401562 15861 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.403952 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.404524 15930 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.404640 15795 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.392551 15849 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.405365 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.405611 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.406030 15722 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.406620 15849 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:23.395037 15837 tablet_bootstrap.cc:492] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.407387 15837 ts_tablet_manager.cc:1403] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.012s
I20260709 13:05:23.407270 15611 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.407553 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:05:23.408048 15688 leader_election.cc:343] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.408310 15644 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.408444 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:23.408551 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:23.409106 15645 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.403813 15836 raft_consensus.cc:359] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.411096 15836 raft_consensus.cc:385] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.411406 15836 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.412019 15836 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.412715 15843 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.413335 15843 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.413942 15843 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.402822 16025 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.416015 15645 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:23.416388 15644 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:23.417083 15930 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.417637 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.414008 15836 ts_tablet_manager.cc:1434] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:05:23.420318 15836 tablet_bootstrap.cc:492] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.420780 15837 raft_consensus.cc:359] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.421358 15849 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.422056 15849 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:23.421612 15837 raft_consensus.cc:385] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.422583 15837 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.423017 15849 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.423192 15837 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.426358 15836 tablet_bootstrap.cc:654] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.426405 15843 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.427412 15837 ts_tablet_manager.cc:1434] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:23.429029 15843 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.429297 15837 tablet_bootstrap.cc:492] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.430634 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.431448 15795 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.436450 15837 tablet_bootstrap.cc:654] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.441310 15795 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.440747 15544 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:23.455432 15836 tablet_bootstrap.cc:492] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.471582 15836 ts_tablet_manager.cc:1403] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.014s
I20260709 13:05:23.444438 15843 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:05:23.471896 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.472220 15973 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.360831 15840 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.473680 15794 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.473824 15843 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.474504 15843 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.475140 15836 raft_consensus.cc:359] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.475813 15836 raft_consensus.cc:385] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.476078 15836 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.476732 15836 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.476529 15843 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.458935 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.479036 15836 ts_tablet_manager.cc:1434] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:23.479439 15720 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.480302 15836 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.459918 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.483511 15794 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:23.488077 15836 tablet_bootstrap.cc:654] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:23.489326 15610 leader_election.cc:343] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.459056 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.491701 15718 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.465948 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.450965 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.458420 16025 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.497484 15722 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.502784 15974 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.508355 15974 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:23.511495 15974 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.506343 15720 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.518203 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.519047 15986 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.519649 15986 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:05:23.510613 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44781.1us
I20260709 13:05:23.520679 15986 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.541887 15861 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.542389 15861 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.544407 15861 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.547526 15840 ts_tablet_manager.cc:1434] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.217s	user 0.007s	sys 0.002s
I20260709 13:05:23.555776 15840 tablet_bootstrap.cc:492] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.557924 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:23.559382 15610 leader_election.cc:343] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.563551 15858 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.563999 15858 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.561568 15543 catalog_manager.cc:5697] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.570199 15858 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.550525 15718 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:23.589097 15836 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.589597 15836 ts_tablet_manager.cc:1403] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.029s
I20260709 13:05:23.597211 15837 tablet_bootstrap.cc:492] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.597887 15837 ts_tablet_manager.cc:1403] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.169s	user 0.023s	sys 0.015s
I20260709 13:05:23.605813 15836 raft_consensus.cc:359] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.606573 15836 raft_consensus.cc:385] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.606837 15836 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.607470 15836 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.609526 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.610173 15718 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.611476 15840 tablet_bootstrap.cc:654] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.611866 15836 ts_tablet_manager.cc:1434] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:05:23.615244 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.615945 15836 tablet_bootstrap.cc:492] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
W20260709 13:05:23.617273 15685 leader_election.cc:343] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.618188 16037 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.612573 15543 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.617513 15722 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.620543 16037 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.620761 15837 raft_consensus.cc:359] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.621615 15837 raft_consensus.cc:385] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.621951 15837 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.626595 15837 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.627501 15544 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.631695 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.633219 15611 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.632218 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.635063 16037 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:05:23.635442 15610 leader_election.cc:343] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.635587 16037 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.635947 16037 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.636276 16037 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.636356 15836 tablet_bootstrap.cc:654] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.642210 15837 ts_tablet_manager.cc:1434] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:05:23.644385 15837 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
W20260709 13:05:23.645530 15688 leader_election.cc:343] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.646919 15688 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:23.656004 16039 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.656661 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.657325 15722 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.661780 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.663303 16025 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.663654 16025 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.663973 16025 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.675412 15986 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.677127 15836 tablet_bootstrap.cc:492] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.673774 16025 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.677665 15836 ts_tablet_manager.cc:1403] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.011s
I20260709 13:05:23.678167 15837 tablet_bootstrap.cc:654] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.679625 16025 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.683513 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.684700 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:05:23.685014 15610 leader_election.cc:343] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.685276 15718 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.688675 15840 tablet_bootstrap.cc:492] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.689165 15840 ts_tablet_manager.cc:1403] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.014s
I20260709 13:05:23.691946 15718 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.692334 15836 raft_consensus.cc:359] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.693035 15836 raft_consensus.cc:385] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.693070 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.693418 15836 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.693962 16025 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.691745 15840 raft_consensus.cc:359] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.694576 15840 raft_consensus.cc:385] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.694885 15840 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.694089 15836 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.694723 16025 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.696408 16025 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.698325 15840 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.701311 15840 ts_tablet_manager.cc:1434] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:05:23.701253 16037 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.702389 15840 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.704411 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.705123 15718 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.708909 15840 tablet_bootstrap.cc:654] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.711302 15837 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.711442 15718 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.711934 15837 ts_tablet_manager.cc:1403] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.005s
I20260709 13:05:23.712654 15611 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:23.712764 16037 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.713852 15973 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.714461 15973 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.715415 15973 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.716533 15837 raft_consensus.cc:359] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.717396 15837 raft_consensus.cc:385] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.717823 15837 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.718528 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.719035 15837 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.722680 15837 ts_tablet_manager.cc:1434] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
W20260709 13:05:23.720204 15610 leader_election.cc:343] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.723111 15840 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.724489 16025 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.724941 16025 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.726694 15836 ts_tablet_manager.cc:1434] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:05:23.727010 16025 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.726729 15544 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.723675 15840 ts_tablet_manager.cc:1403] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 13:05:23.727728 16039 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.731598 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.731514 15840 raft_consensus.cc:359] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.732242 15840 raft_consensus.cc:385] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.732527 15840 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.733152 15840 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:23.733981 15610 leader_election.cc:343] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.734740 16037 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.735698 15840 ts_tablet_manager.cc:1434] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:23.736707 15840 tablet_bootstrap.cc:492] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.737453 15836 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:23.744076 15840 tablet_bootstrap.cc:654] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.745698 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.746366 15837 tablet_bootstrap.cc:492] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.746515 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.750501 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.751387 16025 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.751956 16025 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.752458 16025 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.757131 15840 tablet_bootstrap.cc:492] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.757616 15840 ts_tablet_manager.cc:1403] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:05:23.760179 16025 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.760201 15840 raft_consensus.cc:359] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.761102 15840 raft_consensus.cc:385] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.761440 15840 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.762473 16025 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.763263 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.763800 15722 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.764394 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:23.765854 15610 leader_election.cc:343] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.762180 15840 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.767932 15840 ts_tablet_manager.cc:1434] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:05:23.768916 15840 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.771154 15722 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.772504 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.773648 16025 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.774355 16025 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.775081 15840 tablet_bootstrap.cc:654] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.775163 16025 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.781884 15795 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.785916 15837 tablet_bootstrap.cc:654] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.806824 16041 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.808408 15840 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.808948 15840 ts_tablet_manager.cc:1403] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.017s
I20260709 13:05:23.828020 15876 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.828907 15840 raft_consensus.cc:359] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.829730 15840 raft_consensus.cc:385] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.830044 15840 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.830720 15840 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.834177 15840 ts_tablet_manager.cc:1434] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:05:23.835283 15840 tablet_bootstrap.cc:492] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.836640 15836 tablet_bootstrap.cc:654] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.838173 15544 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.843674 15837 tablet_bootstrap.cc:492] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:23.844159 15837 ts_tablet_manager.cc:1403] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.098s	user 0.005s	sys 0.037s
I20260709 13:05:23.847783 15876 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.848347 15876 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.849165 15837 raft_consensus.cc:359] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.850090 15837 raft_consensus.cc:385] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.850430 15837 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.851347 15837 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.853009 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.854175 15876 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:23.855571 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.856689 15718 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:23.856895 15837 ts_tablet_manager.cc:1434] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:05:23.858328 15973 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.859514 15973 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.861537 15840 tablet_bootstrap.cc:654] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.863101 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:23.864395 15876 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.865304 15836 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.865769 15836 ts_tablet_manager.cc:1403] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.138s	user 0.013s	sys 0.010s
I20260709 13:05:23.868274 15836 raft_consensus.cc:359] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.868916 15836 raft_consensus.cc:385] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.869184 15836 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.869786 15949 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.870690 15836 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.871048 15876 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.874104 15836 ts_tablet_manager.cc:1434] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:23.874632 15973 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.876391 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:23.875072 15836 tablet_bootstrap.cc:492] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
W20260709 13:05:23.879632 15610 leader_election.cc:343] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.880896 15973 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.880234 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.882180 15837 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:23.881526 15973 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.885902 15840 tablet_bootstrap.cc:492] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.886365 15840 ts_tablet_manager.cc:1403] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.004s
I20260709 13:05:23.887115 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.887813 15973 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.888303 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:23.889681 15610 leader_election.cc:343] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.889870 15718 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.891178 15840 raft_consensus.cc:359] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.891867 15840 raft_consensus.cc:385] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.892132 15840 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.892192 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.892912 15840 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.893507 16037 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.893906 16037 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.881688 15722 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:23.894393 16037 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.894981 15840 ts_tablet_manager.cc:1434] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:23.895924 15840 tablet_bootstrap.cc:492] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:23.895404 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.896750 16025 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.897152 16025 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.897650 16025 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.898656 15837 tablet_bootstrap.cc:654] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.899616 15836 tablet_bootstrap.cc:654] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.901923 16037 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.903229 15840 tablet_bootstrap.cc:654] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.905110 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.905763 15718 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.910841 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:23.912657 15610 leader_election.cc:343] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.913378 16037 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.918681 16025 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.921557 15718 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:23.923614 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:23.924706 16037 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.925433 16037 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:23.930581 15843 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.933866 16039 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.946195 15949 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.951375 15949 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.958372 15949 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:23.955232 16039 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.961159 16039 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.964262 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.926386 16037 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:23.954238 16025 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:23.968191 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:23.968859 15718 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.971590 15836 tablet_bootstrap.cc:492] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:23.972292 15836 ts_tablet_manager.cc:1403] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.009s
I20260709 13:05:23.981151 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:23.982604 16025 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.984139 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:23.984994 15719 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:23.986133 15760 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:23.986948 15949 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.988787 15840 tablet_bootstrap.cc:492] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:23.989387 15840 ts_tablet_manager.cc:1403] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.094s	user 0.035s	sys 0.020s
W20260709 13:05:23.993294 15610 leader_election.cc:343] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.996639 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:23.989934 16039 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.004978 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:24.009025 15685 leader_election.cc:343] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.010089 15837 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.010510 15837 ts_tablet_manager.cc:1403] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.129s	user 0.024s	sys 0.012s
I20260709 13:05:24.016485 15837 raft_consensus.cc:359] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.017194 15837 raft_consensus.cc:385] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.017511 15837 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.018250 15837 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.020349 15837 ts_tablet_manager.cc:1434] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:24.020895 16041 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:24.024008 15837 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.029879 16041 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.030553 16041 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.034471 15973 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.041253 15688 leader_election.cc:343] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.041795 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:24.062950 15840 raft_consensus.cc:359] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:24.070662 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:24.070941 16038 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.072160 15949 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.053030 16025 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:05:24.070797 15840 raft_consensus.cc:385] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.075129 15840 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.074954 15836 raft_consensus.cc:359] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.075783 15836 raft_consensus.cc:385] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.060148 15973 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.076089 15836 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.077549 15840 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.080214 15840 ts_tablet_manager.cc:1434] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 13:05:24.081225 15840 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.083104 15876 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.084558 15836 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.083592 15876 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.097139 15836 ts_tablet_manager.cc:1434] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.124s	user 0.006s	sys 0.014s
I20260709 13:05:24.100768 15876 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:24.101819 15986 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.101073 15718 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.104020 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.102289 15973 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.101854 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.105139 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:24.105489 15720 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:24.106792 16041 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.106873 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:24.108752 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.107950 15760 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:24.110000 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:24.110445 15840 tablet_bootstrap.cc:654] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.110605 15949 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:24.111868 15610 leader_election.cc:343] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:24.113155 15688 leader_election.cc:343] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.118353 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.119029 15720 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
W20260709 13:05:24.119588 15685 leader_election.cc:343] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.120038 15685 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:24.120755 16041 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.112062 15973 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.121778 15973 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:24.122601 15973 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.124708 15949 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.130270 15836 tablet_bootstrap.cc:492] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.137274 15837 tablet_bootstrap.cc:654] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.156713 15611 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:24.157639 16069 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.158023 16069 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.158340 16069 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.149076 16037 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:24.179796 15544 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.198458 15544 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.205462 15840 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.205971 15840 ts_tablet_manager.cc:1403] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.002s
I20260709 13:05:24.215232 15840 raft_consensus.cc:359] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.215919 15840 raft_consensus.cc:385] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.216187 15840 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.216185 16069 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.217178 15840 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.218429 16069 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.219369 15840 ts_tablet_manager.cc:1434] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:24.220453 15840 tablet_bootstrap.cc:492] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.231328 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:24.231989 15796 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.242345 16037 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.249785 15836 tablet_bootstrap.cc:654] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.249614 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:24.252174 16037 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.256565 15837 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.257124 15837 ts_tablet_manager.cc:1403] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.234s	user 0.016s	sys 0.012s
I20260709 13:05:24.257766 15718 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.256258 15796 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.276461 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.277809 15840 tablet_bootstrap.cc:654] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.278462 15986 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.279865 15986 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:24.280671 15986 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.283078 16068 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.286170 15718 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.295423 15796 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.298213 15837 raft_consensus.cc:359] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.299047 15837 raft_consensus.cc:385] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.299351 15837 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.301719 16068 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.300060 15837 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.309903 16068 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.312655 16068 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.315539 15837 ts_tablet_manager.cc:1434] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.005s
I20260709 13:05:24.313798 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:24.322901 15610 leader_election.cc:343] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.328133 15836 tablet_bootstrap.cc:492] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:24.328686 15836 ts_tablet_manager.cc:1403] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.202s	user 0.016s	sys 0.006s
I20260709 13:05:24.334059 15837 tablet_bootstrap.cc:492] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.335201 15876 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.335672 15876 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.337630 15840 tablet_bootstrap.cc:492] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.338121 15840 ts_tablet_manager.cc:1403] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.009s
I20260709 13:05:24.338376 15876 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:24.339562 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.334167 15543 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.335668 15986 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:24.341610 15840 raft_consensus.cc:359] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.341897 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.342772 15718 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:24.343307 15543 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.344610 15973 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.340174 15837 tablet_bootstrap.cc:654] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.342394 15840 raft_consensus.cc:385] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.350198 15840 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.350965 15840 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.351927 15836 raft_consensus.cc:359] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.352689 15836 raft_consensus.cc:385] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.353027 15836 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.346175 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:24.353776 15836 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.354592 15840 ts_tablet_manager.cc:1434] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:24.355077 15949 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.355896 15840 tablet_bootstrap.cc:492] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.356297 15836 ts_tablet_manager.cc:1434] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:24.357470 15836 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.361310 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.361994 15718 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:24.363392 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:24.364646 15973 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.365051 15973 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.365453 15973 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.366724 15836 tablet_bootstrap.cc:654] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.373787 15837 tablet_bootstrap.cc:492] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.374425 15837 ts_tablet_manager.cc:1403] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.006s
I20260709 13:05:24.377621 15837 raft_consensus.cc:359] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.379596 15837 raft_consensus.cc:385] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.380407 15837 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.382897 15837 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.385864 15837 ts_tablet_manager.cc:1434] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:24.368386 15949 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.387887 15836 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:24.389142 15836 ts_tablet_manager.cc:1403] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.009s
I20260709 13:05:24.378000 15973 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.390568 15837 tablet_bootstrap.cc:492] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.392163 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:24.392920 15721 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.396937 15840 tablet_bootstrap.cc:654] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.400426 15973 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.401916 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:24.403614 15610 leader_election.cc:343] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.403841 15721 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.392153 15836 raft_consensus.cc:359] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.407068 15836 raft_consensus.cc:385] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.407511 15836 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.409117 15837 tablet_bootstrap.cc:654] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.408387 15836 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.418563 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:24.419407 15836 ts_tablet_manager.cc:1434] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:05:24.419818 15973 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.420486 15836 tablet_bootstrap.cc:492] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.420367 15973 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:24.421729 16038 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.421463 15973 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.422302 16038 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.427696 15836 tablet_bootstrap.cc:654] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.430210 15840 tablet_bootstrap.cc:492] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.430739 15840 ts_tablet_manager.cc:1403] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.015s
I20260709 13:05:24.430810 16038 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.432080 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:24.438967 15796 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:24.432884 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.440354 15644 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:24.441936 15688 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.442940 16038 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.443388 16038 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.443527 15837 tablet_bootstrap.cc:492] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.443779 16038 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.444013 15837 ts_tablet_manager.cc:1403] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.054s	user 0.001s	sys 0.015s
I20260709 13:05:24.447351 15837 raft_consensus.cc:359] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.448050 15837 raft_consensus.cc:385] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.448369 15837 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.449106 15837 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.459568 15840 raft_consensus.cc:359] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.460336 15840 raft_consensus.cc:385] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.460618 15840 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.461395 15840 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.463380 16038 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.464344 15840 ts_tablet_manager.cc:1434] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:05:24.467163 15840 tablet_bootstrap.cc:492] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.467499 15542 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.468482 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:24.469115 15645 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.471872 15973 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.474489 15836 tablet_bootstrap.cc:492] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:24.474979 15836 ts_tablet_manager.cc:1403] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.010s
I20260709 13:05:24.483465 15840 tablet_bootstrap.cc:654] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.488307 15836 raft_consensus.cc:359] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.489300 15836 raft_consensus.cc:385] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.489619 15836 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.492813 15836 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.466044 15837 ts_tablet_manager.cc:1434] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:05:24.495980 15837 tablet_bootstrap.cc:492] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.488126 15645 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:24.497124 15688 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.498075 16041 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.498558 16041 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:24.499389 16041 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.503330 15974 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.503988 15974 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.506990 16038 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.507155 15974 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.509765 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:24.513104 15685 leader_election.cc:343] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.514215 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.515038 15645 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:24.516264 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:24.517233 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:24.521039 15796 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.522037 15973 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.517535 16041 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.525177 16041 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.533968 16041 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.533876 15544 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.537525 15837 tablet_bootstrap.cc:654] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.549160 15796 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:24.544298 16041 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.550681 15840 tablet_bootstrap.cc:492] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.550858 15836 ts_tablet_manager.cc:1434] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.001s
I20260709 13:05:24.551127 15840 ts_tablet_manager.cc:1403] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.084s	user 0.045s	sys 0.016s
I20260709 13:05:24.551826 15836 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.553660 15840 raft_consensus.cc:359] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.554433 15840 raft_consensus.cc:385] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.554711 15840 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.555486 15840 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.556865 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:24.557431 15645 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.558312 15840 ts_tablet_manager.cc:1434] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:24.558951 15836 tablet_bootstrap.cc:654] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.562568 15840 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.564744 15645 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:24.566107 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.567143 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:24.567840 16038 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:24.568362 15685 leader_election.cc:343] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.569276 16038 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:24.569504 15840 tablet_bootstrap.cc:654] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.570696 15837 tablet_bootstrap.cc:492] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.571228 15837 ts_tablet_manager.cc:1403] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.002s
I20260709 13:05:24.573104 16038 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.573670 16041 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.575054 15837 raft_consensus.cc:359] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.575870 15837 raft_consensus.cc:385] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.576189 15837 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.576916 15837 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.579435 15837 ts_tablet_manager.cc:1434] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:05:24.580698 15837 tablet_bootstrap.cc:492] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.583524 15836 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:24.584074 15836 ts_tablet_manager.cc:1403] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.005s
I20260709 13:05:24.586843 15836 raft_consensus.cc:359] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.587507 15836 raft_consensus.cc:385] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.587769 15836 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.588388 15836 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.591142 15836 ts_tablet_manager.cc:1434] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:24.592473 15836 tablet_bootstrap.cc:492] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.595649 15837 tablet_bootstrap.cc:654] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.607753 15836 tablet_bootstrap.cc:654] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.618458 15840 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.618916 15840 ts_tablet_manager.cc:1403] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.011s
I20260709 13:05:24.621496 15840 raft_consensus.cc:359] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.622155 15840 raft_consensus.cc:385] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.622416 15840 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.622059 15837 tablet_bootstrap.cc:492] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.623157 15837 ts_tablet_manager.cc:1403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.007s
I20260709 13:05:24.623210 15840 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.624130 15793 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.623968 15544 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.625339 15840 ts_tablet_manager.cc:1434] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:24.626148 15837 raft_consensus.cc:359] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.626880 15837 raft_consensus.cc:385] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.627242 15837 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.628016 15837 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.629628 15836 tablet_bootstrap.cc:492] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:24.630079 15837 ts_tablet_manager.cc:1434] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:24.630074 15836 ts_tablet_manager.cc:1403] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.005s
I20260709 13:05:24.631059 15837 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.633253 15840 tablet_bootstrap.cc:492] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.633322 15836 raft_consensus.cc:359] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.634627 15836 raft_consensus.cc:385] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.634881 15836 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.637574 15836 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.639752 15836 ts_tablet_manager.cc:1434] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:24.642760 15840 tablet_bootstrap.cc:654] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.650709 16068 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.668800 15836 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.671056 15837 tablet_bootstrap.cc:654] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.678247 16068 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.680276 15840 tablet_bootstrap.cc:492] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.680903 15840 ts_tablet_manager.cc:1403] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.021s
I20260709 13:05:24.688297 15836 tablet_bootstrap.cc:654] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.689224 15837 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:24.689775 15837 ts_tablet_manager.cc:1403] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.008s
I20260709 13:05:24.689704 16068 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.693128 15837 raft_consensus.cc:359] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.694520 15837 raft_consensus.cc:385] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.694890 15837 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.685149 15840 raft_consensus.cc:359] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.695842 15840 raft_consensus.cc:385] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.695915 16068 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.696302 15840 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.696591 16068 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.697418 15840 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.697958 15837 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.699241 15840 ts_tablet_manager.cc:1434] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:24.699538 16068 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.699872 15837 ts_tablet_manager.cc:1434] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:24.700369 15840 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.699780 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.701175 15720 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:24.700562 16069 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.702041 15837 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:24.702262 16069 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.736007 15840 tablet_bootstrap.cc:654] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.741271 16038 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.741921 16038 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.744192 16038 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.747885 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.748533 15645 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:24.749660 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.750571 16038 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.750998 16038 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.751679 16038 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.747221 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:24.761348 16038 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:24.762327 15685 leader_election.cc:343] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.764195 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:24.764750 16069 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.764829 15645 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.764889 15836 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:24.792098 15836 ts_tablet_manager.cc:1403] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.003s
I20260709 13:05:24.792948 15876 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.793433 15876 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.794745 15836 raft_consensus.cc:359] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.795394 15836 raft_consensus.cc:385] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.795426 15876 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:24.795734 15836 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.796377 15836 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.767635 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:24.798080 15645 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:24.798388 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.799014 15644 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:24.799537 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.800320 16041 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.800550 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.800776 16041 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:05:24.801404 15685 leader_election.cc:343] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.769114 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:24.777199 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:24.785414 15840 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:24.802625 15796 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:24.802994 15795 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:24.803133 15840 ts_tablet_manager.cc:1403] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.103s	user 0.049s	sys 0.023s
I20260709 13:05:24.767777 15611 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.804066 15973 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.804409 15973 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.804754 15973 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.805512 15836 ts_tablet_manager.cc:1434] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:05:24.805444 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.806218 15718 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:24.806674 15836 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:24.801630 16041 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.808143 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.808919 16069 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.809295 16069 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.809759 16069 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.805830 15840 raft_consensus.cc:359] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.810720 15840 raft_consensus.cc:385] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.811069 15840 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.811671 15905 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.816218 15905 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.816628 15905 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.790395 15837 tablet_bootstrap.cc:654] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.815523 15840 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.766389 16038 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.790977 16068 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
W20260709 13:05:24.821377 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 116613us
I20260709 13:05:24.822872 15840 ts_tablet_manager.cc:1434] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.008s
I20260709 13:05:24.821547 15973 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.838862 15973 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.841667 16069 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.843665 16069 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:24.881070 15840 tablet_bootstrap.cc:492] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:24.898138 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.900924 15721 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:24.902387 15794 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.903229 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:24.906086 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:24.906702 15791 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.907255 15905 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.908098 15840 tablet_bootstrap.cc:654] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.918846 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:24.919485 15721 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.918319 15791 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.926442 15544 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.930326 15792 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 1: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:05:24.931537 15974 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.941298 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:24.941952 15720 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.946547 15836 tablet_bootstrap.cc:654] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.947984 15905 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:24.948717 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:24.949461 15644 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:24.951311 15721 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.965874 15949 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.966496 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:24.967344 15717 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:24.966549 15949 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:24.968417 15760 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:24.969702 15876 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.970227 15949 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:24.974167 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:24.983915 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:24.984587 15717 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:24.973588 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:24.985667 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:24.988024 16111 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.988564 16111 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:24.988363 16069 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.991520 15720 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:24.994079 15876 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:24.994592 15876 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.995014 15876 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.994300 16111 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.009850 15974 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.015770 15611 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:25.017041 15973 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.017712 15973 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:25.018833 15973 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.013649 15876 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.027875 15792 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:25.033543 15876 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.036962 15837 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:25.037458 15837 ts_tablet_manager.cc:1403] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.336s	user 0.019s	sys 0.022s
I20260709 13:05:25.037926 15974 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.038655 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:25.040431 15837 raft_consensus.cc:359] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.041275 15837 raft_consensus.cc:385] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.041749 15837 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.042366 15974 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.042742 15837 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.041725 15930 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:25.045058 15837 ts_tablet_manager.cc:1434] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:25.045075 15974 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.046119 15837 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:25.049829 15836 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.050534 15836 ts_tablet_manager.cc:1403] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.244s	user 0.016s	sys 0.004s
I20260709 13:05:25.051118 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:25.051224 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.051548 15793 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.053586 16037 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.054495 16037 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.056064 15840 tablet_bootstrap.cc:492] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:25.056506 16037 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.053575 15717 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.052687 16068 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:25.056531 15840 ts_tablet_manager.cc:1403] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.176s	user 0.010s	sys 0.041s
I20260709 13:05:25.068374 15974 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:25.072677 15685 leader_election.cc:343] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.085873 16068 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.086354 16068 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:25.087181 16068 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.091214 15974 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.091909 15974 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.102571 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:25.115068 15840 raft_consensus.cc:359] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.115814 15840 raft_consensus.cc:385] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.116101 15840 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.118125 15836 raft_consensus.cc:359] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.118830 15836 raft_consensus.cc:385] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.118960 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.119529 16068 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.119729 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:25.120342 15685 leader_election.cc:343] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:25.122046 15611 leader_election.cc:343] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.123143 15974 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.121448 15717 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:25.125267 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.126261 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:25.131177 15688 leader_election.cc:343] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.131810 15688 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:25.135071 15974 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.119129 15836 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.116782 15840 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.148281 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:05:25.141820 15543 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.149115 15876 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:25.149854 15688 leader_election.cc:343] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.150261 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:25.150238 15543 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.152518 15876 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:25.152619 15836 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.154764 15837 tablet_bootstrap.cc:654] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:25.143934 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:25.153231 15876 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:25.158305 15610 leader_election.cc:343] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.158918 15610 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:25.160004 15843 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.163154 15930 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.167263 15840 ts_tablet_manager.cc:1434] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.004s
I20260709 13:05:25.169142 15840 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:25.168157 15836 ts_tablet_manager.cc:1434] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.000s
I20260709 13:05:25.202064 15542 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:25.205235 15673 tablet.cc:2406] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:25.208601 15836 tablet_bootstrap.cc:492] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.228499 15837 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:25.228987 15837 ts_tablet_manager.cc:1403] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.183s	user 0.043s	sys 0.015s
I20260709 13:05:25.230583 15840 tablet_bootstrap.cc:654] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.236747 15836 tablet_bootstrap.cc:654] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.237003 15837 raft_consensus.cc:359] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.240780 15837 raft_consensus.cc:385] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.241061 15837 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.241664 15837 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.243678 15837 ts_tablet_manager.cc:1434] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:05:25.243786 15836 tablet_bootstrap.cc:492] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.243786 15840 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:25.244438 15836 ts_tablet_manager.cc:1403] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 13:05:25.244438 15840 ts_tablet_manager.cc:1403] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 13:05:25.244879 15837 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:25.247617 15840 raft_consensus.cc:359] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.247617 15836 raft_consensus.cc:359] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.248432 15840 raft_consensus.cc:385] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.248520 15836 raft_consensus.cc:385] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.248740 15840 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.248793 15836 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.249506 15836 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.249565 15840 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.254671 15837 tablet_bootstrap.cc:654] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.255398 15836 ts_tablet_manager.cc:1434] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:25.256363 15836 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.262903 15840 ts_tablet_manager.cc:1434] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:05:25.263996 15840 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:25.265467 15837 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:25.265990 15837 ts_tablet_manager.cc:1403] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:05:25.266494 15836 tablet_bootstrap.cc:654] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.268476 15837 raft_consensus.cc:359] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.269186 15837 raft_consensus.cc:385] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.269634 15837 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.270364 15837 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.271461 15840 tablet_bootstrap.cc:654] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.272069 15836 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.272308 15837 ts_tablet_manager.cc:1434] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:25.272537 15836 ts_tablet_manager.cc:1403] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:05:25.273581 15837 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:25.276011 15836 raft_consensus.cc:359] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.276917 15836 raft_consensus.cc:385] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.277237 15836 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.279966 15837 tablet_bootstrap.cc:654] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.283731 15836 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.297626 15836 ts_tablet_manager.cc:1434] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:05:25.299031 15836 tablet_bootstrap.cc:492] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.307180 15836 tablet_bootstrap.cc:654] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.314368 15930 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.314908 15930 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.317003 15930 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.319123 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.319393 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:05:25.320760 15685 leader_election.cc:343] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.322623 15840 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:25.323052 15840 ts_tablet_manager.cc:1403] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.018s
I20260709 13:05:25.324812 15840 raft_consensus.cc:359] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.325356 15840 raft_consensus.cc:385] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:25.325378 15688 leader_election.cc:343] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.325692 15840 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.325868 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:25.322623 15836 tablet_bootstrap.cc:492] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.326891 15974 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.327189 15836 ts_tablet_manager.cc:1403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 13:05:25.329370 15836 raft_consensus.cc:359] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.329916 15836 raft_consensus.cc:385] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.326396 15840 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.330160 15836 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.331110 15836 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.331683 15840 ts_tablet_manager.cc:1434] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:25.333060 15836 ts_tablet_manager.cc:1434] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:25.333871 15836 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.339793 15836 tablet_bootstrap.cc:654] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.333886 15840 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:25.348060 15840 tablet_bootstrap.cc:654] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.363710 15791 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.376354 15840 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:25.376863 15840 ts_tablet_manager.cc:1403] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.007s
I20260709 13:05:25.380329 15840 raft_consensus.cc:359] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.380816 15837 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:25.380908 15836 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.381021 15840 raft_consensus.cc:385] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.381385 15840 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.381399 15837 ts_tablet_manager.cc:1403] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.108s	user 0.034s	sys 0.058s
I20260709 13:05:25.382277 15840 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.383423 15974 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.383829 15840 ts_tablet_manager.cc:1434] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:25.384342 15837 raft_consensus.cc:359] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.384778 15840 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:25.385046 15837 raft_consensus.cc:385] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.385347 15837 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.381492 15836 ts_tablet_manager.cc:1403] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.007s
I20260709 13:05:25.387429 15837 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.391111 15974 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.391405 15836 raft_consensus.cc:359] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.392105 15836 raft_consensus.cc:385] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.392297 15837 ts_tablet_manager.cc:1434] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:25.392385 15836 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.393421 15837 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:25.395666 15840 tablet_bootstrap.cc:654] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.393263 15836 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.399354 15837 tablet_bootstrap.cc:654] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.400084 15836 ts_tablet_manager.cc:1434] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:05:25.401055 15836 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.407217 15836 tablet_bootstrap.cc:654] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.415910 15836 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.416368 15836 ts_tablet_manager.cc:1403] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:25.417039 15986 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.417814 15986 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.419219 15836 raft_consensus.cc:359] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.419909 15836 raft_consensus.cc:385] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.420181 15836 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.420616 15986 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.420781 15836 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.425793 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.431069 15836 ts_tablet_manager.cc:1434] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
W20260709 13:05:25.431317 15611 leader_election.cc:343] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.432660 15836 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.432253 16068 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:25.447836 15836 tablet_bootstrap.cc:654] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.451237 16109 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.452220 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.451956 16109 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.455024 16109 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.456118 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:25.457077 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.457087 15644 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
W20260709 13:05:25.459479 15760 leader_election.cc:343] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.460243 15762 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:25.462069 16109 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.462883 16109 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.463276 16109 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:25.466547 15610 leader_election.cc:343] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.476306 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:25.477646 15986 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:25.483052 15986 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.502010 16111 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.483654 15986 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.524398 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.525605 15721 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:25.505393 15974 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.527724 15974 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.531973 16041 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.532636 16041 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.533910 15876 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.534516 15876 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.540818 15876 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.546118 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:25.546941 15644 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:25.548681 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:25.549674 15876 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.550132 15876 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.550482 15876 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.577955 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.580622 15721 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:25.594158 16041 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.604236 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.513597 15986 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.607244 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:25.608866 16111 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.609360 16111 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.609859 16111 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.629693 16109 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.676362 16109 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.682058 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:25.682740 15644 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.686237 15642 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:05:25.686720 15642 pending_rounds.cc:85] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 0
I20260709 13:05:25.687063 15642 pending_rounds.cc:107] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:05:25.687477 15642 raft_consensus.cc:2889] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:25.641925 15843 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.659271 15840 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:25.691007 15840 ts_tablet_manager.cc:1403] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.306s	user 0.020s	sys 0.025s
I20260709 13:05:25.661890 15836 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:25.693909 15836 ts_tablet_manager.cc:1403] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.261s	user 0.080s	sys 0.101s
I20260709 13:05:25.667970 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:25.666384 15837 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:25.689548 15843 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.695261 15837 ts_tablet_manager.cc:1403] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.302s	user 0.069s	sys 0.123s
W20260709 13:05:25.632447 15685 leader_election.cc:343] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.649865 15876 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:25.696236 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 63832.6us
I20260709 13:05:25.694463 15643 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:25.671446 16111 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.667291 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:25.709690 15843 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.718091 15876 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.665387 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.631940 15974 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.724092 15949 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.724462 15837 raft_consensus.cc:359] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.725165 15837 raft_consensus.cc:385] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.725437 15837 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.634274 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.719820 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:25.731415 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:25.734447 15646 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.736238 15836 raft_consensus.cc:359] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.736966 15836 raft_consensus.cc:385] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.737249 15836 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.737943 15836 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.738246 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:25.739039 15717 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.740113 15836 ts_tablet_manager.cc:1434] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:05:25.741075 15836 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:25.726092 15837 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.741637 15644 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:25.742352 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.742645 15721 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.730417 15840 raft_consensus.cc:359] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.743155 15716 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:25.743429 15840 raft_consensus.cc:385] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.743752 15840 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.744406 15840 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.726639 16111 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.750357 15837 ts_tablet_manager.cc:1434] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:05:25.750576 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:25.751340 15837 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:25.752140 16111 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.752604 16111 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.753013 16111 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.754158 15762 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:25.754918 15905 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.755355 15905 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:25.756098 15905 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.759862 16109 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.760330 16109 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.780293 15840 ts_tablet_manager.cc:1434] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.003s
I20260709 13:05:25.766902 15836 tablet_bootstrap.cc:654] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.783624 15843 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:05:25.788173 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 81991.1us
W20260709 13:05:25.790802 15685 leader_election.cc:343] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.785285 16069 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:05:25.803879 15716 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:25.806239 15876 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:25.764057 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:25.762691 16109 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.769033 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.761730 15721 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:25.813879 15840 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:25.770722 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:05:25.817853 15610 leader_election.cc:343] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.818431 15718 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:25.820330 15719 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.816507 15643 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:25.825366 15986 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.837411 15760 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:25.838434 15876 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.838798 15876 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.839097 15876 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.841895 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:25.837407 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:05:25.845255 15688 leader_election.cc:343] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.845824 15688 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:25.847728 15876 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.846495 15986 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.852748 16148 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.858081 16148 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.858433 16148 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.858382 15646 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:25.859051 15986 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:25.859376 15837 tablet_bootstrap.cc:654] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.855350 15930 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.864516 15876 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:25.868314 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:25.869169 15717 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:25.855154 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:25.871034 15876 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.871681 15791 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.871438 15876 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:25.867556 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:25.873138 15876 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.877857 15722 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.875541 15719 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:25.863914 16111 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:25.903957 15722 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:25.901578 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:25.911054 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:25.918469 16069 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.919004 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:25.924614 15643 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.919008 16069 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:25.925658 15719 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
W20260709 13:05:26.021112 16150 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 13:05:26.023074 16069 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.048954 15791 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:26.112341 15840 tablet_bootstrap.cc:654] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.112869 16111 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:05:26.113761 15610 leader_election.cc:343] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.118856 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:26.119899 15611 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:26.122565 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:26.123121 15722 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.123034 16068 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:26.124509 16068 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.127128 15760 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:26.124909 16068 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.953197 15643 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:26.219427 15722 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:26.222066 15836 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:26.219509 15837 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:26.222571 15836 ts_tablet_manager.cc:1403] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.482s	user 0.012s	sys 0.006s
I20260709 13:05:26.222967 15837 ts_tablet_manager.cc:1403] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.472s	user 0.019s	sys 0.005s
W20260709 13:05:26.224627 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 97538us
I20260709 13:05:26.247614 16156 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.248238 16156 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:26.249110 16156 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.263109 15544 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:26.271781 15610 leader_election.cc:343] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.287065 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:26.288825 16146 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.282698 16148 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.299754 15836 raft_consensus.cc:359] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.310611 15836 raft_consensus.cc:385] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.311031 15836 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.319011 15836 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.321478 15840 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:26.322139 15840 ts_tablet_manager.cc:1403] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.509s	user 0.018s	sys 0.013s
I20260709 13:05:26.293669 15837 raft_consensus.cc:359] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.327303 15837 raft_consensus.cc:385] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.327771 15837 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.330816 15837 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.295176 16148 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:26.290130 16068 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.307693 16146 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:26.343170 15836 ts_tablet_manager.cc:1434] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.003s
I20260709 13:05:26.303777 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:26.358886 15837 ts_tablet_manager.cc:1434] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.006s
W20260709 13:05:26.363940 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84122.7us
I20260709 13:05:26.401041 15837 tablet_bootstrap.cc:492] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:26.442036 15836 tablet_bootstrap.cc:492] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:26.448840 15840 raft_consensus.cc:359] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.449867 15840 raft_consensus.cc:385] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.450220 15840 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.451061 15840 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.376950 16068 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:26.414354 16146 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.458076 15840 ts_tablet_manager.cc:1434] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.002s
I20260709 13:05:26.484145 16173 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:26.485919 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:26.486549 15795 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.463924 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:26.497928 15840 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:26.493691 15795 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
W20260709 13:05:26.550071 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 47024.8us
W20260709 13:05:26.566720 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 118298us
I20260709 13:05:26.557402 16109 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 13:05:26.580291 15685 leader_election.cc:343] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.582952 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:26.583738 15715 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.593317 15837 tablet_bootstrap.cc:654] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.595512 16165 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.596134 16165 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.598651 16165 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:26.592434 16041 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.602592 16041 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.614555 15836 tablet_bootstrap.cc:654] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.614502 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:26.631421 16041 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:26.634291 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:26.634545 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:26.635149 15640 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
W20260709 13:05:26.635628 15685 leader_election.cc:343] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.637442 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:26.639109 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:26.639734 15643 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.642776 15840 tablet_bootstrap.cc:654] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.642159 16038 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:26.646658 16038 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.647027 16038 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.676290 15543 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.690553 15905 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:26.693073 15610 leader_election.cc:343] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.693482 15715 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:26.699123 16156 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.702122 15643 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:26.707564 16038 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.708055 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:05:26.719031 15610 leader_election.cc:343] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.720952 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:26.725529 15930 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.729027 15930 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:26.729437 16038 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:26.729924 15930 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.719960 16172 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.711315 15905 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:05:26.771277 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:26.772693 15685 leader_election.cc:343] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.726639 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:26.763839 16172 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:26.783833 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:26.792001 15840 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:26.797091 15840 ts_tablet_manager.cc:1403] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.299s	user 0.017s	sys 0.002s
I20260709 13:05:26.789292 15719 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 1: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:05:26.798949 15836 tablet_bootstrap.cc:492] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:26.799196 15837 tablet_bootstrap.cc:492] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:26.799425 15836 ts_tablet_manager.cc:1403] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.390s	user 0.036s	sys 0.032s
I20260709 13:05:26.799664 15837 ts_tablet_manager.cc:1403] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.399s	user 0.011s	sys 0.021s
I20260709 13:05:26.801819 15641 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.783993 16172 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:26.832839 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:26.833420 15840 raft_consensus.cc:359] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.834658 15840 raft_consensus.cc:385] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.834985 15840 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.843391 16165 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.844632 15836 raft_consensus.cc:359] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.862939 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:26.835830 15840 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.872014 15840 ts_tablet_manager.cc:1434] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.001s
I20260709 13:05:26.872931 15836 raft_consensus.cc:385] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.873284 15836 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.874014 15836 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.875602 15641 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:26.879026 16164 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:26.879592 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:26.880925 16041 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.881388 16041 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:26.884971 16041 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.887130 15836 ts_tablet_manager.cc:1434] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.087s	user 0.002s	sys 0.005s
I20260709 13:05:26.888118 15836 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:26.894443 15836 tablet_bootstrap.cc:654] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.906503 16109 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.911645 15840 tablet_bootstrap.cc:492] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:26.826009 15837 raft_consensus.cc:359] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.918483 15837 raft_consensus.cc:385] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.918895 15837 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.919710 15837 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.924772 16165 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.932235 15543 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.935631 15837 ts_tablet_manager.cc:1434] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.136s	user 0.004s	sys 0.004s
I20260709 13:05:26.941803 15837 tablet_bootstrap.cc:492] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:26.944754 15840 tablet_bootstrap.cc:654] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.938711 15543 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.958102 16172 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.961977 15836 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:26.965776 15836 ts_tablet_manager.cc:1403] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.016s
I20260709 13:05:26.968801 15836 raft_consensus.cc:359] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.969622 15836 raft_consensus.cc:385] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.969965 15836 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.971309 15836 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:26.973780 15836 ts_tablet_manager.cc:1434] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:05:26.975109 15836 tablet_bootstrap.cc:492] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:26.975780 15544 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.977479 15544 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:26.978956 15610 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:26.982748 15836 tablet_bootstrap.cc:654] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.994465 15542 catalog_manager.cc:5697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.995872 15837 tablet_bootstrap.cc:654] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.996361 15542 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.998761 15836 tablet_bootstrap.cc:492] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:26.999217 15836 ts_tablet_manager.cc:1403] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 13:05:27.001770 15836 raft_consensus.cc:359] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.002470 15836 raft_consensus.cc:385] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.002820 15836 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.003490 15836 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.005609 15836 ts_tablet_manager.cc:1434] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:27.006559 15836 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:27.011483 15837 tablet_bootstrap.cc:492] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.012064 15837 ts_tablet_manager.cc:1403] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.010s
I20260709 13:05:27.012418 15836 tablet_bootstrap.cc:654] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.038793 15837 raft_consensus.cc:359] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.039582 15840 tablet_bootstrap.cc:492] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:27.039721 15837 raft_consensus.cc:385] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.040118 15837 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.040753 15837 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.041218 15840 ts_tablet_manager.cc:1403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.130s	user 0.016s	sys 0.008s
I20260709 13:05:27.043330 15837 ts_tablet_manager.cc:1434] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:05:27.044344 15837 tablet_bootstrap.cc:492] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.044730 15840 raft_consensus.cc:359] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.045411 15840 raft_consensus.cc:385] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.045672 15840 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.046346 15840 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.049052 15840 ts_tablet_manager.cc:1434] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:27.050073 15840 tablet_bootstrap.cc:492] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:27.052392 15837 tablet_bootstrap.cc:654] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.053283 16149 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.053560 15836 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:27.054019 15836 ts_tablet_manager.cc:1403] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.022s
I20260709 13:05:27.053787 16149 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.055958 15840 tablet_bootstrap.cc:654] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.056079 16149 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.056628 15836 raft_consensus.cc:359] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.056762 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.057327 15836 raft_consensus.cc:385] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.057636 15644 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:27.058089 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:27.057659 15836 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.059098 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:05:27.059849 15685 leader_election.cc:343] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.060143 16041 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.060092 15836 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.060618 16041 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.061092 16041 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.064626 16149 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.065397 16149 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.066622 15836 ts_tablet_manager.cc:1434] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:05:27.067636 15836 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:27.069067 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.069691 15644 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:27.070911 15688 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:27.071759 15974 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.072111 15974 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.072446 15974 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.072887 16149 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.076858 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:27.078320 15685 leader_election.cc:343] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.078848 15836 tablet_bootstrap.cc:654] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.079306 16041 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.084020 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:27.084787 15644 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.086719 16041 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.086938 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:27.088915 15685 leader_election.cc:343] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.091559 15837 tablet_bootstrap.cc:492] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.092114 15837 ts_tablet_manager.cc:1403] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.006s
I20260709 13:05:27.092077 15644 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:27.093547 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.094197 15974 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.094985 16041 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.097507 16041 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:27.099643 16041 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.101850 15837 raft_consensus.cc:359] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.104725 15837 raft_consensus.cc:385] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.105823 15837 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.106273 15840 tablet_bootstrap.cc:492] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:27.106735 15840 ts_tablet_manager.cc:1403] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.023s
I20260709 13:05:27.107035 15837 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.109515 15840 raft_consensus.cc:359] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.110061 15837 ts_tablet_manager.cc:1434] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:05:27.110205 15840 raft_consensus.cc:385] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.110571 15840 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.111363 15840 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.114579 15840 ts_tablet_manager.cc:1434] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:27.115520 15840 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:27.111387 15837 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.122601 15837 tablet_bootstrap.cc:654] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.128069 15837 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.128588 15837 ts_tablet_manager.cc:1403] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:05:27.131350 15837 raft_consensus.cc:359] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.132097 15837 raft_consensus.cc:385] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.132404 15837 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.133064 15837 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.135968 15837 ts_tablet_manager.cc:1434] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:27.136436 16164 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.136886 16164 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.139005 16164 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.139966 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:27.140349 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.140558 15644 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:27.141626 15611 leader_election.cc:343] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.129647 15840 tablet_bootstrap.cc:654] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.147866 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:27.149354 15610 leader_election.cc:343] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.149785 15610 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.150470 16164 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.151520 15644 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:27.152642 15688 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:27.153399 16041 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.153882 16041 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:27.154676 16041 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.158322 15840 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:27.158929 15840 ts_tablet_manager.cc:1403] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.005s
I20260709 13:05:27.160108 15837 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.160967 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:27.161582 15789 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.165380 15974 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.167258 15840 raft_consensus.cc:359] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.167981 15840 raft_consensus.cc:385] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.168064 16164 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.168256 15840 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.168567 16164 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.168954 15840 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.171167 15840 ts_tablet_manager.cc:1434] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:05:27.173367 16164 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.173506 15789 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:27.175004 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.175635 15718 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:27.176872 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:27.177037 15840 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:27.178158 15837 tablet_bootstrap.cc:654] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.178462 16175 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.185483 16175 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.183274 15840 tablet_bootstrap.cc:654] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.183169 15544 catalog_manager.cc:5697] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.184012 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:27.185889 16175 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:27.186785 15610 leader_election.cc:343] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.187955 15836 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:27.188400 15836 ts_tablet_manager.cc:1403] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.121s	user 0.031s	sys 0.034s
I20260709 13:05:27.190874 15836 raft_consensus.cc:359] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.191496 15836 raft_consensus.cc:385] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.191766 15836 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.192346 15836 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.196364 15836 ts_tablet_manager.cc:1434] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:27.201072 15836 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:27.200920 16166 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:27.207473 15836 tablet_bootstrap.cc:654] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.208580 16175 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.213268 16175 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.216451 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:27.217270 15718 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.223351 15836 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:27.223994 15836 ts_tablet_manager.cc:1403] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:05:27.226605 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:27.226683 15836 raft_consensus.cc:359] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.227404 15836 raft_consensus.cc:385] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.227716 15836 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.228444 15836 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:27.228777 15610 leader_election.cc:343] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.235402 15836 ts_tablet_manager.cc:1434] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:27.237831 15837 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.238092 15718 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:27.238457 15837 ts_tablet_manager.cc:1403] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 13:05:27.239753 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.241029 16175 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.241375 15836 tablet_bootstrap.cc:492] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:27.241690 16175 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:27.242924 16175 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.242340 15837 raft_consensus.cc:359] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.253597 15837 raft_consensus.cc:385] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.254757 15837 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.255760 15837 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.258082 15836 tablet_bootstrap.cc:654] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.226819 15542 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.260864 15837 ts_tablet_manager.cc:1434] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:05:27.261934 15837 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.269148 16152 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:27.281414 16149 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.282089 16149 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.284772 16149 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.288610 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:27.289994 15685 leader_election.cc:343] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.290411 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.291059 15644 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:27.295344 16164 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.295792 16164 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.297853 15688 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.298864 15974 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.299233 15974 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.297856 16164 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.299307 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.300241 15714 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 0.
I20260709 13:05:27.299605 15974 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.301470 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:27.303099 16166 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.303544 16166 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.303943 16166 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.301545 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:27.307087 15610 leader_election.cc:343] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.318420 15837 tablet_bootstrap.cc:654] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.320961 15840 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:27.318760 15974 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.321408 15840 ts_tablet_manager.cc:1403] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.026s
I20260709 13:05:27.320348 15542 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.325531 16156 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.327124 16156 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.329821 15789 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.330683 16156 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:27.331933 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.336002 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.336791 15644 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:05:27.337715 15762 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:27.338150 16156 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.338738 16156 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.340452 16173 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.319324 16166 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.345157 15840 raft_consensus.cc:359] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.353132 15840 raft_consensus.cc:385] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.353446 15840 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.356003 15840 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.358254 15974 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.357510 16166 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.349457 16169 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:27.354034 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:27.370012 15836 tablet_bootstrap.cc:492] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:27.370537 15836 ts_tablet_manager.cc:1403] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.016s
I20260709 13:05:27.371265 16109 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.372615 15714 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.376678 16109 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.374955 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:27.380260 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.371665 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:27.381466 15836 raft_consensus.cc:359] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.382056 15644 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:27.382575 15685 leader_election.cc:343] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.382323 15836 raft_consensus.cc:385] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.374624 16149 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:27.383216 15836 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.386142 15840 ts_tablet_manager.cc:1434] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:05:27.400655 15840 tablet_bootstrap.cc:492] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:27.404538 16173 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.405830 16156 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:27.413461 16172 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.414009 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:27.414099 16172 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.416531 16172 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.416827 16109 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:27.418548 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.419178 15836 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:27.420223 15611 leader_election.cc:343] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.424659 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:27.426182 15974 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:27.426759 15836 ts_tablet_manager.cc:1434] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:05:27.428719 15836 tablet_bootstrap.cc:492] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:27.430811 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.431593 15721 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:05:27.432140 15644 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:27.433269 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:27.437652 15610 leader_election.cc:343] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:27.439842 15610 leader_election.cc:343] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.440459 15610 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.444240 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.444963 15639 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:27.446197 15762 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:27.448283 16173 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.448799 16173 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.454072 15714 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:05:27.455328 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.455735 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.456511 16173 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:27.460609 15837 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.461242 15837 ts_tablet_manager.cc:1403] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.200s	user 0.057s	sys 0.015s
I20260709 13:05:27.462745 15760 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:27.469653 15836 tablet_bootstrap.cc:654] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.474624 16109 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.468806 16152 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.503602 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.494763 16164 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.511811 16154 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:27.543525 15837 raft_consensus.cc:359] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.544319 15837 raft_consensus.cc:385] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.544605 15837 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.550836 15688 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.545480 15837 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.554252 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:27.553509 15930 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.574376 15930 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:27.575279 15930 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.581873 16109 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.562565 15905 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.601862 15837 ts_tablet_manager.cc:1434] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.001s
I20260709 13:05:27.612584 15840 tablet_bootstrap.cc:654] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:27.608858 15685 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.610683 15791 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:27.656361 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 83304.8us
I20260709 13:05:27.607443 16164 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:27.662945 15837 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.660651 16041 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:27.663748 16224 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:27.662024 16166 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.665969 16166 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.667927 16166 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.668471 16164 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.670017 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:27.671082 15611 leader_election.cc:343] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.610224 16154 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:05:27.681317 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:27.677577 16154 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:27.689054 16041 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:27.692421 15610 leader_election.cc:343] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.692860 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.695096 16165 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.702304 15836 tablet_bootstrap.cc:492] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:27.702886 15836 ts_tablet_manager.cc:1403] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.274s	user 0.014s	sys 0.009s
I20260709 13:05:27.689232 15542 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.742455 15836 raft_consensus.cc:359] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.743439 15836 raft_consensus.cc:385] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.743801 15836 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.752743 15837 tablet_bootstrap.cc:654] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.762567 15974 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:27.744552 15836 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.783790 15836 ts_tablet_manager.cc:1434] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.004s
I20260709 13:05:27.789273 16154 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.791746 16154 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:27.785010 16152 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.792471 15788 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:27.792512 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:27.794582 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:27.796573 15760 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:27.784631 15544 catalog_manager.cc:5697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 0 to 1, leader changed from <none> to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.798272 16154 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:27.798259 16041 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:05:27.813557 16041 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:27.813953 16041 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:27.814754 16041 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.815955 16041 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:27.792516 16152 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.822657 15837 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.823544 15837 ts_tablet_manager.cc:1403] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.163s	user 0.007s	sys 0.014s
I20260709 13:05:27.829255 16175 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:27.829682 16152 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.834081 15837 raft_consensus.cc:359] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.834844 15837 raft_consensus.cc:385] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.835108 15837 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.836084 15837 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.844897 15837 ts_tablet_manager.cc:1434] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:27.844285 15836 tablet_bootstrap.cc:492] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:27.846194 15837 tablet_bootstrap.cc:492] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.851809 15840 tablet_bootstrap.cc:492] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:27.855957 15840 ts_tablet_manager.cc:1403] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.460s	user 0.016s	sys 0.020s
I20260709 13:05:27.855718 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:27.859535 15840 raft_consensus.cc:359] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.860244 15840 raft_consensus.cc:385] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.860502 15840 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.863963 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.861115 15840 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:27.866393 15611 leader_election.cc:343] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.867435 15840 ts_tablet_manager.cc:1434] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:27.869841 15837 tablet_bootstrap.cc:654] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.871239 15836 tablet_bootstrap.cc:654] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.872912 16175 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:27.870625 15610 leader_election.cc:343] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.873785 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:27.874498 16146 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.887856 16169 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.888788 15840 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:27.888338 16169 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.932837 16169 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:27.949127 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.949882 15643 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:27.921872 15836 tablet_bootstrap.cc:492] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:27.951078 15836 ts_tablet_manager.cc:1403] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.001s
I20260709 13:05:27.951696 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:27.954243 15836 raft_consensus.cc:359] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.955243 15836 raft_consensus.cc:385] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.955585 15836 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
W20260709 13:05:27.959823 15685 leader_election.cc:343] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.963037 15840 tablet_bootstrap.cc:654] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.963536 16156 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.964164 16156 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.970094 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:27.972450 15837 tablet_bootstrap.cc:492] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:27.972944 15837 ts_tablet_manager.cc:1403] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.127s	user 0.034s	sys 0.059s
I20260709 13:05:27.978013 15840 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:27.978511 15840 ts_tablet_manager.cc:1403] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.001s
I20260709 13:05:27.977406 15837 raft_consensus.cc:359] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.980736 15837 raft_consensus.cc:385] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.981046 15837 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.981913 15837 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.984122 15837 ts_tablet_manager.cc:1434] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:05:27.985123 15837 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:27.987337 16156 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:27.988327 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:27.988457 15789 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.989879 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:27.991400 15840 raft_consensus.cc:359] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.992105 15840 raft_consensus.cc:385] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.992383 15840 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.993073 15840 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:27.995229 15840 ts_tablet_manager.cc:1434] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 13:05:27.996819 15840 tablet_bootstrap.cc:492] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:27.997109 15837 tablet_bootstrap.cc:654] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.008623 15840 tablet_bootstrap.cc:654] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:28.009415 15593 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:28.012387 15837 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:28.012897 15837 ts_tablet_manager.cc:1403] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.000s
I20260709 13:05:28.016652 15837 raft_consensus.cc:359] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.017398 15837 raft_consensus.cc:385] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.017578 15688 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:28.017673 15837 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.018534 15837 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.019920 16149 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.020301 16149 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.020133 15836 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.020655 16149 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.022441 15836 ts_tablet_manager.cc:1434] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:05:28.023360 15836 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:28.037446 15836 tablet_bootstrap.cc:654] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.041533 16149 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.045331 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:28.047784 15646 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.048588 15837 ts_tablet_manager.cc:1434] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.035s	user 0.000s	sys 0.008s
I20260709 13:05:28.055006 15837 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:28.058104 15836 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:28.058796 15836 ts_tablet_manager.cc:1403] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.008s
I20260709 13:05:28.060560 16149 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.062686 15836 raft_consensus.cc:359] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.063671 15836 raft_consensus.cc:385] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.063982 15836 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.065059 15836 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.067353 15840 tablet_bootstrap.cc:492] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.068153 15840 ts_tablet_manager.cc:1403] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.023s
I20260709 13:05:28.068351 15646 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.067353 15836 ts_tablet_manager.cc:1434] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:28.070672 15688 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.071478 15836 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: Bootstrap starting.
I20260709 13:05:28.071688 16149 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.072865 16149 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:28.073691 16149 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.076566 15837 tablet_bootstrap.cc:654] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.075052 15840 raft_consensus.cc:359] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.077169 15840 raft_consensus.cc:385] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.077530 15840 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.083011 15836 tablet_bootstrap.cc:654] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.084488 16224 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.084995 16224 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.087397 16224 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.087421 16041 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.088060 16041 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.088778 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.089433 15639 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:28.090013 16041 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.091289 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.091979 15643 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:28.090776 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.093302 16220 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.093441 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.093667 16220 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.094406 16041 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.094128 15840 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.094760 16041 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.095098 16041 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.095731 15840 ts_tablet_manager.cc:1434] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 13:05:28.096797 15840 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.094071 16220 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.098642 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:28.099292 15791 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.106079 15791 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.109215 16220 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.114980 16041 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.118680 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:28.118566 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:28.120080 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:05:28.124950 15685 leader_election.cc:343] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:28.125849 15685 leader_election.cc:343] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.131032 16041 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.131297 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:28.131948 15639 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.133163 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:28.133450 15837 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:28.120680 16220 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.134634 15837 ts_tablet_manager.cc:1403] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.010s
I20260709 13:05:28.123833 15646 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.137382 15837 raft_consensus.cc:359] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.138043 15837 raft_consensus.cc:385] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.133333 15543 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.138330 15837 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.139926 15837 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.142436 15837 ts_tablet_manager.cc:1434] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:28.143484 15837 tablet_bootstrap.cc:492] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
W20260709 13:05:28.143769 15685 leader_election.cc:343] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.144733 16220 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.145206 16220 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.146526 15639 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
W20260709 13:05:28.146754 15685 consensus_peers.cc:597] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.147874 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.148895 16041 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.149498 16041 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:28.149658 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:05:28.156481 15685 leader_election.cc:343] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.150713 16041 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.167095 16165 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.167661 16165 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.169225 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.171046 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:28.172422 15611 leader_election.cc:343] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.172636 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:28.169632 16165 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.170120 15639 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
W20260709 13:05:28.174860 15610 leader_election.cc:343] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.175797 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:28.176177 16220 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.176654 16228 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:28.176779 15840 tablet_bootstrap.cc:654] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.178812 16156 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:28.181494 15836 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: No bootstrap required, opened a new log
I20260709 13:05:28.181993 15836 ts_tablet_manager.cc:1403] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.031s
I20260709 13:05:28.182835 15646 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.178273 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.185299 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:28.187392 16220 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.188474 16169 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.189005 16169 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:28.189852 16169 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.189770 15836 raft_consensus.cc:359] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.190632 15836 raft_consensus.cc:385] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.190904 15836 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.191404 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:28.191529 15836 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:28.193089 15685 leader_election.cc:343] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.195281 15836 ts_tablet_manager.cc:1434] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:28.193821 16220 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.198149 16220 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.209990 16041 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:28.235571 15544 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.237830 16220 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.237222 15544 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.242256 15837 tablet_bootstrap.cc:654] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.242516 16165 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.243458 15840 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.253859 15840 ts_tablet_manager.cc:1403] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.157s	user 0.021s	sys 0.008s
I20260709 13:05:28.244207 16220 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.245215 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:28.246706 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:28.257272 15643 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.260062 15840 raft_consensus.cc:359] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.261035 15840 raft_consensus.cc:385] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.261343 15840 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.262120 15840 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:28.274633 15685 leader_election.cc:343] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.275592 15837 tablet_bootstrap.cc:492] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:28.276163 15837 ts_tablet_manager.cc:1403] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.133s	user 0.014s	sys 0.016s
I20260709 13:05:28.277706 15840 ts_tablet_manager.cc:1434] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:05:28.278928 15840 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.278864 15837 raft_consensus.cc:359] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.279652 15837 raft_consensus.cc:385] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.279986 15837 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.280697 15837 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.282649 15837 ts_tablet_manager.cc:1434] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:28.283519 15837 tablet_bootstrap.cc:492] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Bootstrap starting.
I20260709 13:05:28.286108 16041 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.286259 15840 tablet_bootstrap.cc:654] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.286590 16041 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.288609 16041 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.290228 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.290829 15644 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:28.292181 15688 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.293709 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:05:28.295130 15685 leader_election.cc:343] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.296432 16220 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.298156 15789 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.296906 16220 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.307456 15643 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.310593 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:28.312611 16041 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.313295 16041 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:28.314047 16041 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.298698 16220 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.320856 16165 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.337091 15840 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.337601 15840 ts_tablet_manager.cc:1403] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.025s
I20260709 13:05:28.340417 15840 raft_consensus.cc:359] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.341064 15840 raft_consensus.cc:385] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.341312 15837 tablet_bootstrap.cc:654] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.341367 15840 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.343485 15840 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.345518 15840 ts_tablet_manager.cc:1434] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:05:28.346442 15840 tablet_bootstrap.cc:492] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.349344 16220 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.366719 15840 tablet_bootstrap.cc:654] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.368844 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:28.370625 15646 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.371093 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:28.371690 15789 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.374982 15542 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.379639 15789 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.381263 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:28.382093 16041 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.382519 16041 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:28.383261 16041 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.369619 16220 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.391245 15646 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.397992 15840 tablet_bootstrap.cc:492] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.398626 15840 ts_tablet_manager.cc:1403] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.022s
I20260709 13:05:28.401281 15840 raft_consensus.cc:359] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.402014 15840 raft_consensus.cc:385] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.402274 15840 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.402984 15840 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.404455 15840 ts_tablet_manager.cc:1434] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:28.405323 15837 tablet_bootstrap.cc:492] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: No bootstrap required, opened a new log
I20260709 13:05:28.405797 15837 ts_tablet_manager.cc:1403] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.006s
I20260709 13:05:28.408478 15837 raft_consensus.cc:359] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.409063 15840 tablet_bootstrap.cc:492] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.409125 15837 raft_consensus.cc:385] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.409554 15837 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.408284 15543 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.410288 15837 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.414552 15837 ts_tablet_manager.cc:1434] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:28.417511 15840 tablet_bootstrap.cc:654] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.430975 16156 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.431718 16156 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.435225 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.438625 16156 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:28.446327 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:28.447650 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:28.448556 16156 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:28.450410 15840 tablet_bootstrap.cc:492] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.450878 15840 ts_tablet_manager.cc:1403] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.013s
I20260709 13:05:28.453097 15840 raft_consensus.cc:359] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.453588 15840 raft_consensus.cc:385] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.453886 15840 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.454384 15840 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.456112 15840 ts_tablet_manager.cc:1434] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:28.457479 15840 tablet_bootstrap.cc:492] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.458035 16156 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.458531 16156 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.463088 15840 tablet_bootstrap.cc:654] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.464644 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.465463 15639 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:28.467272 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:28.470610 16154 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.471025 16154 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.471393 16154 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.472720 15840 tablet_bootstrap.cc:492] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.473626 15840 ts_tablet_manager.cc:1403] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:05:28.474905 16156 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:28.475901 15840 raft_consensus.cc:359] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.478670 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:28.479143 15840 raft_consensus.cc:385] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.479461 15721 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 0.
I20260709 13:05:28.479461 15840 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.481343 15840 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.481535 16154 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.483469 15840 ts_tablet_manager.cc:1434] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:05:28.485122 15840 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.485487 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:28.486063 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:28.486634 15721 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.491070 15840 tablet_bootstrap.cc:654] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.486143 15646 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.493036 15721 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:28.494230 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:28.495146 15949 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.495471 16154 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:28.495621 15949 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:28.496564 15949 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.499006 15840 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.498924 15646 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:05:28.499560 15840 ts_tablet_manager.cc:1403] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:05:28.503036 15840 raft_consensus.cc:359] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.503953 15840 raft_consensus.cc:385] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.504292 15840 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.505066 15840 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.507597 15840 ts_tablet_manager.cc:1434] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:28.508448 15840 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Bootstrap starting.
I20260709 13:05:28.512967 15840 tablet_bootstrap.cc:654] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.515384 15543 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:28.518599 15840 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: No bootstrap required, opened a new log
I20260709 13:05:28.519060 15840 ts_tablet_manager.cc:1403] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:05:28.521545 15840 raft_consensus.cc:359] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.522228 15840 raft_consensus.cc:385] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.522493 15840 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.523113 15840 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.525024 15840 ts_tablet_manager.cc:1434] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:28.581549 16041 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.590902 15793 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.600188 15974 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.609550 16220 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.622236 16041 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.714916 16266 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.715332 16266 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.716907 16266 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:28.717593 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.717828 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:28.718434 15646 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 1: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:05:28.719317 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:05:28.719944 16266 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.725231 15793 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.726321 16266 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:28.741000 15974 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.759109 15974 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.759588 15974 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.761601 15974 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.762743 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:28.763273 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:28.763918 15791 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:28.764248 15974 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.764348 15639 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 0.
I20260709 13:05:28.765133 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:28.765966 16041 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.766283 16041 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.766618 16041 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.774158 16041 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.778394 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:28.778963 15793 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.779606 16041 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:28.785496 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:28.786193 15639 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.786255 15793 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.787248 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:28.787817 16041 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.788168 16041 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:28.788911 16041 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:28.792799 15639 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:05:28.806687 15789 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.808557 15543 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.819231 15974 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.821122 15974 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.836416 16220 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:28.850222 16041 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.026644 15949 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:29.031024 16266 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:29.207137 16166 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:05:29.207971 16166 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:29.211187 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:05:29.211390 16166 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:29.211798 15721 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:05:29.212548 15974 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:29.212909 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:29.214775 16166 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.213619 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:29.215306 16166 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:05:29.215725 15793 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 2: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:05:29.215730 16166 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.224148 16166 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:29.227321 16166 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:29.227824 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:29.227977 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:29.228564 15793 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 2: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:05:29.237478 16169 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.258114 15715 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:05:29.261240 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:29.262975 16228 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:29.267575 16228 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:29.268386 16228 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:29.291216 15544 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 2 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.402483 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:29.428092 16288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:29.428082 16291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:29.430130 16289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:29.430855 14516 server_base.cc:1061] running on GCE node
I20260709 13:05:29.432570 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:29.432850 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:29.433104 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602329433078 us; error 0 us; skew 500 ppm
I20260709 13:05:29.433728 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:29.437217 14516 webserver.cc:533] Webserver started at http://127.14.45.4:40263/ using document root <none> and password file <none>
I20260709 13:05:29.437888 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:29.438153 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:29.438509 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:29.439765 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-3-root/instance:
uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
format_stamp: "Formatted at 2026-07-09 13:05:29 on dist-test-slave-lfdf"
I20260709 13:05:29.444823 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:05:29.448611 16296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:29.449914 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:05:29.450330 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-3-root
uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
format_stamp: "Formatted at 2026-07-09 13:05:29 on dist-test-slave-lfdf"
I20260709 13:05:29.450712 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:29.479095 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:29.480436 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:29.482115 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:29.485069 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:29.485327 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:29.485633 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:29.485891 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:29.558264 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.4:41485
I20260709 13:05:29.558382 16358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.4:41485 every 8 connection(s)
I20260709 13:05:29.563925 14516 auto_leader_rebalancer-test.cc:384] add a tserver: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:29.588133 16359 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37417
I20260709 13:05:29.588744 16359 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:29.589761 16359 heartbeater.cc:507] Master 127.14.45.62:37417 requested a full tablet report, sending...
I20260709 13:05:29.591907 15544 ts_manager.cc:194] Registered new tserver with Master: 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:05:29.593463 15544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50524
I20260709 13:05:29.689668 15718 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:29.690956 16228 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:29.708900 15793 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:29.710460 16228 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.218709 15718 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:30.230041 15646 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.231206 15789 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.232982 16220 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:30.240837 15685 consensus_peers.cc:597] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95d881615f17486b87fb31ab586c91fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.240842 16220 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:30.243748 16220 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.245824 15789 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.264032 15542 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.280570 15646 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.294482 15646 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:30.303885 15718 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.305305 16175 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.308679 15789 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.310742 16175 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:30.319932 15610 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 260cdec1e9ff4f2e92f7db3917710d4c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.322422 16228 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.324354 15789 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.330410 15715 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.342661 15543 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.376724 15789 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:30.384696 15715 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.384971 15646 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.386296 16367 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.387468 16284 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.396240 16367 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
W20260709 13:05:30.398767 15759 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 493304a609d247829052517242c00e96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.398036 15715 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.404717 15639 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.415343 15791 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:30.427284 15718 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.429248 16284 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:30.431334 15759 consensus_peers.cc:597] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 931130cafbad4fe6ad371c4a32da2678. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.428758 15543 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.448570 15639 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.454070 16284 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.464650 15949 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.470443 15646 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.473789 15718 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.488019 15544 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:30.596278 16359 heartbeater.cc:499] Master 127.14.45.62:37417 was elected leader, sending a full tablet report...
I20260709 13:05:30.915210 16393 ts_tablet_manager.cc:933] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:30.927876 16394 ts_tablet_manager.cc:933] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:30.930365 16393 tablet_copy_client.cc:323] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:05:30.946482 16394 tablet_copy_client.cc:323] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
W20260709 13:05:30.951247 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 269130us
I20260709 13:05:30.961032 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 493304a609d247829052517242c00e96 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:30.961788 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 493304a609d247829052517242c00e96 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-493304a609d247829052517242c00e96
I20260709 13:05:30.968214 15805 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 931130cafbad4fe6ad371c4a32da2678 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:30.969105 15805 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 931130cafbad4fe6ad371c4a32da2678 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-931130cafbad4fe6ad371c4a32da2678
I20260709 13:05:31.171823 16402 ts_tablet_manager.cc:933] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:31.238318 16402 tablet_copy_client.cc:323] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:31.276710 15805 tablet_copy_source_session.cc:215] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.334575 16394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931130cafbad4fe6ad371c4a32da2678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.352860 15732 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet 95d881615f17486b87fb31ab586c91fd from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:31.353416 15732 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet 95d881615f17486b87fb31ab586c91fd from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-95d881615f17486b87fb31ab586c91fd
I20260709 13:05:31.360471 15732 tablet_copy_source_session.cc:215] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.361434 16394 tablet_copy_client.cc:806] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:31.362295 16394 tablet_copy_client.cc:670] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:31.368523 16402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d881615f17486b87fb31ab586c91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.397459 16394 tablet_copy_client.cc:538] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:31.404821 16414 ts_tablet_manager.cc:933] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:31.405242 15806 tablet_copy_source_session.cc:215] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.414386 16393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493304a609d247829052517242c00e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.421249 16394 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:31.431473 16402 tablet_copy_client.cc:806] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:31.432096 16402 tablet_copy_client.cc:670] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:31.441975 16414 tablet_copy_client.cc:323] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:31.449566 16402 tablet_copy_client.cc:538] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:31.476238 16394 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:31.476908 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet 260cdec1e9ff4f2e92f7db3917710d4c from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:31.477555 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet 260cdec1e9ff4f2e92f7db3917710d4c from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-260cdec1e9ff4f2e92f7db3917710d4c
I20260709 13:05:31.483584 16393 tablet_copy_client.cc:806] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:31.485081 16393 tablet_copy_client.cc:670] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:31.485556 16394 tablet_bootstrap.cc:492] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:31.487532 16394 ts_tablet_manager.cc:1403] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.016s
I20260709 13:05:31.492164 16393 tablet_copy_client.cc:538] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:31.492789 16402 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:31.502058 16394 raft_consensus.cc:359] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.503115 16394 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:31.503857 16394 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.542863 15657 tablet_copy_source_session.cc:215] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.549804 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260cdec1e9ff4f2e92f7db3917710d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.590922 16394 ts_tablet_manager.cc:1434] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.103s	user 0.015s	sys 0.003s
I20260709 13:05:31.595634 16393 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:31.610539 16414 tablet_copy_client.cc:806] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:31.611140 16414 tablet_copy_client.cc:670] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:31.614264 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-931130cafbad4fe6ad371c4a32da2678 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:31.614812 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-931130cafbad4fe6ad371c4a32da2678 on tablet 931130cafbad4fe6ad371c4a32da2678 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:31.639196 16414 tablet_copy_client.cc:538] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:31.656576 16414 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:31.659418 16402 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:31.660403 16402 tablet_bootstrap.cc:492] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:31.661401 16402 ts_tablet_manager.cc:1403] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.015s
I20260709 13:05:31.663606 16393 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:31.664547 16393 tablet_bootstrap.cc:492] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:31.665244 16393 ts_tablet_manager.cc:1403] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.014s
I20260709 13:05:31.665692 16402 raft_consensus.cc:359] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.666708 16402 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:31.668403 16393 raft_consensus.cc:359] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.669759 16393 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:31.670464 16393 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.667428 16402 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.674278 16393 ts_tablet_manager.cc:1434] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:31.674933 16402 ts_tablet_manager.cc:1434] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:31.678834 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-493304a609d247829052517242c00e96 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:31.679158 15732 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-95d881615f17486b87fb31ab586c91fd received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:31.679291 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-493304a609d247829052517242c00e96 on tablet 493304a609d247829052517242c00e96 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:31.681921 15732 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-95d881615f17486b87fb31ab586c91fd on tablet 95d881615f17486b87fb31ab586c91fd with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:31.706199 16414 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:31.707347 16414 tablet_bootstrap.cc:492] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:31.708218 16414 ts_tablet_manager.cc:1403] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.007s
I20260709 13:05:31.712934 16414 raft_consensus.cc:359] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.717885 16414 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:31.718740 16414 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:31.721983 16414 ts_tablet_manager.cc:1434] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:31.733196 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-260cdec1e9ff4f2e92f7db3917710d4c received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:31.733671 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-260cdec1e9ff4f2e92f7db3917710d4c on tablet 260cdec1e9ff4f2e92f7db3917710d4c with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:31.836440 16334 raft_consensus.cc:1217] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:31.836381 16333 raft_consensus.cc:1217] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:31.894209 16333 raft_consensus.cc:1217] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:32.047575 16333 raft_consensus.cc:1217] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:05:32.175570 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5c20 after lost signal to thread 14519
W20260709 13:05:32.176755 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800201980 after lost signal to thread 15579
W20260709 13:05:32.179054 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08002b72a0 after lost signal to thread 15820
W20260709 13:05:32.179965 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08001be020 after lost signal to thread 16358
I20260709 13:05:32.272961 16382 raft_consensus.cc:1064] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:32.276134 16382 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.294546 15722 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.295236 16333 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.296180 16410 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.298399 16422 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.306473 15788 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.318833 16367 raft_consensus.cc:1064] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:32.321396 16367 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.320895 16410 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:05:32.345273 16334 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.347064 16284 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.355158 16410 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.363210 15722 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.366899 16388 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.387722 15719 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.390882 16333 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.412145 15543 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.425419 15788 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.436622 16429 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.438758 16428 raft_consensus.cc:1064] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:32.446101 16428 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.450389 15643 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.452064 16367 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.456297 16334 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.462414 15722 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.466138 15643 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.489580 15545 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.510381 15646 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.511554 15722 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.512286 16334 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.512876 16284 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.513890 16429 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.516525 16428 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.548113 15643 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.551990 16284 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.555855 16332 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.569638 15722 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.567312 15646 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.594663 15545 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.623644 15788 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.627079 16332 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.627933 15722 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.630405 16410 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:32.631317 16422 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:32.636088 16401 raft_consensus.cc:1064] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:32.641940 16401 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.642464 16422 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.643594 15722 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.700629 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 260cdec1e9ff4f2e92f7db3917710d4c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:32.719903 16332 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.782330 15643 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.839633 16444 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.841339 16332 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.865602 16429 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:05:32.891263 15788 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.893765 15716 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:05:32.875212 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 125862us
I20260709 13:05:32.905979 15795 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:32.914438 16284 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.923197 16449 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:05:32.924412 16332 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:32.929512 16334 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.931879 16367 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:32.935978 16388 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:05:32.956467 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 115149us
I20260709 13:05:33.028267 15542 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:33.030532 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 51037.9us
I20260709 13:05:33.050889 15639 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.062294 16334 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.069667 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 931130cafbad4fe6ad371c4a32da2678 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.046804 16429 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.088994 16449 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:33.094281 16332 raft_consensus.cc:2955] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:33.145888 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 105155us
I20260709 13:05:33.148206 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet 260cdec1e9ff4f2e92f7db3917710d4c with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:33.182600 16458 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:05:33.191299 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 173778us
I20260709 13:05:33.207569 15540 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.257788 15722 raft_consensus.cc:2955] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.277110 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet 931130cafbad4fe6ad371c4a32da2678 with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:33.298342 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 493304a609d247829052517242c00e96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.303476 15540 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.309801 15639 raft_consensus.cc:2955] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.369856 16465 tablet_replica.cc:333] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:33.370939 16465 raft_consensus.cc:2243] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.355486 16451 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.384390 16463 tablet_replica.cc:333] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:33.385860 16463 raft_consensus.cc:2243] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.386658 16463 raft_consensus.cc:2272] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.394518 15790 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.416812 16463 ts_tablet_manager.cc:1916] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.432286 16333 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.442358 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet 493304a609d247829052517242c00e96 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
W20260709 13:05:33.445986 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 64403.3us
I20260709 13:05:33.455072 16465 raft_consensus.cc:2272] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:33.425864 16464 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
I20260709 13:05:33.467829 16465 ts_tablet_manager.cc:1916] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.499094 16467 tablet_replica.cc:333] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:33.508765 15639 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.512207 15541 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.536295 15722 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:33.557706 16333 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.566592 16444 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.578478 15788 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.589423 16449 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.603885 16465 ts_tablet_manager.cc:1929] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.605657 16467 raft_consensus.cc:2243] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.605849 16463 ts_tablet_manager.cc:1929] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.606453 16465 log.cc:1199] T 931130cafbad4fe6ad371c4a32da2678 P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/931130cafbad4fe6ad371c4a32da2678
I20260709 13:05:33.610286 16467 raft_consensus.cc:2272] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.610608 16169 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.613468 16467 ts_tablet_manager.cc:1916] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.606451 16463 log.cc:1199] T 260cdec1e9ff4f2e92f7db3917710d4c P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/260cdec1e9ff4f2e92f7db3917710d4c
I20260709 13:05:33.618024 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet 260cdec1e9ff4f2e92f7db3917710d4c (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:33.628798 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet 931130cafbad4fe6ad371c4a32da2678 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:33.631323 16333 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.646588 15790 raft_consensus.cc:2955] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.647419 15541 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:33.649652 16467 ts_tablet_manager.cc:1929] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.658023 16467 log.cc:1199] T 493304a609d247829052517242c00e96 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/493304a609d247829052517242c00e96
I20260709 13:05:33.663152 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet 95d881615f17486b87fb31ab586c91fd with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:33.666872 16465 tablet_replica.cc:333] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:33.683416 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet 493304a609d247829052517242c00e96 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:33.737007 16465 raft_consensus.cc:2243] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.737972 16465 raft_consensus.cc:2272] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.744416 16465 ts_tablet_manager.cc:1916] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.753466 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95d881615f17486b87fb31ab586c91fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.772940 16465 ts_tablet_manager.cc:1929] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.773526 16465 log.cc:1199] T 95d881615f17486b87fb31ab586c91fd P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/95d881615f17486b87fb31ab586c91fd
I20260709 13:05:33.775357 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet 95d881615f17486b87fb31ab586c91fd (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:34.839743 15788 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:34.850108 15722 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:34.850229 15759 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d5a8a31a7e747c69abd21e5dbc2c1d9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.850584 15641 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.851703 16429 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.852977 16284 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.871124 15646 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:34.869586 16429 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:34.887748 15722 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:34.900457 15641 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:34.913121 15541 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
W20260709 13:05:34.930680 15610 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 000b7a022df94c229b7580329401d5f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.931800 15788 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.933538 16422 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.936205 15717 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.939160 16422 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.968022 16410 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:34.971434 15790 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.047995 15722 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.059826 15540 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.070384 15714 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
W20260709 13:05:35.116113 15685 consensus_peers.cc:597] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d084942b6c014c78b9a4ece4089fb430. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.117897 15790 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.119460 16449 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.126477 15641 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.127979 16483 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.132928 16449 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.134972 15790 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.140569 15646 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.156931 15540 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.160763 15790 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.181555 15722 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.183338 16470 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.185652 15641 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:35.186000 15759 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d1d6e542161416d9033cefcbd0c06e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.188099 16470 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.196313 16429 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.197500 15722 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.218639 15646 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.229336 15542 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:35.284461 16489 ts_tablet_manager.cc:933] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:35.286546 16489 tablet_copy_client.cc:323] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:05:35.288902 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:35.289462 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-7d5a8a31a7e747c69abd21e5dbc2c1d9
I20260709 13:05:35.297326 15806 tablet_copy_source_session.cc:215] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.302651 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.324880 16489 tablet_copy_client.cc:806] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.325601 16489 tablet_copy_client.cc:670] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.329924 16489 tablet_copy_client.cc:538] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.338764 16489 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:35.359778 16489 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.360818 16489 tablet_bootstrap.cc:492] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:35.361577 16489 ts_tablet_manager.cc:1403] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:05:35.364971 16489 raft_consensus.cc:359] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.365873 16489 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:35.366622 16489 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.387100 16489 ts_tablet_manager.cc:1434] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 13:05:35.389063 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-7d5a8a31a7e747c69abd21e5dbc2c1d9 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:35.389544 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-7d5a8a31a7e747c69abd21e5dbc2c1d9 on tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:35.431138 16489 ts_tablet_manager.cc:933] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:35.434724 16489 tablet_copy_client.cc:323] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:35.436818 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet 000b7a022df94c229b7580329401d5f2 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:35.437470 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet 000b7a022df94c229b7580329401d5f2 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-000b7a022df94c229b7580329401d5f2
I20260709 13:05:35.447072 15657 tablet_copy_source_session.cc:215] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.451735 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000b7a022df94c229b7580329401d5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.470412 16489 tablet_copy_client.cc:806] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.471081 16489 tablet_copy_client.cc:670] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.476653 16489 tablet_copy_client.cc:538] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.486414 16489 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:35.587182 16496 ts_tablet_manager.cc:933] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:35.604854 16496 tablet_copy_client.cc:323] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:05:35.606603 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 8d1d6e542161416d9033cefcbd0c06e3 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:35.607152 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 8d1d6e542161416d9033cefcbd0c06e3 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-8d1d6e542161416d9033cefcbd0c06e3
I20260709 13:05:35.626410 15806 tablet_copy_source_session.cc:215] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.630903 16496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1d6e542161416d9033cefcbd0c06e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.671406 16496 tablet_copy_client.cc:806] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.672196 16496 tablet_copy_client.cc:670] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.678249 16496 tablet_copy_client.cc:538] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.698933 16496 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:35.762276 16496 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.763206 16496 tablet_bootstrap.cc:492] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:35.763943 16496 ts_tablet_manager.cc:1403] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.005s
I20260709 13:05:35.783564 16489 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.784693 16489 tablet_bootstrap.cc:492] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:35.788056 16489 ts_tablet_manager.cc:1403] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.301s	user 0.072s	sys 0.079s
I20260709 13:05:35.791975 16495 ts_tablet_manager.cc:933] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:35.807360 16489 raft_consensus.cc:359] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.807866 16495 tablet_copy_client.cc:323] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:35.806440 16496 raft_consensus.cc:359] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.811266 16496 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:35.812526 16496 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.811767 16489 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:35.814666 16489 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:35.822170 16496 ts_tablet_manager.cc:1434] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.003s
I20260709 13:05:35.823540 15732 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet d084942b6c014c78b9a4ece4089fb430 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:35.826200 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-8d1d6e542161416d9033cefcbd0c06e3 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:35.826433 15732 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet d084942b6c014c78b9a4ece4089fb430 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-d084942b6c014c78b9a4ece4089fb430
I20260709 13:05:35.826714 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-8d1d6e542161416d9033cefcbd0c06e3 on tablet 8d1d6e542161416d9033cefcbd0c06e3 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:35.828383 16489 ts_tablet_manager.cc:1434] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.005s
I20260709 13:05:35.831900 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-000b7a022df94c229b7580329401d5f2 received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:35.832396 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-000b7a022df94c229b7580329401d5f2 on tablet 000b7a022df94c229b7580329401d5f2 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:35.846146 16333 raft_consensus.cc:1217] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:05:35.846980 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48284.4us
I20260709 13:05:35.865658 15732 tablet_copy_source_session.cc:215] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.868871 16495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084942b6c014c78b9a4ece4089fb430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.900826 16495 tablet_copy_client.cc:806] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.902222 16495 tablet_copy_client.cc:670] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.929731 16495 tablet_copy_client.cc:538] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.959209 16495 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:36.115005 16495 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:36.116014 16495 tablet_bootstrap.cc:492] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:36.120783 16333 raft_consensus.cc:1217] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:36.131166 16495 ts_tablet_manager.cc:1403] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.010s
I20260709 13:05:36.134994 16495 raft_consensus.cc:359] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:36.137292 16495 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:36.139832 16495 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:36.150427 16495 ts_tablet_manager.cc:1434] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:05:36.215003 16333 raft_consensus.cc:1217] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:36.223428 15732 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-d084942b6c014c78b9a4ece4089fb430 received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:36.223944 15732 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-d084942b6c014c78b9a4ece4089fb430 on tablet d084942b6c014c78b9a4ece4089fb430 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:36.227488 16332 raft_consensus.cc:1217] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:36.314910 16473 raft_consensus.cc:1064] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:36.322098 16473 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:36.344363 16332 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.346203 16510 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.347258 15641 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.350345 16429 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.354285 15714 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.355765 16510 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.383180 16510 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.385293 15714 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.403702 15542 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.425843 16333 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.457993 15644 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.519300 15789 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:36.527709 16333 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.529409 16473 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.541553 16505 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.543370 15644 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.545167 16470 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.549609 15644 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.554880 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.554020 16333 raft_consensus.cc:2955] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.577651 15540 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.597167 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:36.616783 16519 tablet_replica.cc:333] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:36.617900 16519 raft_consensus.cc:2243] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.618737 16519 raft_consensus.cc:2272] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.623286 16519 ts_tablet_manager.cc:1916] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:36.628798 16422 raft_consensus.cc:1064] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:36.631098 16422 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:36.648700 16333 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.649485 15789 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.652423 16422 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.655573 16507 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.658377 15714 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.659931 16410 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.682282 16519 ts_tablet_manager.cc:1929] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:36.687628 16410 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.689335 15714 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.703433 16519 log.cc:1199] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/7d5a8a31a7e747c69abd21e5dbc2c1d9
I20260709 13:05:36.704492 16468 raft_consensus.cc:1064] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:36.705108 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet 7d5a8a31a7e747c69abd21e5dbc2c1d9 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:36.707082 16468 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:36.712591 15789 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.714236 15540 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.735425 16505 raft_consensus.cc:1064] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:36.720168 16332 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.742631 16505 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:36.754597 15791 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.755878 15644 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.756047 16502 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.757392 16333 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.759866 16502 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.759938 15644 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:36.771374 16468 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.781040 15714 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.781728 16333 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.784473 16457 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.787050 16457 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.801936 16333 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.803637 16429 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.807616 15714 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.810765 15716 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.810777 15644 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.812659 16508 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.818217 16501 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.816597 16505 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:36.819953 15791 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.826525 16332 raft_consensus.cc:2955] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.827210 15639 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.828157 16505 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.907409 15541 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.936100 15716 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.911381 15540 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.916672 16332 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.929949 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 000b7a022df94c229b7580329401d5f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.931802 16504 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.935141 15639 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.958833 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet 000b7a022df94c229b7580329401d5f2 with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:36.983126 15540 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:36.992398 16534 tablet_replica.cc:333] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:36.993846 16534 raft_consensus.cc:2243] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.994655 16534 raft_consensus.cc:2272] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.998812 16534 ts_tablet_manager.cc:1916] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:05:37.008245 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08000910a0 after lost signal to thread 14519
W20260709 13:05:37.009303 15576 debug-util.cc:398] Leaking SignalData structure 0x7b0800091780 after lost signal to thread 15579
W20260709 13:05:37.010485 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2e20 after lost signal to thread 15671
W20260709 13:05:37.011571 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08000fde80 after lost signal to thread 15746
I20260709 13:05:37.012056 16332 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:37.014513 15576 debug-util.cc:398] Leaking SignalData structure 0x7b0800217b80 after lost signal to thread 15820
I20260709 13:05:37.021636 15716 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:05:37.027438 15576 debug-util.cc:398] Leaking SignalData structure 0x7b0800239140 after lost signal to thread 16358
I20260709 13:05:37.040053 16333 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.041926 16483 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.044462 15789 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.046195 16502 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.047185 15789 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:37.052058 16483 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.054402 16534 ts_tablet_manager.cc:1929] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.054931 16534 log.cc:1199] T 000b7a022df94c229b7580329401d5f2 P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/000b7a022df94c229b7580329401d5f2
I20260709 13:05:37.056640 15639 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.060526 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet 000b7a022df94c229b7580329401d5f2 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:37.062381 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d084942b6c014c78b9a4ece4089fb430 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:37.065435 16470 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.074338 16333 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.076557 16473 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.078665 15639 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.082585 16470 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:37.082377 15789 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.088013 16333 raft_consensus.cc:2955] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.096158 15542 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.108105 15540 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.110258 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d1d6e542161416d9033cefcbd0c06e3 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:37.111234 16519 tablet_replica.cc:333] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:37.112263 16519 raft_consensus.cc:2243] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.113026 16519 raft_consensus.cc:2272] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.140455 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet d084942b6c014c78b9a4ece4089fb430 with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:37.145933 16519 ts_tablet_manager.cc:1916] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:37.171280 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d1d6e542161416d9033cefcbd0c06e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:37.174116 16332 raft_consensus.cc:2955] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:37.187577 16519 ts_tablet_manager.cc:1929] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.188288 16519 log.cc:1199] T 8d1d6e542161416d9033cefcbd0c06e3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/8d1d6e542161416d9033cefcbd0c06e3
I20260709 13:05:37.190529 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet 8d1d6e542161416d9033cefcbd0c06e3 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:37.198626 16535 tablet_replica.cc:333] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:37.200812 16535 raft_consensus.cc:2243] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.202702 16535 raft_consensus.cc:2272] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.213598 16535 ts_tablet_manager.cc:1916] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:37.235528 16535 ts_tablet_manager.cc:1929] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.236069 16535 log.cc:1199] T d084942b6c014c78b9a4ece4089fb430 P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/d084942b6c014c78b9a4ece4089fb430
I20260709 13:05:37.237792 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet d084942b6c014c78b9a4ece4089fb430 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:38.295661 15714 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:38.358757 15641 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.360271 16483 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.361578 15794 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:38.367065 15685 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c36d0932529945e9a284405282d65321. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.368064 16501 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.386667 15641 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.386140 16501 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.389899 15794 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.404966 15714 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:38.430459 15541 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.442301 15641 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.448822 16483 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:38.452070 15685 consensus_peers.cc:597] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3fb28c93eda43e09b6d9552f89d12ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.453912 15794 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.459232 16501 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.485146 16501 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.520277 15789 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.520751 15644 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.544023 15641 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:38.577527 15794 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.579071 15541 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.597332 16507 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.607401 15714 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.613257 16507 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:38.644975 15610 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8f5c34f652e44ef80105d4e8021a365. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.644214 16499 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.651101 15714 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.677153 15639 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:38.682242 15794 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.680071 15542 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.726325 15714 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.731163 16508 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.731714 15788 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.742347 16507 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.746512 16508 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.748430 15718 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
W20260709 13:05:38.749644 15610 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8b1fac517a64a4e9eaa1931a61e14dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.778751 15542 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.803761 15794 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:38.937629 16557 ts_tablet_manager.cc:933] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:38.953892 16558 ts_tablet_manager.cc:933] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:38.960429 16557 tablet_copy_client.cc:323] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:38.962446 15732 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet f3fb28c93eda43e09b6d9552f89d12ba from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:38.962968 16558 tablet_copy_client.cc:323] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:38.962997 15732 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet f3fb28c93eda43e09b6d9552f89d12ba from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-f3fb28c93eda43e09b6d9552f89d12ba
I20260709 13:05:38.968320 15731 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet c36d0932529945e9a284405282d65321 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:38.968878 15731 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet c36d0932529945e9a284405282d65321 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-c36d0932529945e9a284405282d65321
I20260709 13:05:38.981130 15731 tablet_copy_source_session.cc:215] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:38.985450 15732 tablet_copy_source_session.cc:215] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:38.989290 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0932529945e9a284405282d65321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.990764 16557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3fb28c93eda43e09b6d9552f89d12ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.013101 16557 tablet_copy_client.cc:806] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.013885 16557 tablet_copy_client.cc:670] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.016459 16558 tablet_copy_client.cc:806] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.017102 16558 tablet_copy_client.cc:670] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.022547 16557 tablet_copy_client.cc:538] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.026819 16558 tablet_copy_client.cc:538] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.037441 16557 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:39.066753 16561 ts_tablet_manager.cc:933] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:39.069199 16557 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.070324 16557 tablet_bootstrap.cc:492] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:39.071151 16557 ts_tablet_manager.cc:1403] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.034s	user 0.027s	sys 0.005s
I20260709 13:05:39.071863 16558 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:39.079408 16561 tablet_copy_client.cc:323] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:39.078318 16557 raft_consensus.cc:359] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.080544 16557 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:39.081362 16557 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.091199 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet a8f5c34f652e44ef80105d4e8021a365 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:39.091830 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet a8f5c34f652e44ef80105d4e8021a365 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-a8f5c34f652e44ef80105d4e8021a365
I20260709 13:05:39.143639 16558 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.150074 16558 tablet_bootstrap.cc:492] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:39.150941 16558 ts_tablet_manager.cc:1403] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.004s
I20260709 13:05:39.157274 16558 raft_consensus.cc:359] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.168454 16558 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:39.169256 16558 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.187480 16558 ts_tablet_manager.cc:1434] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:05:39.200228 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-c36d0932529945e9a284405282d65321 received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:39.200754 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-c36d0932529945e9a284405282d65321 on tablet c36d0932529945e9a284405282d65321 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:39.207095 15657 tablet_copy_source_session.cc:215] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.229967 16561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f5c34f652e44ef80105d4e8021a365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.235601 16558 ts_tablet_manager.cc:933] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:39.248405 16558 tablet_copy_client.cc:323] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:39.267198 16561 tablet_copy_client.cc:806] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.268366 16561 tablet_copy_client.cc:670] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.285725 16557 ts_tablet_manager.cc:1434] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.213s	user 0.040s	sys 0.052s
I20260709 13:05:39.328537 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-f3fb28c93eda43e09b6d9552f89d12ba received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:39.329016 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-f3fb28c93eda43e09b6d9552f89d12ba on tablet f3fb28c93eda43e09b6d9552f89d12ba with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:39.341969 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet a8b1fac517a64a4e9eaa1931a61e14dd from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:39.342635 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet a8b1fac517a64a4e9eaa1931a61e14dd from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-a8b1fac517a64a4e9eaa1931a61e14dd
I20260709 13:05:39.403044 15657 tablet_copy_source_session.cc:215] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.401002 16561 tablet_copy_client.cc:538] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.427784 16333 raft_consensus.cc:1217] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.450133 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1fac517a64a4e9eaa1931a61e14dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.452945 16333 raft_consensus.cc:1217] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.471168 16561 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:39.549633 16558 tablet_copy_client.cc:806] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.550345 16558 tablet_copy_client.cc:670] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.559309 16558 tablet_copy_client.cc:538] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.581085 16558 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:39.623973 16561 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.624974 16561 tablet_bootstrap.cc:492] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:39.626242 16561 ts_tablet_manager.cc:1403] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.155s	user 0.027s	sys 0.009s
I20260709 13:05:39.627808 16558 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.629618 16561 raft_consensus.cc:359] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.630584 16561 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:39.631319 16561 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.639587 16558 tablet_bootstrap.cc:492] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:39.640599 16558 ts_tablet_manager.cc:1403] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.003s
I20260709 13:05:39.642386 16561 ts_tablet_manager.cc:1434] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:39.643767 16558 raft_consensus.cc:359] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.650900 16558 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:39.651582 16558 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:39.659024 16558 ts_tablet_manager.cc:1434] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:05:39.660744 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-a8b1fac517a64a4e9eaa1931a61e14dd received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:39.661154 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-a8b1fac517a64a4e9eaa1931a61e14dd on tablet a8b1fac517a64a4e9eaa1931a61e14dd with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:39.670083 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-a8f5c34f652e44ef80105d4e8021a365 received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:39.670555 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-a8f5c34f652e44ef80105d4e8021a365 on tablet a8f5c34f652e44ef80105d4e8021a365 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:39.752200 16333 raft_consensus.cc:1217] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.816439 16483 raft_consensus.cc:1064] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:39.818650 16483 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:39.851317 16333 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.853206 16468 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.857200 15788 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.858894 16501 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:39.872131 15641 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.882997 16468 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:39.921986 16571 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:05:39.942497 16501 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:39.956071 15641 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:39.981940 15791 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:39.988159 16483 raft_consensus.cc:1064] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:39.992072 16483 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:40.006044 16333 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.025406 15540 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.055351 16332 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.056808 15639 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.058403 16577 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.059327 15788 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.065567 16483 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.086623 16575 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:40.093508 16577 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.096809 15788 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.124380 16332 raft_consensus.cc:1217] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:40.133298 16333 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.153117 15714 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:40.161094 15641 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.170928 15639 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.174281 16468 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.179759 16333 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.183748 16468 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:40.191602 15639 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.161499 15545 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.185542 16501 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.195560 16333 raft_consensus.cc:2955] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:40.226400 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74770.4us
I20260709 13:05:40.318352 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c36d0932529945e9a284405282d65321 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.320305 16499 raft_consensus.cc:1064] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:40.324204 16499 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:40.345898 16333 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.356340 15545 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.472625 16508 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.531559 15721 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.614303 15716 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:40.625152 15793 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.628151 16592 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.641130 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet c36d0932529945e9a284405282d65321 with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:40.644325 16594 tablet_replica.cc:333] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:40.647547 16577 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.653601 16507 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.658731 15794 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:40.688932 16499 raft_consensus.cc:1064] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:40.691457 16499 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:40.700732 15788 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.710391 16330 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:05:40.762001 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 61924.6us
W20260709 13:05:40.840137 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 135608us
W20260709 13:05:40.882071 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 213309us
W20260709 13:05:41.055853 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 292831us
W20260709 13:05:41.078066 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 353957us
I20260709 13:05:41.094455 16587 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:41.098412 16594 raft_consensus.cc:2243] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.099447 16594 raft_consensus.cc:2272] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.103240 16594 ts_tablet_manager.cc:1916] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:41.117596 16332 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:41.124006 15791 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:41.135830 15722 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:41.147801 16594 ts_tablet_manager.cc:1929] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:41.148259 16594 log.cc:1199] T c36d0932529945e9a284405282d65321 P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/c36d0932529945e9a284405282d65321
I20260709 13:05:41.149912 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet c36d0932529945e9a284405282d65321 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:41.150082 16587 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:41.170761 16590 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:41.180183 15542 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:41.185456 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 59228.6us
I20260709 13:05:41.186872 16605 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:41.190719 16588 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.215966 15789 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.218497 16332 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:41.337487 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 103204us
I20260709 13:05:41.358548 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3fb28c93eda43e09b6d9552f89d12ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:05:41.385165 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 44557.1us
I20260709 13:05:41.385707 16590 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.392230 15788 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.396242 16329 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.410547 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet f3fb28c93eda43e09b6d9552f89d12ba with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:41.419143 16619 tablet_replica.cc:333] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:41.420595 16619 raft_consensus.cc:2243] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.422611 16619 raft_consensus.cc:2272] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.425599 16619 ts_tablet_manager.cc:1916] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:41.443230 16619 ts_tablet_manager.cc:1929] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:41.443755 16619 log.cc:1199] T f3fb28c93eda43e09b6d9552f89d12ba P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/f3fb28c93eda43e09b6d9552f89d12ba
I20260709 13:05:41.469166 16592 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:41.446087 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet f3fb28c93eda43e09b6d9552f89d12ba (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:41.473120 15541 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:41.476176 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 199356us
W20260709 13:05:41.479779 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 133735us
I20260709 13:05:41.482311 15716 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.486608 15719 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:41.489259 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3540 after lost signal to thread 14519
W20260709 13:05:41.491690 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08000bfd40 after lost signal to thread 15579
W20260709 13:05:41.493058 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7720 after lost signal to thread 15671
W20260709 13:05:41.498322 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800318be0 after lost signal to thread 15746
W20260709 13:05:41.502851 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08002b08c0 after lost signal to thread 15820
W20260709 13:05:41.507203 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800311220 after lost signal to thread 16358
I20260709 13:05:41.536420 15542 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.555466 15643 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:41.565328 16329 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:41.568043 16507 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:41.588644 16553 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.586124 16332 raft_consensus.cc:2955] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.595703 15720 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:41.599426 16329 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.611858 16588 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:41.626673 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8b1fac517a64a4e9eaa1931a61e14dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:41.611876 15646 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:41.637152 15545 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.647197 15789 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:41.649427 16330 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:41.653311 16590 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:41.654567 16508 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:41.632602 15716 raft_consensus.cc:2955] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.669253 16587 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.670387 15789 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.692240 15542 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:41.693729 16595 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.006s
I20260709 13:05:41.702121 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b1fac517a64a4e9eaa1931a61e14dd with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:41.721009 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet a8f5c34f652e44ef80105d4e8021a365 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:41.727305 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8f5c34f652e44ef80105d4e8021a365 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:41.733404 16329 raft_consensus.cc:2955] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:41.737859 16621 tablet_replica.cc:333] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:41.756256 16621 raft_consensus.cc:2243] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.757117 16621 raft_consensus.cc:2272] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.742162 16622 tablet_replica.cc:333] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:41.762706 16621 ts_tablet_manager.cc:1916] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:41.775627 16622 raft_consensus.cc:2243] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.776989 16622 raft_consensus.cc:2272] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.782109 16622 ts_tablet_manager.cc:1916] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:41.797372 16622 ts_tablet_manager.cc:1929] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:41.797925 16622 log.cc:1199] T a8f5c34f652e44ef80105d4e8021a365 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/a8f5c34f652e44ef80105d4e8021a365
I20260709 13:05:41.800038 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet a8f5c34f652e44ef80105d4e8021a365 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:41.806453 16621 ts_tablet_manager.cc:1929] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:41.807003 16621 log.cc:1199] T a8b1fac517a64a4e9eaa1931a61e14dd P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/a8b1fac517a64a4e9eaa1931a61e14dd
I20260709 13:05:41.809064 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet a8b1fac517a64a4e9eaa1931a61e14dd (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
W20260709 13:05:42.254908 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9740 after lost signal to thread 14519
W20260709 13:05:42.255972 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08002508a0 after lost signal to thread 15579
W20260709 13:05:42.257103 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9c40 after lost signal to thread 15671
W20260709 13:05:42.260710 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800198de0 after lost signal to thread 15746
W20260709 13:05:42.261924 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08003304e0 after lost signal to thread 15820
W20260709 13:05:42.264501 15743 debug-util.cc:398] Leaking SignalData structure 0x7b080032ee60 after lost signal to thread 16358
W20260709 13:05:42.997912 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 60421.2us
W20260709 13:05:43.067415 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66583.9us
W20260709 13:05:43.070616 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52513.5us
W20260709 13:05:43.180243 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 97167us
W20260709 13:05:43.181787 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70426.6us
I20260709 13:05:43.188545 15789 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:05:43.230696 15759 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dabdbaded914a498e98f6a03182ab7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:43.232198 15646 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:43.233237 15716 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:43.235728 16632 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:43.238024 16631 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:43.277209 16600 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.278558 15719 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.290815 15645 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.312402 15714 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:43.324810 15541 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.350796 15789 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:43.351740 15685 consensus_peers.cc:597] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2555c9ee274d4274a4cf64af7f5c3609. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:43.353574 16638 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:43.360613 15645 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:43.363687 16625 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:43.379894 16625 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.382123 15791 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.405198 15722 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:43.433038 15646 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:43.434487 15789 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:43.436192 16625 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.439232 16625 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:43.442250 15685 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c6e933897cb4278b93a8cca027153ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:43.444664 15645 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.468372 16637 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.474836 15789 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.483687 15645 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.536841 15646 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:43.582888 15545 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.584976 15545 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.606371 15722 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:43.608117 16628 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:43.608624 15789 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:43.609925 15610 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9dc71c1b2c74ae3a9bd46fccb533628. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:43.625861 16628 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.630869 16654 ts_tablet_manager.cc:933] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:43.639351 16654 tablet_copy_client.cc:323] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:05:43.650857 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 1dabdbaded914a498e98f6a03182ab7e from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:43.651690 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 1dabdbaded914a498e98f6a03182ab7e from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-1dabdbaded914a498e98f6a03182ab7e
I20260709 13:05:43.659574 16628 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.662928 15722 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.678830 15792 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.694201 15806 tablet_copy_source_session.cc:215] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:43.694670 15545 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:43.697693 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dabdbaded914a498e98f6a03182ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:43.756742 16654 tablet_copy_client.cc:806] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:43.757444 16654 tablet_copy_client.cc:670] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:43.768679 16654 tablet_copy_client.cc:538] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:43.793131 16654 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:43.837961 16654 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:43.839883 16658 ts_tablet_manager.cc:933] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:43.839891 16654 tablet_bootstrap.cc:492] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:43.841673 16654 ts_tablet_manager.cc:1403] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.007s
I20260709 13:05:43.845997 16654 raft_consensus.cc:359] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:43.846822 16654 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:43.850575 16654 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:43.855747 16658 tablet_copy_client.cc:323] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:43.858739 15731 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet 2555c9ee274d4274a4cf64af7f5c3609 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:43.859350 15731 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet 2555c9ee274d4274a4cf64af7f5c3609 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-2555c9ee274d4274a4cf64af7f5c3609
I20260709 13:05:43.871281 15731 tablet_copy_source_session.cc:215] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:43.884922 16658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2555c9ee274d4274a4cf64af7f5c3609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:43.908845 16654 ts_tablet_manager.cc:1434] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.067s	user 0.022s	sys 0.018s
I20260709 13:05:43.916550 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-1dabdbaded914a498e98f6a03182ab7e received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:43.917088 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-1dabdbaded914a498e98f6a03182ab7e on tablet 1dabdbaded914a498e98f6a03182ab7e with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:43.933166 16658 tablet_copy_client.cc:806] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:43.933820 16658 tablet_copy_client.cc:670] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:43.940196 16658 tablet_copy_client.cc:538] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:43.959748 16658 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:44.014410 16654 ts_tablet_manager.cc:933] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:44.032524 16654 tablet_copy_client.cc:323] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:44.034318 15731 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet 9c6e933897cb4278b93a8cca027153ac from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:44.034936 15731 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet 9c6e933897cb4278b93a8cca027153ac from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-9c6e933897cb4278b93a8cca027153ac
I20260709 13:05:44.043681 15731 tablet_copy_source_session.cc:215] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:44.058043 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6e933897cb4278b93a8cca027153ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.075428 16332 raft_consensus.cc:1217] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:44.105630 16654 tablet_copy_client.cc:806] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:44.106474 16654 tablet_copy_client.cc:670] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:44.114357 16658 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:44.115389 16658 tablet_bootstrap.cc:492] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:44.116124 16658 ts_tablet_manager.cc:1403] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.011s
I20260709 13:05:44.125877 16654 tablet_copy_client.cc:538] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:44.127688 16658 raft_consensus.cc:359] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:44.128831 16658 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:44.129639 16658 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:44.142298 16654 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:44.142638 16658 ts_tablet_manager.cc:1434] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:05:44.157444 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-2555c9ee274d4274a4cf64af7f5c3609 received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:44.157969 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-2555c9ee274d4274a4cf64af7f5c3609 on tablet 2555c9ee274d4274a4cf64af7f5c3609 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:44.185218 16654 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:44.188643 16654 tablet_bootstrap.cc:492] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:44.189384 16654 ts_tablet_manager.cc:1403] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.005s
I20260709 13:05:44.202371 16654 raft_consensus.cc:359] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:44.203394 16654 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:44.204157 16654 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:44.215251 16654 ts_tablet_manager.cc:1434] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:05:44.227485 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-9c6e933897cb4278b93a8cca027153ac received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:44.227985 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-9c6e933897cb4278b93a8cca027153ac on tablet 9c6e933897cb4278b93a8cca027153ac with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:44.229049 16658 ts_tablet_manager.cc:933] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:44.257242 16658 tablet_copy_client.cc:323] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:44.259460 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet a9dc71c1b2c74ae3a9bd46fccb533628 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:44.260144 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet a9dc71c1b2c74ae3a9bd46fccb533628 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-a9dc71c1b2c74ae3a9bd46fccb533628
I20260709 13:05:44.272544 15657 tablet_copy_source_session.cc:215] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:44.280292 16658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc71c1b2c74ae3a9bd46fccb533628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.319507 16658 tablet_copy_client.cc:806] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:44.320183 16658 tablet_copy_client.cc:670] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:44.324245 16658 tablet_copy_client.cc:538] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:44.334172 16332 raft_consensus.cc:1217] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:44.385408 16658 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:44.498418 16332 raft_consensus.cc:1217] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:44.524755 16658 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:44.526017 16658 tablet_bootstrap.cc:492] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:44.526842 16658 ts_tablet_manager.cc:1403] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.142s	user 0.028s	sys 0.015s
I20260709 13:05:44.539774 16658 raft_consensus.cc:359] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:44.540791 16658 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:44.541574 16658 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:44.563009 16658 ts_tablet_manager.cc:1434] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:05:44.565059 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-a9dc71c1b2c74ae3a9bd46fccb533628 received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:44.565564 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-a9dc71c1b2c74ae3a9bd46fccb533628 on tablet a9dc71c1b2c74ae3a9bd46fccb533628 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:44.644449 16631 raft_consensus.cc:1064] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:44.653981 16631 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:44.708525 16332 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.710392 16624 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.733790 16329 raft_consensus.cc:1217] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:44.748361 15722 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.750113 16624 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:44.751531 15643 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.758944 16669 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:44.788915 16670 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:44.790838 15714 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:44.810825 16633 raft_consensus.cc:1064] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:44.814107 16633 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:44.833756 16332 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:44.844187 15643 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:44.852681 15541 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.927448 16329 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.930603 16625 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.931644 16637 raft_consensus.cc:1064] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:44.935124 16637 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:44.963244 16330 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.964946 16633 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.965361 15645 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.975396 15789 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.981539 16638 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:44.979874 15645 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.985416 15789 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.993610 16638 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.006376 16638 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.013482 16633 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.073895 16679 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.100596 15646 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.106367 16329 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.110446 16637 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.116854 15791 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.126436 15789 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.147017 15643 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.161031 15542 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.196909 16329 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.201370 15791 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:45.232540 15542 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.239794 15643 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.241725 16669 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.246793 16329 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.248525 16669 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.251390 16669 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.256356 15722 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:45.262568 15714 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:45.265010 16330 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.267213 16633 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:45.266798 16329 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:45.270730 15610 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.14.45.62:37417, user_credentials={real_user=slave}} blocked reactor thread for 43492.1us
I20260709 13:05:45.277995 15791 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.280555 16330 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.283238 16637 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.286206 16638 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.301090 16628 raft_consensus.cc:1064] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:45.303781 16628 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:45.306730 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1dabdbaded914a498e98f6a03182ab7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:45.253050 15643 raft_consensus.cc:2955] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.311761 16638 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.317420 16330 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.331081 16332 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.334818 15542 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.337574 16637 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.346201 15791 raft_consensus.cc:2955] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.350261 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dabdbaded914a498e98f6a03182ab7e with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:45.357401 15540 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:45.361129 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 87410.9us
I20260709 13:05:45.366935 15646 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.369195 16679 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.377775 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet 2555c9ee274d4274a4cf64af7f5c3609 with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:45.386099 15714 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:45.387650 16665 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.390949 15540 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.424949 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c6e933897cb4278b93a8cca027153ac with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:45.427755 16693 tablet_replica.cc:333] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:45.430959 16330 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:45.431339 15645 raft_consensus.cc:2955] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.440006 15791 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:45.449909 16665 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.450726 16693 raft_consensus.cc:2243] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.451637 16693 raft_consensus.cc:2272] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.452173 16507 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.461231 16693 ts_tablet_manager.cc:1916] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:45.488973 16689 tablet_replica.cc:333] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:45.539050 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c6e933897cb4278b93a8cca027153ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:45.505697 16689 raft_consensus.cc:2243] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.558625 16689 raft_consensus.cc:2272] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.563177 16689 ts_tablet_manager.cc:1916] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:45.571206 16690 tablet_replica.cc:333] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:45.584359 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2555c9ee274d4274a4cf64af7f5c3609 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:45.593609 16690 raft_consensus.cc:2243] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.594569 16690 raft_consensus.cc:2272] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.598538 16690 ts_tablet_manager.cc:1916] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:05:45.612498 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 109099us
I20260709 13:05:45.614611 16687 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.629243 16690 ts_tablet_manager.cc:1929] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:45.629891 16690 log.cc:1199] T 2555c9ee274d4274a4cf64af7f5c3609 P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/2555c9ee274d4274a4cf64af7f5c3609
I20260709 13:05:45.631910 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet 2555c9ee274d4274a4cf64af7f5c3609 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:45.633863 16693 ts_tablet_manager.cc:1929] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:45.638939 16693 log.cc:1199] T 9c6e933897cb4278b93a8cca027153ac P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/9c6e933897cb4278b93a8cca027153ac
I20260709 13:05:45.642180 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet 9c6e933897cb4278b93a8cca027153ac (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:45.658452 15791 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.672642 15714 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.690950 16689 ts_tablet_manager.cc:1929] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:45.691707 16689 log.cc:1199] T 1dabdbaded914a498e98f6a03182ab7e P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/1dabdbaded914a498e98f6a03182ab7e
I20260709 13:05:45.700896 15540 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.703814 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet 1dabdbaded914a498e98f6a03182ab7e (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:45.721824 16330 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.760610 15643 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:45.793318 15789 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.796041 16330 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:45.801528 16687 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:45.814924 16687 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.832499 16507 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.844719 16329 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.852766 15791 raft_consensus.cc:2955] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.871236 15540 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:45.887650 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9dc71c1b2c74ae3a9bd46fccb533628 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:45.897385 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet a9dc71c1b2c74ae3a9bd46fccb533628 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:45.898475 16689 tablet_replica.cc:333] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:45.899667 16689 raft_consensus.cc:2243] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.900452 16689 raft_consensus.cc:2272] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.910694 16689 ts_tablet_manager.cc:1916] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:45.960384 16689 ts_tablet_manager.cc:1929] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:45.967129 16689 log.cc:1199] T a9dc71c1b2c74ae3a9bd46fccb533628 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/a9dc71c1b2c74ae3a9bd46fccb533628
I20260709 13:05:45.968986 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet a9dc71c1b2c74ae3a9bd46fccb533628 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
W20260709 13:05:47.093057 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48988.7us
I20260709 13:05:47.143108 15791 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:05:47.166435 15759 consensus_peers.cc:597] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5155e26439a345ae8f836c6cc4f0ab34. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.167793 15722 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.170091 15641 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.171293 16703 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.173388 16703 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:47.183616 16697 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.205770 15716 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.214250 15717 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:47.217154 15641 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
W20260709 13:05:47.243192 15685 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cde3f8ed1454b789014048b7d1e4af8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.245652 15646 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.241647 15542 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.248006 15791 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.248745 16698 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.249827 16679 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.279271 16679 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.285192 15791 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.290453 15646 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.307457 15641 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:05:47.330287 15610 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9f64c9d13524994bf43ee72f72781ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.331596 15791 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.333853 15717 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.334026 16708 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:47.335892 16696 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:47.385113 16708 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.423650 15789 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.427433 15540 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.432874 15717 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.447145 15641 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:47.460995 15542 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.509780 15793 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:47.514304 15610 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d5ce40a7af94aa0a543c078bc1fe630. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.516271 16706 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:47.527029 15716 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:47.530328 16699 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:47.553305 16708 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.563356 15793 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.565996 15716 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.589382 15542 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:47.603057 16725 ts_tablet_manager.cc:933] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:47.626884 16725 tablet_copy_client.cc:323] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:05:47.628719 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 5155e26439a345ae8f836c6cc4f0ab34 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:47.629631 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 5155e26439a345ae8f836c6cc4f0ab34 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-5155e26439a345ae8f836c6cc4f0ab34
I20260709 13:05:47.641796 15806 tablet_copy_source_session.cc:215] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:47.649351 16725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5155e26439a345ae8f836c6cc4f0ab34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.700948 16725 tablet_copy_client.cc:806] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:47.701814 16725 tablet_copy_client.cc:670] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:47.741765 16725 tablet_copy_client.cc:538] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:47.792268 16725 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:47.794627 16727 ts_tablet_manager.cc:933] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:47.806174 16727 tablet_copy_client.cc:323] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:47.807966 15731 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet 3cde3f8ed1454b789014048b7d1e4af8 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:47.808607 15731 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet 3cde3f8ed1454b789014048b7d1e4af8 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-3cde3f8ed1454b789014048b7d1e4af8
I20260709 13:05:47.846557 15731 tablet_copy_source_session.cc:215] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:47.851845 16727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde3f8ed1454b789014048b7d1e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.877665 16725 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:47.881551 16725 tablet_bootstrap.cc:492] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:47.882323 16725 ts_tablet_manager.cc:1403] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.090s	user 0.033s	sys 0.030s
I20260709 13:05:47.882650 16727 tablet_copy_client.cc:806] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:47.885591 16727 tablet_copy_client.cc:670] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:47.878826 16730 ts_tablet_manager.cc:933] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:47.886763 16725 raft_consensus.cc:359] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:47.888144 16725 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:47.888835 16725 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:47.896018 16727 tablet_copy_client.cc:538] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:47.906930 16725 ts_tablet_manager.cc:1434] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.006s
I20260709 13:05:47.918013 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-5155e26439a345ae8f836c6cc4f0ab34 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:47.918622 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-5155e26439a345ae8f836c6cc4f0ab34 on tablet 5155e26439a345ae8f836c6cc4f0ab34 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:47.933810 16730 tablet_copy_client.cc:323] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:47.940280 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet e9f64c9d13524994bf43ee72f72781ee from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:47.940915 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet e9f64c9d13524994bf43ee72f72781ee from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-e9f64c9d13524994bf43ee72f72781ee
I20260709 13:05:47.941193 16727 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:47.949633 15657 tablet_copy_source_session.cc:215] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:47.967530 16730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f64c9d13524994bf43ee72f72781ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:48.002076 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080017c200 after lost signal to thread 14519
W20260709 13:05:48.003189 15817 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0fa0 after lost signal to thread 15579
W20260709 13:05:48.004424 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080020f160 after lost signal to thread 15671
W20260709 13:05:48.005489 15817 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd6a0 after lost signal to thread 15746
I20260709 13:05:48.006286 16725 ts_tablet_manager.cc:933] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
W20260709 13:05:48.006572 15817 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6700 after lost signal to thread 15820
W20260709 13:05:48.007766 15817 debug-util.cc:398] Leaking SignalData structure 0x7b08003337a0 after lost signal to thread 16358
I20260709 13:05:48.003197 16727 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:48.022778 16727 tablet_bootstrap.cc:492] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:48.023496 16727 ts_tablet_manager.cc:1403] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.008s
I20260709 13:05:48.027487 16727 raft_consensus.cc:359] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:48.028357 16727 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:48.040733 16725 tablet_copy_client.cc:323] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:48.049996 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet 0d5ce40a7af94aa0a543c078bc1fe630 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:48.050590 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet 0d5ce40a7af94aa0a543c078bc1fe630 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-0d5ce40a7af94aa0a543c078bc1fe630
I20260709 13:05:48.029044 16727 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:48.054176 16730 tablet_copy_client.cc:806] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:48.054986 16730 tablet_copy_client.cc:670] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:48.082569 16332 raft_consensus.cc:1217] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:48.087615 16730 tablet_copy_client.cc:538] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:48.096725 15657 tablet_copy_source_session.cc:215] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:48.100255 16727 ts_tablet_manager.cc:1434] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 13:05:48.102567 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-3cde3f8ed1454b789014048b7d1e4af8 received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:48.103052 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-3cde3f8ed1454b789014048b7d1e4af8 on tablet 3cde3f8ed1454b789014048b7d1e4af8 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:48.105135 16725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ce40a7af94aa0a543c078bc1fe630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.110244 16730 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:48.142725 16725 tablet_copy_client.cc:806] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:48.143332 16725 tablet_copy_client.cc:670] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:48.147920 16725 tablet_copy_client.cc:538] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:48.157635 16730 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:48.158775 16730 tablet_bootstrap.cc:492] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:48.159567 16730 ts_tablet_manager.cc:1403] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.021s
I20260709 13:05:48.164119 16730 raft_consensus.cc:359] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:48.165863 16730 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:48.166613 16725 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:48.166843 16730 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:48.174993 16730 ts_tablet_manager.cc:1434] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:48.177372 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-e9f64c9d13524994bf43ee72f72781ee received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:48.177839 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-e9f64c9d13524994bf43ee72f72781ee on tablet e9f64c9d13524994bf43ee72f72781ee with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:48.242007 16725 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:48.243063 16725 tablet_bootstrap.cc:492] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:48.243824 16725 ts_tablet_manager.cc:1403] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.008s
I20260709 13:05:48.255967 16725 raft_consensus.cc:359] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:48.256968 16725 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:48.272713 16725 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:48.279594 16725 ts_tablet_manager.cc:1434] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 13:05:48.281409 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-0d5ce40a7af94aa0a543c078bc1fe630 received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:48.281978 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-0d5ce40a7af94aa0a543c078bc1fe630 on tablet 0d5ce40a7af94aa0a543c078bc1fe630 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:48.349972 16329 raft_consensus.cc:1217] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:48.368589 16329 raft_consensus.cc:1217] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:48.415300 16329 raft_consensus.cc:1217] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:48.578238 16624 raft_consensus.cc:1064] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:48.581051 16624 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:48.619089 16329 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:48.621973 16703 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.622406 15716 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:48.622438 15646 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:48.636257 16697 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:48.639981 16738 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:48.696594 16624 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.716547 15722 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.722591 15646 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.743331 16329 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.743443 15545 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.838335 16699 raft_consensus.cc:1064] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:48.841125 16699 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:48.859952 16329 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:48.861322 15789 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:48.862453 15716 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:48.862785 16699 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:48.857156 15791 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:48.865566 16704 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.867126 16628 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.885957 16329 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.887619 16624 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.896838 16697 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.900889 16332 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.904026 16628 raft_consensus.cc:1064] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:48.904318 15717 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.905934 16624 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:05:48.927567 16628 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:48.928879 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5155e26439a345ae8f836c6cc4f0ab34 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:48.953123 15717 raft_consensus.cc:2955] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.983796 15540 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:48.974606 16679 raft_consensus.cc:1064] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:48.992969 16679 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:05:49.066507 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 90202.6us
W20260709 13:05:49.072381 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71350.3us
W20260709 13:05:49.070789 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70520.3us
I20260709 13:05:49.072196 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet 5155e26439a345ae8f836c6cc4f0ab34 with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:49.075189 16759 tablet_replica.cc:333] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:49.078953 16330 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:49.078954 15793 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:05:49.081303 16750 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:05:49.097343 16754 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:49.098140 16759 raft_consensus.cc:2243] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.098778 16755 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.099128 16759 raft_consensus.cc:2272] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.101713 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 109462us
I20260709 13:05:49.108650 16759 ts_tablet_manager.cc:1916] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:49.114926 15722 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:49.119973 16754 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.122064 16507 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:49.139672 15719 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.154160 16329 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:49.160616 15793 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:49.157215 16679 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:05:49.170866 15793 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.173964 16698 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.177300 16699 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.191196 15540 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.167397 16329 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.195119 15714 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.218215 15646 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:49.220899 16332 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.231582 16698 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.236061 16329 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.243011 15646 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:49.250805 16759 ts_tablet_manager.cc:1929] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:49.251330 16759 log.cc:1199] T 5155e26439a345ae8f836c6cc4f0ab34 P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/5155e26439a345ae8f836c6cc4f0ab34
I20260709 13:05:49.251405 15540 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.253261 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet 5155e26439a345ae8f836c6cc4f0ab34 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:49.260829 15793 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.269815 15541 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.284389 16329 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:49.284832 15791 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:49.290551 15793 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.296767 16507 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.298874 16679 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.306345 16628 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.348502 16754 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.358171 15641 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.368036 15789 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.351222 15643 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:49.397248 16332 raft_consensus.cc:2955] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.404618 15719 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:49.405433 16329 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:49.406796 16708 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.412197 16628 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.419621 16755 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.423561 15719 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.430800 16329 raft_consensus.cc:2955] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.451193 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9f64c9d13524994bf43ee72f72781ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:49.462404 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d5ce40a7af94aa0a543c078bc1fe630 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:49.475135 15542 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.480384 15541 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.486828 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ce40a7af94aa0a543c078bc1fe630 with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:49.488715 16768 tablet_replica.cc:333] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:49.489856 16768 raft_consensus.cc:2243] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.490700 16768 raft_consensus.cc:2272] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.494900 16768 ts_tablet_manager.cc:1916] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:49.504209 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet e9f64c9d13524994bf43ee72f72781ee with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:49.542843 16769 tablet_replica.cc:333] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:05:49.544018 16769 raft_consensus.cc:2243] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.544896 16769 raft_consensus.cc:2272] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.551251 16769 ts_tablet_manager.cc:1916] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:49.567747 16768 ts_tablet_manager.cc:1929] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:49.568346 16768 log.cc:1199] T 0d5ce40a7af94aa0a543c078bc1fe630 P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/0d5ce40a7af94aa0a543c078bc1fe630
I20260709 13:05:49.570147 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet 0d5ce40a7af94aa0a543c078bc1fe630 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:49.608777 16769 ts_tablet_manager.cc:1929] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:49.617978 16769 log.cc:1199] T e9f64c9d13524994bf43ee72f72781ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/e9f64c9d13524994bf43ee72f72781ee
I20260709 13:05:49.620764 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet e9f64c9d13524994bf43ee72f72781ee (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:49.852865 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.926326 15719 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:49.939342 15643 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:49.941388 16329 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:49.943041 16679 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.945670 16758 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:49.965088 16758 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:49.974419 15643 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:49.999960 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54720us
I20260709 13:05:50.033922 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cde3f8ed1454b789014048b7d1e4af8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.042819 16332 raft_consensus.cc:2955] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:50.059423 15545 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.121631 15717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:50.122421 15717 raft_consensus.cc:606] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:50.126796 15717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:50.127418 15717 raft_consensus.cc:606] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:50.128067 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cde3f8ed1454b789014048b7d1e4af8 with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:50.147071 15719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:50.147847 15719 raft_consensus.cc:606] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:50.174818 16779 tablet_replica.cc:333] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:50.181607 16679 raft_consensus.cc:993] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.182116 16679 raft_consensus.cc:1081] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.186380 16779 raft_consensus.cc:2243] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.187017 16779 raft_consensus.cc:2272] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.186800 15793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:50.187575 15793 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.187948 15793 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.192015 16779 ts_tablet_manager.cc:1916] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.198529 15793 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.202567 15793 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:50.203624 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:50.203651 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:50.210803 15719 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.210958 15643 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.211200 15719 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:50.212178 15719 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.213261 15719 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.218993 15643 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.220515 15719 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.220567 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:50.221686 16770 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.225647 15645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:50.226332 15645 raft_consensus.cc:606] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:50.222241 16770 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:50.231866 16770 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.234284 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:50.234906 15714 raft_consensus.cc:606] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:50.237643 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:50.238261 15714 raft_consensus.cc:606] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:50.240446 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:50.242318 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:50.255192 16772 raft_consensus.cc:993] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.255774 16772 raft_consensus.cc:1081] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.257366 15793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:50.257925 15793 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.258276 15793 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.264564 15793 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.264973 16779 ts_tablet_manager.cc:1929] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.265849 16779 log.cc:1199] T 3cde3f8ed1454b789014048b7d1e4af8 P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/3cde3f8ed1454b789014048b7d1e4af8
I20260709 13:05:50.266665 15793 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:50.267243 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:50.267845 15643 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.269595 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:50.270222 15714 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.270532 15714 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:50.271270 15714 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.272436 15714 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.283113 15714 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.284464 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet 3cde3f8ed1454b789014048b7d1e4af8 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:50.285473 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:50.286502 16770 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.287020 16770 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:50.287948 16770 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.289407 15643 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.301371 15540 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.338814 15540 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.536295 16679 raft_consensus.cc:993] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.536773 16679 raft_consensus.cc:1081] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.538280 15793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:50.538826 15793 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.539263 15793 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.546445 15793 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.549081 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:50.550019 15643 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.550866 15793 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:50.574319 16771 raft_consensus.cc:993] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.574815 16758 raft_consensus.cc:1081] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:50.578084 15793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:50.578615 15793 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.578958 15793 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.585395 15643 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.587515 15762 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:50.589424 16783 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.589993 16783 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:50.590947 16783 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.594530 16771 raft_consensus.cc:993] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:50.595019 16771 raft_consensus.cc:1081] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:50.597059 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:05:50.597637 16330 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.598166 16330 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.598706 15793 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.601689 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:50.602358 15645 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.609476 15793 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:50.612758 15645 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.613327 16330 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:50.614617 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:50.615543 16770 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.616144 16770 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:50.617071 16770 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.620132 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:50.620918 15714 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.621480 15714 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:50.621963 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:50.622587 15789 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.622370 15714 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:50.624292 15714 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.633858 16330 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:50.638695 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:50.639370 15719 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.639657 15719 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:50.640416 15719 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.642002 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:50.642792 15717 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.643203 15717 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:50.641641 15719 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.644227 15717 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:50.646298 15717 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.661163 15719 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.659330 15789 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:50.665179 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:50.670933 16788 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.672637 15645 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.675823 16785 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:50.683753 15714 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
W20260709 13:05:50.702549 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48969.7us
I20260709 13:05:50.713428 15717 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:50.719767 15717 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.723755 16791 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:50.728711 15540 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.741319 16754 raft_consensus.cc:993] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:50.741887 16754 raft_consensus.cc:1081] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:50.747339 16788 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:50.747452 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56434
I20260709 13:05:50.748255 16330 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.748768 16330 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.748435 16788 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:50.776959 15541 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.761731 16330 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:50.783179 16330 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:50.785806 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:50.786842 15717 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.788153 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:50.796437 15643 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.796943 15643 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:50.807933 15643 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:50.809320 15643 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.818595 15643 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:50.824153 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:50.825183 16789 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.835403 15717 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:50.845104 15717 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.849922 16738 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.851588 16789 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:50.852646 16789 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:50.869217 15643 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.872531 16738 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:50.865576 15541 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.920390 15541 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.994815 15717 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.996835 16784 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:51.041891 15641 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.043496 15714 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.048440 16738 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.055656 16784 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.075232 15641 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.077481 16738 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.157835 15714 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.159296 16789 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:51.218832 15793 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.222636 16788 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:51.244076 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:51.286345 15717 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.288125 16789 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:51.341727 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:51.483969 15641 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.500247 16789 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:51.565558 15719 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:51.589906 15641 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.591557 16812 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.601876 15643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:51.602669 15643 raft_consensus.cc:606] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
W20260709 13:05:51.606482 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48043.1us
W20260709 13:05:51.619758 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65127us
I20260709 13:05:51.631706 15793 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.636631 16817 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.640266 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:05:51.640816 15793 raft_consensus.cc:606] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:51.640030 15643 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.646165 15641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:51.646749 15641 raft_consensus.cc:606] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:51.652663 15641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:51.653278 15641 raft_consensus.cc:606] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:51.654910 16812 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:51.659807 15641 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:05:51.672600 15685 consensus_peers.cc:597] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 356b3bbf62c44a84bc360356d580684d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.685936 15717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:51.696113 15717 raft_consensus.cc:606] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:51.702692 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:51.704779 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:51.710397 15789 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.697504 15541 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:51.724574 15610 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5622436c83fb41fa8923df2295b99818. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.725428 16818 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.726914 16785 raft_consensus.cc:993] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:51.727447 16785 raft_consensus.cc:1081] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:51.729295 15717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:05:51.729981 15717 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.730367 15717 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.743212 15791 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.746340 15719 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.751402 16818 raft_consensus.cc:993] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:51.751967 16818 raft_consensus.cc:1081] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:51.754362 16813 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.758158 15789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56124
I20260709 13:05:51.758723 15789 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.759115 15789 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.770177 15717 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.770771 15789 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.773002 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:51.773594 15641 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.775818 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:51.776445 15716 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.779479 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:51.780035 15643 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.780308 15643 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:51.781009 15643 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.782092 15643 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.782759 15717 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:51.782059 16813 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.783303 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:51.783954 15793 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.784296 15793 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:51.786788 15793 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.787870 15793 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.788954 15643 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:51.785810 15641 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:51.774748 15789 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:51.790175 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:51.790997 16784 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.791453 16784 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:51.792366 16784 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.796365 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:51.797209 16817 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.797408 15719 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.797667 16817 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:51.803540 15716 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:51.805055 15789 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.810680 16818 raft_consensus.cc:993] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:51.811167 16818 raft_consensus.cc:1081] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:51.813900 15717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:05:51.814428 15717 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.814774 15717 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.802878 16817 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.820188 15793 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:51.833299 15540 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.833655 15716 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:51.831650 15545 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.866775 15717 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.868767 15717 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:51.870059 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:51.870641 15793 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.879953 15793 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:51.881111 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:51.882195 16679 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.882623 16679 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:51.883339 16679 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.906253 16811 raft_consensus.cc:993] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:51.907002 16812 raft_consensus.cc:1081] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:51.906874 15540 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.911621 15793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:51.912168 15793 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.912489 15793 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.919963 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:51.920609 15643 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.920933 15643 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:51.921692 15643 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.926990 15643 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:51.930563 15685 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbf56bc1c60545828ec946a02bb6cf8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.932008 15789 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.933405 16771 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.945212 15643 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:51.959031 15793 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:51.971429 15540 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.989192 15793 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:51.974520 15641 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.992149 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:51.992815 15645 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.993598 16817 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:51.995632 15789 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:52.000638 16771 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.004464 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:52.005096 15716 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.005398 15716 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:52.007196 15716 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:52.008432 15716 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.010803 15645 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:52.012113 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:52.015480 16791 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.011795 15641 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:52.021287 15716 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:52.024290 16810 raft_consensus.cc:993] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:52.024947 16810 raft_consensus.cc:1081] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:52.017657 16791 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:52.027544 15716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:05:52.044466 15716 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.045928 15716 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.026733 16791 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:52.048273 15540 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:52.057054 15716 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:52.067030 15716 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:52.067194 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:52.067759 15789 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.073688 15793 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:52.076953 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:52.079013 15789 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:52.079694 15641 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.080068 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:52.080454 15641 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:52.080950 16771 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.081590 16771 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:52.082476 16771 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:52.084650 15641 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:05:52.106135 15759 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17999909d8e0416d88f73b762dbb4bd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:52.106846 15641 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.107636 15716 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:52.103199 15545 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.110628 16783 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:52.120157 15643 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:52.126457 16738 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:52.146095 15641 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:52.178812 16791 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:52.180565 15714 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:52.197772 16841 ts_tablet_manager.cc:933] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:52.215710 16842 ts_tablet_manager.cc:933] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:52.217918 15545 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.220261 16841 tablet_copy_client.cc:323] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:52.222265 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet 5622436c83fb41fa8923df2295b99818 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:52.222904 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet 5622436c83fb41fa8923df2295b99818 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-5622436c83fb41fa8923df2295b99818
I20260709 13:05:52.223625 15793 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.224877 16679 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.229550 15645 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:52.244844 15657 tablet_copy_source_session.cc:215] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.245764 15540 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.255491 16842 tablet_copy_client.cc:323] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:52.257385 15731 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet 356b3bbf62c44a84bc360356d580684d from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:52.257977 15731 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet 356b3bbf62c44a84bc360356d580684d from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-356b3bbf62c44a84bc360356d580684d
I20260709 13:05:52.268069 15643 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.273980 16784 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.295581 16841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5622436c83fb41fa8923df2295b99818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.304616 15731 tablet_copy_source_session.cc:215] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.313110 16842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b3bbf62c44a84bc360356d580684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.322821 15714 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.324533 16738 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.335680 15643 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.337973 16771 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:52.386588 15643 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.390163 16817 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.416574 16852 ts_tablet_manager.cc:933] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:52.429441 16841 tablet_copy_client.cc:806] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.430488 16841 tablet_copy_client.cc:670] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.452390 16841 tablet_copy_client.cc:538] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.464344 15719 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.466967 16784 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.475406 15793 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.478948 16817 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:52.603049 16852 tablet_copy_client.cc:323] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.2:40695
I20260709 13:05:52.787492 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:52.831773 16841 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:52.875442 16842 tablet_copy_client.cc:806] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.876204 16842 tablet_copy_client.cc:670] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.961846 15641 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.996971 15643 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.001471 15793 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.003737 15731 tablet_copy_service.cc:140] P 8ca6a5ab086d47e5a79ef37ddead9f28: Received BeginTabletCopySession request for tablet dbf56bc1c60545828ec946a02bb6cf8b from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:39124)
I20260709 13:05:53.013067 15731 tablet_copy_service.cc:161] P 8ca6a5ab086d47e5a79ef37ddead9f28: Beginning new tablet copy session on tablet dbf56bc1c60545828ec946a02bb6cf8b from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:39124: session id = 228b1ac5589e48af9bbf6caecd6aeaea-dbf56bc1c60545828ec946a02bb6cf8b
I20260709 13:05:53.126818 16858 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:53.134951 16811 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:05:53.216543 16842 tablet_copy_client.cc:538] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.286907 16841 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.288674 16841 tablet_bootstrap.cc:492] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:53.290868 16865 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:53.285729 15731 tablet_copy_source_session.cc:215] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.247973 16842 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:53.313717 16841 ts_tablet_manager.cc:1403] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.488s	user 0.021s	sys 0.028s
I20260709 13:05:53.338583 16852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf56bc1c60545828ec946a02bb6cf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.415387 16841 raft_consensus.cc:359] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:53.471470 16891 ts_tablet_manager.cc:933] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:53.430722 16841 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:53.531210 16891 tablet_copy_client.cc:323] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:05:53.537371 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 17999909d8e0416d88f73b762dbb4bd6 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:05:53.538142 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 17999909d8e0416d88f73b762dbb4bd6 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-17999909d8e0416d88f73b762dbb4bd6
I20260709 13:05:53.550773 16841 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:05:53.569547 16889 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:05:53.571233 16841 ts_tablet_manager.cc:1434] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.249s	user 0.010s	sys 0.000s
I20260709 13:05:53.617188 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:53.627077 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-5622436c83fb41fa8923df2295b99818 received from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:53.651934 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-5622436c83fb41fa8923df2295b99818 on tablet 5622436c83fb41fa8923df2295b99818 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:53.663189 16838 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:05:53.669538 16838 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:53.675380 16838 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:53.676733 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:05:53.688756 15806 tablet_copy_source_session.cc:215] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.696137 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:53.621706 16852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56432 (request call id 211) took 1271 ms. Trace:
I20260709 13:05:53.714064 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:05:53.734377 16891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17999909d8e0416d88f73b762dbb4bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.734567 16679 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.704614 16852 rpcz_store.cc:276] 0709 13:05:52.350760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.350913 (+   153us) service_pool.cc:224] Handling call
0709 13:05:52.417340 (+ 66427us) ts_tablet_manager.cc:934] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
0709 13:05:53.309610 (+892270us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:53.490800 (+181190us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:53.522206 (+ 31406us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:53.620769 (+ 98563us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:53.621121 (+   352us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:53.621497 (+   376us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:53.621624 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":64174,"spinlock_wait_cycles":57728,"tablet-copy.queue_time_us":55548,"thread_start_us":179209,"threads_started":2}
I20260709 13:05:53.748661 16852 tablet_copy_client.cc:806] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.749317 16852 tablet_copy_client.cc:670] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:53.769390 16852 tablet_copy_client.cc:538] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.797978 16842 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.800464 16842 tablet_bootstrap.cc:492] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:53.802518 16852 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:53.816406 16842 ts_tablet_manager.cc:1403] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.569s	user 0.033s	sys 0.007s
I20260709 13:05:53.820276 16842 raft_consensus.cc:359] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:53.821213 16842 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:53.821928 16842 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:53.829681 16891 tablet_copy_client.cc:806] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.830508 16891 tablet_copy_client.cc:670] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:53.836786 16842 ts_tablet_manager.cc:1434] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:53.841713 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-356b3bbf62c44a84bc360356d580684d received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:53.842274 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-356b3bbf62c44a84bc360356d580684d on tablet 356b3bbf62c44a84bc360356d580684d with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:53.851316 16891 tablet_copy_client.cc:538] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.889647 16891 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:05:53.914009 15645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:53.914677 15645 raft_consensus.cc:606] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:53.918609 15720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:53.919196 15720 raft_consensus.cc:606] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:53.922847 15796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:05:53.923411 15796 raft_consensus.cc:606] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:53.929845 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:05:53.930387 15793 raft_consensus.cc:606] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:53.937572 15716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:53.938560 15716 raft_consensus.cc:606] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:53.942529 15716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:53.943080 15716 raft_consensus.cc:606] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:53.944409 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:53.946069 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:53.956015 16852 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.957098 16852 tablet_bootstrap.cc:492] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:53.957862 16852 ts_tablet_manager.cc:1403] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.005s
I20260709 13:05:53.965526 16852 raft_consensus.cc:359] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:53.966605 16852 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:53.967324 16852 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:53.982779 16852 ts_tablet_manager.cc:1434] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:05:53.990309 15731 tablet_copy_service.cc:342] P 8ca6a5ab086d47e5a79ef37ddead9f28: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-dbf56bc1c60545828ec946a02bb6cf8b received from {username='slave'} at 127.0.0.1:39124
I20260709 13:05:53.990736 15731 tablet_copy_service.cc:434] P 8ca6a5ab086d47e5a79ef37ddead9f28: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-dbf56bc1c60545828ec946a02bb6cf8b on tablet dbf56bc1c60545828ec946a02bb6cf8b with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:54.008594 16891 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:54.009557 16891 tablet_bootstrap.cc:492] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:05:54.010233 16891 ts_tablet_manager.cc:1403] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.122s	user 0.026s	sys 0.019s
I20260709 13:05:54.020114 16891 raft_consensus.cc:359] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:54.023485 16891 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:05:54.024260 16891 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:54.032153 16891 ts_tablet_manager.cc:1434] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:05:54.038019 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-17999909d8e0416d88f73b762dbb4bd6 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:05:54.038514 16333 raft_consensus.cc:1217] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:54.038537 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-17999909d8e0416d88f73b762dbb4bd6 on tablet 17999909d8e0416d88f73b762dbb4bd6 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:54.059477 16865 raft_consensus.cc:993] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.060241 16882 raft_consensus.cc:1081] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.062106 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56442
I20260709 13:05:54.062737 16330 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.063081 16330 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.073285 16882 raft_consensus.cc:993] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.073824 16882 raft_consensus.cc:1081] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.078723 16329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56442
I20260709 13:05:54.079258 16329 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.079604 16329 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.086599 16333 raft_consensus.cc:1217] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:54.086498 16329 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.089238 16329 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:54.090920 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:54.091583 15645 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.092648 16330 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.094801 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:54.095387 15796 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.095743 15796 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:54.096534 15796 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.109760 15796 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.110219 15645 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.112721 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:54.113034 16333 raft_consensus.cc:1217] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:54.113726 16861 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.114235 16861 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:54.115168 16861 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.115870 16330 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:54.118070 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:54.118223 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:54.118676 15720 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.118829 15792 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.119211 15792 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:54.120133 15792 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.121405 15792 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.132403 15720 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.134297 15792 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.135946 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:05:54.137353 16870 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.140343 15796 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.151753 16870 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:54.153239 16870 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.173416 15540 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.228804 15540 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.281697 16811 raft_consensus.cc:993] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.282349 16859 raft_consensus.cc:1081] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.284511 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:05:54.285065 16330 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.285559 16330 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.284997 16897 raft_consensus.cc:993] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.291076 16897 raft_consensus.cc:1081] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:54.294054 16329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:05:54.294587 16329 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.294922 16329 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.295521 16330 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.297120 16330 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:54.297794 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:54.298341 15720 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.298619 15720 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:54.299108 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:54.301115 16329 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.299335 15720 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.302306 15720 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.303750 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:54.304348 15646 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.306913 16329 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:54.307865 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:54.308435 15716 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.308720 15716 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:54.309532 15716 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.310734 15716 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.301682 15792 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.318637 15720 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.323242 16298 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:05:54.324203 16870 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.324736 16870 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:54.325670 16870 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.350715 15646 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.362581 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:54.364023 16870 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.364591 16870 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:54.365599 16870 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.367163 16885 raft_consensus.cc:993] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:54.367630 16885 raft_consensus.cc:1081] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:54.370088 15720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:05:54.370640 15720 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.370985 15720 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.363649 15540 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.377441 15720 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:54.381228 15720 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:54.415838 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:54.416594 15646 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.416985 15646 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:54.418020 15646 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:54.426190 15646 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.434216 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:54.434873 15796 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.441411 15796 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:54.451134 15716 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.451967 15646 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:54.453878 15792 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:54.456840 16330 raft_consensus.cc:1217] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:54.458009 16896 raft_consensus.cc:993] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:54.459481 16896 raft_consensus.cc:1081] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:54.456714 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:54.470520 15796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:54.471136 15796 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.471527 15796 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.471941 16811 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.476027 15541 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.481237 16811 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:54.482215 16811 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:54.538192 15541 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.540282 15796 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:54.545001 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:54.546695 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:54.547310 15716 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.547605 15716 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:54.548403 15716 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:54.547959 15796 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:54.545589 15645 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.549575 15716 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.583791 15645 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:05:54.585228 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:54.586457 16865 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:54.586977 16865 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:54.587886 16865 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:54.595577 15716 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:05:54.611838 15541 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.626793 15646 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.628048 16870 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:54.628834 15796 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.630415 16870 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:54.670387 16912 raft_consensus.cc:1064] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:54.673254 16912 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.676827 16896 raft_consensus.cc:1064] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:54.679705 16896 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.705772 16791 raft_consensus.cc:1064] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:54.726212 16330 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.727551 15792 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.729693 15639 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.732671 15792 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.731244 16811 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:54.735869 16897 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.743538 15792 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.739229 16771 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:05:54.745246 16329 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.746575 15718 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.746387 16925 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:05:54.712049 16791 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:54.753139 16885 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:05:54.794265 16913 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 13:05:54.771442 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 66833.4us
I20260709 13:05:54.850368 16862 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.856058 15718 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.856225 15716 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.856424 15720 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.879781 16929 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:54.880297 16928 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:54.881409 16929 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:54.883311 15796 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.899272 16897 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:54.927260 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 47105.4us
I20260709 13:05:54.898315 16904 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:05:55.014230 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 123629us
W20260709 13:05:55.020742 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 127943us
I20260709 13:05:55.024888 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:55.028142 15796 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:55.097051 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 62431.5us
I20260709 13:05:55.127807 15646 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:55.131270 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 97392.7us
I20260709 13:05:55.139845 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:55.143708 16330 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:55.146795 16929 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:55.178639 15646 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.190876 16939 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:55.210223 16935 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:05:55.314321 16935 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:55.332504 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 89946us
I20260709 13:05:55.380190 16334 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:55.460686 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 114564us
W20260709 13:05:55.467535 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 89289.9us
I20260709 13:05:55.473099 16963 raft_consensus.cc:1064] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:05:55.487327 15722 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:55.488696 15718 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.518929 16963 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:55.526396 15796 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:55.587209 15639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:55.601306 15639 raft_consensus.cc:606] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:55.605921 16949 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:55.606035 16935 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:55.610306 15645 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.635625 15647 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:55.747016 16969 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:55.758520 15716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.040s	sys 0.102s
W20260709 13:05:55.758911 15716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.040s	sys 0.102s
I20260709 13:05:55.790346 15796 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:55.797303 15638 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:55.799355 16333 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:55.800346 16947 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:55.805445 16885 raft_consensus.cc:993] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:55.806057 16885 raft_consensus.cc:1081] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:55.809445 15720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:05:55.810019 15720 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.810364 15720 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.811745 16947 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:55.817121 15720 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:55.822469 15720 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:05:55.823709 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:05:55.824425 16334 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.863691 15541 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:55.893963 16934 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:05:55.909873 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 273474us
I20260709 13:05:55.909660 15720 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:05:55.943324 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.980034 16980 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.998754 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 62299.2us
I20260709 13:05:55.980665 16980 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:56.002950 15720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:56.004208 15720 raft_consensus.cc:606] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:56.002592 16330 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.012919 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:56.014706 15642 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.015201 15642 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:05:56.017455 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 86806.4us
I20260709 13:05:56.036124 15796 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.043517 15640 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.034155 15642 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:05:56.083494 16978 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:05:56.084474 16962 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:05:56.086719 16334 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:56.101373 16329 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:56.102197 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 98191.8us
I20260709 13:05:56.124750 16980 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:56.157411 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:05:56.136178 16983 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:05:56.189968 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 170422us
I20260709 13:05:56.163548 15642 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.235046 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:56.238914 15641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:56.239640 15641 raft_consensus.cc:606] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:05:56.240777 16988 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:05:56.255110 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 94364.9us
I20260709 13:05:56.257418 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:56.266487 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:05:56.280491 16970 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.267642 16771 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.286796 16334 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.271543 16868 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:56.299201 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 106377us
I20260709 13:05:56.291265 16970 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:05:56.317085 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 71980.8us
I20260709 13:05:56.330873 16997 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:05:56.332782 15642 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:56.341060 16970 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.379421 16947 raft_consensus.cc:993] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:56.386313 16962 raft_consensus.cc:1081] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:56.402745 16947 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:05:56.417479 16947 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.419602 16947 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:05:56.422691 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:05:56.414515 16334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:05:56.477043 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:05:56.487742 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:56.501777 15715 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.487639 16334 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.500571 16865 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.513072 16947 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:56.514732 16334 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.534690 15644 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.531080 16333 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.567636 16885 raft_consensus.cc:993] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:56.568198 16885 raft_consensus.cc:1081] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:56.570945 15718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:05:56.571583 15718 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.571966 15718 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.597675 15540 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.597211 15718 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.615607 16334 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.624993 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:05:56.625598 16333 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.627671 15796 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.642695 16333 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:56.646915 15718 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:05:56.669346 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:56.669972 15715 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.670260 15715 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:56.670950 15715 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.671615 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:05:56.671784 15715 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.673205 16997 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.675042 16997 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:56.671871 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:05:56.676081 15791 raft_consensus.cc:606] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:56.676091 16997 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.677995 16334 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:56.679813 15715 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:56.680948 16298 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:05:56.686544 17003 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.687083 17003 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:56.694469 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:56.695168 15647 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.688000 17003 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.721781 15647 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:05:56.727435 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:56.728127 15644 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.728416 15644 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:56.729146 15644 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.730378 15644 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.729269 15640 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.741729 15647 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:56.745622 15644 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:56.862591 15638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:56.863325 15638 raft_consensus.cc:606] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:56.880239 16334 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:56.882653 16970 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:56.892797 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:56.895125 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:56.919605 15640 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:56.917297 15541 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.931259 15545 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 122) took 1091 ms. Trace:
I20260709 13:05:56.931785 15545 rpcz_store.cc:276] 0709 13:05:55.840171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.840346 (+   175us) service_pool.cc:224] Handling call
0709 13:05:56.931064 (+1090718us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5432,"reported_tablets":7}
I20260709 13:05:56.926851 15713 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.951759 15641 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.955477 15791 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:56.973819 16330 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:56.975354 16865 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:56.976990 15714 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:56.983697 15545 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 2 to 3, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.987157 16935 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:05:56.985723 15545 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.006489 15714 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.001423 15796 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.001955 16997 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:57.013236 16333 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.015583 15796 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.996136 16935 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.007383 15545 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.009063 16330 raft_consensus.cc:2955] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:56.999001 16334 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.018211 16963 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.031581 16965 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.042016 16971 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:05:57.055553 16913 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:57.070278 16968 raft_consensus.cc:993] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:57.070881 16968 raft_consensus.cc:1081] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:57.087550 15796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56124
I20260709 13:05:57.088359 15796 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.088766 15796 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.103017 15796 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:57.113579 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:57.114588 15796 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:05:57.115161 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:05:57.115206 15647 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:57.122484 16333 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.131706 15796 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.133917 16334 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.137153 16939 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:57.129977 15647 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:57.138563 15647 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:57.139770 15647 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.123747 16971 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.157289 15542 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.178869 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17999909d8e0416d88f73b762dbb4bd6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:57.186463 15647 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:57.190943 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:57.191911 17000 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:57.200714 16334 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:57.197857 16329 raft_consensus.cc:2955] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.204658 17000 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:57.210806 17000 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:57.213346 15545 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 4 to 5, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.224202 16993 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.227087 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5622436c83fb41fa8923df2295b99818 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:57.229118 15647 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.231817 15796 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.234485 15641 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.235821 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet 17999909d8e0416d88f73b762dbb4bd6 with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:57.252331 16930 raft_consensus.cc:993] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:57.252940 16961 raft_consensus.cc:1081] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:57.248310 16997 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:57.252957 16933 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:05:57.261111 15545 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 3 to 4, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 1 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.265041 15714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:05:57.265625 15714 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:57.265978 15714 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.291868 15714 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:57.302781 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:57.303773 15796 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:57.304347 15796 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:57.306411 15714 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:57.305461 15796 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:57.308059 15796 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.315948 15714 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:57.322062 16330 raft_consensus.cc:2955] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.323298 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:57.323931 15640 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.340512 15796 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:05:57.341984 15545 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 3 to 4, VOTER fec10611791a4ab384f86b212249410e (127.14.45.1) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.343432 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet 5622436c83fb41fa8923df2295b99818 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47688
I20260709 13:05:57.344053 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 356b3bbf62c44a84bc360356d580684d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:57.345717 15718 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.341972 15685 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:57.358806 16993 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:57.359349 16993 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:57.360163 16993 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:57.367148 17003 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:57.381847 17026 tablet_replica.cc:333] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:57.383071 17026 raft_consensus.cc:2243] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.384397 17026 raft_consensus.cc:2272] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.397657 15640 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:05:57.409044 16330 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.423120 15540 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.449156 15636 tablet_service.cc:1558] Processing DeleteTablet for tablet 356b3bbf62c44a84bc360356d580684d with delete_type TABLET_DATA_TOMBSTONED (TS fec10611791a4ab384f86b212249410e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42116
I20260709 13:05:57.463167 17029 tablet_replica.cc:333] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
W20260709 13:05:57.487100 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 93436.8us
I20260709 13:05:57.497064 15641 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.526042 16963 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:05:57.561497 17026 ts_tablet_manager.cc:1916] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.566452 16993 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.559898 17029 raft_consensus.cc:2243] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.573195 17029 raft_consensus.cc:2272] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.575997 17029 ts_tablet_manager.cc:1916] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:05:57.589979 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 175804us
I20260709 13:05:57.616477 16333 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.626430 16935 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:05:57.629698 16939 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.660665 15540 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.699219 15638 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.700489 17029 ts_tablet_manager.cc:1929] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.701004 17029 log.cc:1199] T 5622436c83fb41fa8923df2295b99818 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/5622436c83fb41fa8923df2295b99818
I20260709 13:05:57.702775 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet 5622436c83fb41fa8923df2295b99818 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:57.740644 15530 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbf56bc1c60545828ec946a02bb6cf8b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:57.767505 17026 ts_tablet_manager.cc:1929] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:05:57.769419 17026 log.cc:1199] T 17999909d8e0416d88f73b762dbb4bd6 P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/17999909d8e0416d88f73b762dbb4bd6
I20260709 13:05:57.771811 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet 17999909d8e0416d88f73b762dbb4bd6 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
W20260709 13:05:57.782110 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50524.5us
I20260709 13:05:57.789389 15540 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e reported cstate change: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 1 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.795011 15647 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.803226 17000 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:57.804081 16330 raft_consensus.cc:2955] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:05:57.818305 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet dbf56bc1c60545828ec946a02bb6cf8b with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56118
I20260709 13:05:57.833348 17044 tablet_replica.cc:333] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:05:57.846303 17026 tablet_replica.cc:333] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:05:57.854815 17044 raft_consensus.cc:2243] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.855703 17044 raft_consensus.cc:2272] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.859557 15791 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.862603 17026 raft_consensus.cc:2243] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.863526 17026 raft_consensus.cc:2272] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.868189 17026 ts_tablet_manager.cc:1916] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.871870 16939 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.861501 17044 ts_tablet_manager.cc:1916] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.892194 15647 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.895165 16939 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.896371 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:57.938011 17026 ts_tablet_manager.cc:1929] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.938563 17026 log.cc:1199] T 356b3bbf62c44a84bc360356d580684d P fec10611791a4ab384f86b212249410e: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/wals/356b3bbf62c44a84bc360356d580684d
I20260709 13:05:57.940555 15532 catalog_manager.cc:5028] TS fec10611791a4ab384f86b212249410e (127.14.45.1:46181): tablet 356b3bbf62c44a84bc360356d580684d (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:57.993820 17044 ts_tablet_manager.cc:1929] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.997685 17044 log.cc:1199] T dbf56bc1c60545828ec946a02bb6cf8b P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/dbf56bc1c60545828ec946a02bb6cf8b
I20260709 13:05:58.000042 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet dbf56bc1c60545828ec946a02bb6cf8b (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:05:58.026806 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:58.092453 15641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76331ca323724c289906034e280e8274"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:58.093166 15641 raft_consensus.cc:606] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:58.101547 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:58.102252 15713 raft_consensus.cc:606] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:58.106703 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:58.107357 15713 raft_consensus.cc:606] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:58.112387 15641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:58.113034 15641 raft_consensus.cc:606] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:58.117949 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:05:58.118475 15789 raft_consensus.cc:606] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:58.119689 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:58.121443 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:58.201651 17034 raft_consensus.cc:993] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:58.203287 17034 raft_consensus.cc:1081] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:58.205603 15714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:05:58.206295 15714 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.206698 15714 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.214581 15714 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.217708 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:58.218364 15641 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.226649 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:58.227444 15789 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:58.227813 15789 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:58.228814 15789 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.230738 15789 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.238904 15641 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:05:58.243748 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:58.244715 16963 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:58.245323 16963 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:58.246457 16963 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.242305 15714 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:58.298166 15789 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:05:58.305243 15541 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.355504 16963 raft_consensus.cc:993] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:58.356043 16963 raft_consensus.cc:1081] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:05:58.359038 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:05:58.359622 16330 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.359982 16330 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.374006 16330 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:58.377775 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:58.378369 15647 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.385519 15647 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:05:58.387463 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:58.388653 17032 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:58.389235 17032 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:05:58.389757 16971 raft_consensus.cc:993] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:58.390303 16971 raft_consensus.cc:1081] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:58.393029 16330 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:58.394929 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:58.395584 15714 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:58.395880 15714 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:58.390292 17032 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:58.396651 15714 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:05:58.397998 15714 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.405082 16971 raft_consensus.cc:993] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:58.405260 15714 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:05:58.405697 16913 raft_consensus.cc:1081] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:58.408654 15714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:05:58.409179 15714 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.409533 15714 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.411953 15789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76331ca323724c289906034e280e8274"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56124
I20260709 13:05:58.412586 15789 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.412953 15789 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.424700 15789 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.429111 15714 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.434095 15714 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:58.434243 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:58.434940 15792 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.437984 15789 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:58.437894 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:58.440546 15647 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.439282 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:58.441850 15641 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.442162 15641 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:58.438982 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:58.442942 15714 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.442849 15641 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.444145 15641 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.449862 15647 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:05:58.459981 15647 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.463855 15647 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.464062 15792 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:58.465394 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:05:58.466370 16963 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.466912 16963 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:58.467382 15641 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:05:58.467818 16963 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.474287 15647 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:58.469621 15714 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:05:58.476120 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:58.476935 16865 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.477445 16865 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:58.478498 16865 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.499393 15541 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.506717 15542 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.521823 16939 raft_consensus.cc:993] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:58.522398 16939 raft_consensus.cc:1081] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:05:58.528092 15792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56120
I20260709 13:05:58.528654 15792 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.529021 15792 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.544621 15542 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 3 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.594724 15792 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.597317 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:05:58.597915 15641 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.607074 15792 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:05:58.608326 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:05:58.608909 15714 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:58.609184 15714 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:05:58.609856 15714 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.610926 15714 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.612684 15641 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:05:58.614219 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:05:58.617190 16865 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:58.618703 16865 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:58.619745 16865 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:58.617106 15714 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:05:58.630901 15542 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.631621 15792 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:58.633478 16939 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:58.679237 15641 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:58.682329 16939 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:58.911134 15714 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.916425 16961 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.926597 15641 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:58.931913 15647 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.944187 16961 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:58.946002 15714 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:58.947919 17032 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:58.967629 15789 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.978650 15644 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:58.979733 16939 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:58.992663 17032 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:05:59.000932 15610 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17db433a32844f26aa2fe7c2d4e4bf66. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.004614 15714 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:59.007972 15792 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:59.007891 17058 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:59.014818 17061 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:59.017217 15644 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.020999 16963 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:05:59.084182 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 47105.1us
I20260709 13:05:59.176612 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.182135 15647 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:59.325263 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54765.6us
W20260709 13:05:59.373519 17079 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:05:59.383885 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43886.6us
W20260709 13:05:59.375613 17075 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:05:59.421670 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 220508us
I20260709 13:05:59.431600 15714 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
W20260709 13:05:59.470810 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 362929us
W20260709 13:05:59.474507 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67683.3us
I20260709 13:05:59.394724 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.535684 17087 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:05:59.586637 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 57778.4us
W20260709 13:05:59.666471 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 57995.9us
I20260709 13:05:59.674310 15789 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:59.686546 15720 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.700245 17060 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:59.702647 17102 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.726544 17110 ts_tablet_manager.cc:933] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181)
I20260709 13:05:59.739121 15541 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 2 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:59.754640 17110 tablet_copy_client.cc:323] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.1:46181
I20260709 13:05:59.813351 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:05:59.819856 15793 raft_consensus.cc:606] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:05:59.833760 15657 tablet_copy_service.cc:140] P fec10611791a4ab384f86b212249410e: Received BeginTabletCopySession request for tablet 17db433a32844f26aa2fe7c2d4e4bf66 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:35384)
I20260709 13:05:59.834661 15657 tablet_copy_service.cc:161] P fec10611791a4ab384f86b212249410e: Beginning new tablet copy session on tablet 17db433a32844f26aa2fe7c2d4e4bf66 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:35384: session id = 228b1ac5589e48af9bbf6caecd6aeaea-17db433a32844f26aa2fe7c2d4e4bf66
I20260709 13:05:59.838238 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:59.839871 15713 raft_consensus.cc:606] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:05:59.849823 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:05:59.852440 15713 raft_consensus.cc:606] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:05:59.855659 15657 tablet_copy_source_session.cc:215] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:59.859889 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17db433a32844f26aa2fe7c2d4e4bf66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.870350 15647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:05:59.871137 15647 raft_consensus.cc:606] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:05:59.878574 15789 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:05:59.896167 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:59.897833 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:59.915282 15759 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b106b4017dc84b21a7c6f58814593886. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.915443 15720 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:59.921641 15644 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:59.925355 17078 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.926196 17034 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:59.928500 17078 raft_consensus.cc:993] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:59.929054 17078 raft_consensus.cc:1081] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:05:59.934545 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:05:59.935134 15713 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.935571 15713 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.945861 16865 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:59.948741 15644 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:59.950825 15713 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:05:59.959967 15713 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:05:59.960927 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:05:59.961591 15789 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.961977 15789 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:05:59.972540 15713 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:05:59.999642 15791 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:00.007121 15541 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 5, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.029517 15789 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:00.043601 15789 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.035125 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:00.048871 15644 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.064505 15644 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:00.047034 17110 tablet_copy_client.cc:806] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:00.065927 17110 tablet_copy_client.cc:670] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:00.067613 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:00.068698 17085 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.069180 17085 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:00.070015 17085 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:00.077929 15759 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d1a63ae20354b95b7bd0e7365b598f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.078922 15644 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:00.080685 15713 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:00.081377 16865 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.090061 15789 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:00.100322 17110 tablet_copy_client.cc:538] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:00.094619 17077 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:00.103231 17080 raft_consensus.cc:993] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:00.103760 17080 raft_consensus.cc:1081] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:00.109082 15545 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.112423 15645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:06:00.113008 15645 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.113354 15645 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.122545 15645 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:00.127240 15645 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:00.128000 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:00.128660 15714 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.128966 15714 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:00.129801 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:00.129806 15714 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:00.132681 15791 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.133095 15714 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.132128 17087 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.138442 15647 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.140139 15714 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:00.141328 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:00.145646 17060 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.147249 17060 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:00.148205 17060 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:00.138929 15713 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.159544 17110 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:06:00.171311 17105 raft_consensus.cc:993] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:06:00.172048 17085 raft_consensus.cc:1081] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer 228b1ac5589e48af9bbf6caecd6aeaea to start an election
I20260709 13:06:00.184130 15791 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:00.194384 16333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d"
dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:06:00.195046 16333 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.195461 16333 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.191780 15545 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 2, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 1 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.217437 16333 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:00.222021 15791 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:00.225404 17086 raft_consensus.cc:993] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:06:00.226056 17086 raft_consensus.cc:1081] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:06:00.230157 15796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56124
I20260709 13:06:00.230732 15796 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.231112 15796 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.232599 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:00.233204 15793 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.241374 15796 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:00.244437 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:00.245179 15793 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:00.245870 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:00.246507 16330 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.247898 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:00.248903 17084 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.249421 17084 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:00.250336 17084 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:00.252866 16330 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:00.245055 15647 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.256024 15647 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:00.256050 15796 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:00.258971 15647 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:00.260248 15647 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.258649 15541 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.266543 15647 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:00.267141 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:00.268034 17087 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.268601 17087 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:00.269562 17087 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:00.274765 16333 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:00.302244 15759 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 -> Peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Couldn't send request to peer 228b1ac5589e48af9bbf6caecd6aeaea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00f37d51951a494996e57f1247bd69ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.304914 15714 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:00.306442 16865 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.327340 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:00.327998 15720 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.326762 15541 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.328315 15720 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:00.329643 15720 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:00.333393 15720 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.333599 15647 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:00.335824 17108 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.337668 15545 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.377368 15720 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:00.420957 17110 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.460100 17110 tablet_bootstrap.cc:492] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:06:00.467414 17110 ts_tablet_manager.cc:1403] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.308s	user 0.015s	sys 0.028s
I20260709 13:06:00.470029 17078 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.471125 17110 raft_consensus.cc:359] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:00.471993 17110 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:06:00.473875 15714 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.491876 17134 ts_tablet_manager.cc:933] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:00.502734 17110 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:00.505795 17110 ts_tablet_manager.cc:1434] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:06:00.539835 16333 raft_consensus.cc:1217] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:00.561391 15657 tablet_copy_service.cc:342] P fec10611791a4ab384f86b212249410e: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-17db433a32844f26aa2fe7c2d4e4bf66 received from {username='slave'} at 127.0.0.1:35384
I20260709 13:06:00.561877 15657 tablet_copy_service.cc:434] P fec10611791a4ab384f86b212249410e: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-17db433a32844f26aa2fe7c2d4e4bf66 on tablet 17db433a32844f26aa2fe7c2d4e4bf66 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:00.563417 15647 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.568501 15713 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.574816 15545 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index -1 to 3, NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) added. New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:00.600395 17110 ts_tablet_manager.cc:933] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:00.602546 16913 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.627025 15641 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.640709 15791 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.652115 16963 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:00.654080 16970 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.661098 15796 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.659669 17110 tablet_copy_client.cc:323] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:06:00.669633 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 3d1a63ae20354b95b7bd0e7365b598f8 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:06:00.670579 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 3d1a63ae20354b95b7bd0e7365b598f8 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-3d1a63ae20354b95b7bd0e7365b598f8
I20260709 13:06:00.661177 17134 tablet_copy_client.cc:323] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
I20260709 13:06:00.675129 15805 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet b106b4017dc84b21a7c6f58814593886 from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:06:00.675760 15805 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet b106b4017dc84b21a7c6f58814593886 from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-b106b4017dc84b21a7c6f58814593886
I20260709 13:06:00.698210 17058 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.736640 15806 tablet_copy_source_session.cc:215] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.737063 15805 tablet_copy_source_session.cc:215] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.742465 17134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b106b4017dc84b21a7c6f58814593886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.742673 15793 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.744267 16933 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:00.756644 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1a63ae20354b95b7bd0e7365b598f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.807096 15714 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.812568 17084 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:00.828428 16329 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.831409 17078 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:00.873677 17136 ts_tablet_manager.cc:933] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:00.894954 15647 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.896622 17034 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:00.898730 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:00.964883 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44473.5us
I20260709 13:06:00.983605 17136 tablet_copy_client.cc:323] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Beginning tablet copy session from remote peer at address 127.14.45.3:35499
W20260709 13:06:00.986956 17146 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:01.001719 15806 tablet_copy_service.cc:140] P c1927141dc2540dab644a00fd6843fc6: Received BeginTabletCopySession request for tablet 00f37d51951a494996e57f1247bd69ee from peer 228b1ac5589e48af9bbf6caecd6aeaea ({username='slave'} at 127.0.0.1:44878)
I20260709 13:06:01.002444 15806 tablet_copy_service.cc:161] P c1927141dc2540dab644a00fd6843fc6: Beginning new tablet copy session on tablet 00f37d51951a494996e57f1247bd69ee from peer 228b1ac5589e48af9bbf6caecd6aeaea at {username='slave'} at 127.0.0.1:44878: session id = 228b1ac5589e48af9bbf6caecd6aeaea-00f37d51951a494996e57f1247bd69ee
I20260709 13:06:01.011194 15806 tablet_copy_source_session.cc:215] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.996089 17134 tablet_copy_client.cc:806] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:01.035355 17134 tablet_copy_client.cc:670] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:01.112561 17147 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:01.174685 17136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f37d51951a494996e57f1247bd69ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:01.228724 17152 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:06:01.248359 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 152756us
W20260709 13:06:01.315676 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 67716.5us
W20260709 13:06:01.412792 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 78105.6us
I20260709 13:06:01.442665 17134 tablet_copy_client.cc:538] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:01.474099 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 87091.9us
W20260709 13:06:01.540135 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 136758us
W20260709 13:06:01.554369 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 122396us
W20260709 13:06:01.583168 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 189292us
W20260709 13:06:01.548600 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53328.9us
W20260709 13:06:01.628582 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 188165us
W20260709 13:06:01.703202 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 45694.1us
I20260709 13:06:01.719662 17110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56442 (request call id 310) took 1132 ms. Trace:
I20260709 13:06:01.720124 17110 rpcz_store.cc:276] 0709 13:06:00.587178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.587293 (+   115us) service_pool.cc:224] Handling call
0709 13:06:00.600983 (+ 13690us) ts_tablet_manager.cc:934] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
0709 13:06:00.754986 (+154003us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:01.250583 (+495597us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:01.266719 (+ 16136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:01.705123 (+438404us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:01.719120 (+ 13997us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:01.719412 (+   292us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:01.719596 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19845,"tablet-copy.queue_time_us":12657,"thread_start_us":72191,"threads_started":2}
I20260709 13:06:01.721568 17110 tablet_copy_client.cc:806] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:01.731760 17110 tablet_copy_client.cc:670] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:01.762704 17172 raft_consensus.cc:1064] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:01.785234 17134 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
W20260709 13:06:01.790270 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 207898us
I20260709 13:06:01.872054 17136 tablet_copy_client.cc:806] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:01.880511 17136 tablet_copy_client.cc:670] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:01.880432 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 72460.3us
W20260709 13:06:01.988646 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 104054us
I20260709 13:06:01.821287 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:02.067903 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77607.8us
I20260709 13:06:02.079317 17136 tablet_copy_client.cc:538] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:02.108631 17110 tablet_copy_client.cc:538] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:02.045506 17172 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:02.177958 17136 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:06:02.195747 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:06:02.196339 15789 raft_consensus.cc:606] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:02.211931 15644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95371a1d960048e7af7796052350a058"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:02.213054 15644 raft_consensus.cc:606] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:02.240437 16329 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:02.254009 15714 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:02.260113 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:06:02.260751 15713 raft_consensus.cc:606] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:02.262902 17110 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap starting.
I20260709 13:06:02.264253 17180 raft_consensus.cc:993] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:06:02.264998 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:02.268137 17180 raft_consensus.cc:1081] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:06:02.268647 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:02.270632 17058 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:02.275702 15789 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:02.298096 17157 raft_consensus.cc:993] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: : Instructing follower c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:06:02.298621 17157 raft_consensus.cc:1081] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Signalling peer c1927141dc2540dab644a00fd6843fc6 to start an election
I20260709 13:06:02.306347 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:06:02.307006 15715 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.307374 15715 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.318527 17195 raft_consensus.cc:993] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:02.318682 15715 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.319132 17195 raft_consensus.cc:1081] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:02.320964 15715 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:02.322253 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:02.322871 15789 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.323194 15789 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:02.324030 15789 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.325290 15789 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.339982 15789 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:02.341161 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:02.316028 17157 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:06:02.343494 15792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95371a1d960048e7af7796052350a058"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:56124
I20260709 13:06:02.344113 15792 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.344543 15792 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.344270 17155 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:02.344156 15642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:06:02.345335 17155 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:02.345544 15642 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.346065 15642 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.346329 17155 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.350903 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:02.351585 15640 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.357470 17086 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:02.364230 15792 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.374927 15792 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:02.376363 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:02.377158 15717 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.377826 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:02.379132 15641 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.379417 15641 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:02.380146 15641 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.385812 15641 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.415326 15641 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:02.388044 15640 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:02.424012 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:02.427757 15717 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:02.389127 15642 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.435833 17177 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:02.475719 15642 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:02.481487 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:02.482100 15793 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.456703 17177 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:02.487371 17177 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.535614 15794 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:02.537587 17153 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:02.572141 15793 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:02.576565 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:02.578337 17086 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:02.584662 17086 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:02.585597 17086 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:02.585516 17134 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.620342 17134 tablet_bootstrap.cc:492] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:06:02.623667 17136 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.626323 17134 ts_tablet_manager.cc:1403] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 0.844s	user 0.029s	sys 0.013s
I20260709 13:06:03.064711 17136 tablet_bootstrap.cc:492] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:06:03.203573 17136 ts_tablet_manager.cc:1403] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 1.029s	user 0.025s	sys 0.023s
W20260709 13:06:03.265915 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 50261.7us
W20260709 13:06:03.392992 17202 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:06:03.404160 17211 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:06:03.419021 17134 raft_consensus.cc:359] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:03.420157 17134 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:06:03.420949 17134 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:03.462472 17136 raft_consensus.cc:359] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:03.466681 17136 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:06:03.467665 17136 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:03.471503 17136 ts_tablet_manager.cc:1434] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.201s	user 0.006s	sys 0.003s
I20260709 13:06:03.476045 17134 ts_tablet_manager.cc:1434] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.814s	user 0.012s	sys 0.000s
W20260709 13:06:03.476574 17134 ts_tablet_manager.cc:1467] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Tablet startup took 818ms
I20260709 13:06:03.480742 17110 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.482100 17110 tablet_bootstrap.cc:492] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Bootstrap complete.
I20260709 13:06:03.483075 17110 ts_tablet_manager.cc:1403] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent bootstrapping tablet: real 1.260s	user 0.032s	sys 0.002s
W20260709 13:06:03.476984 17134 ts_tablet_manager.cc:1469] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Trace:
0709 13:06:00.448891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.449034 (+   143us) service_pool.cc:224] Handling call
0709 13:06:00.492681 (+ 43647us) ts_tablet_manager.cc:934] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Initiating tablet copy from peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
0709 13:06:00.741226 (+248545us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:00.752857 (+ 11631us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:00.752977 (+   120us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:00.817446 (+ 64469us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:00.893993 (+ 76547us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:00.967572 (+ 73579us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:00.976810 (+  9238us) inbound_call.cc:177] Queueing success response
0709 13:06:01.295330 (+318520us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b1800278c20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad221bded8 00007fad22318de2 00007fad2a37dd23 00007fad2a37d55d 00007fad2a4193d8 00007fad2a44af4e 00007fad2a42ffdd
0709 13:06:01.781644 (+486314us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:02.661687 (+880043us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:02.952389 (+290702us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:02.953269 (+   880us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":21112,"mutex_wait_us":87576,"raft.queue_time_us":1181,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":611,"spinlock_wait_cycles":43131264,"tablet-copy.queue_time_us":20325,"tablet-download-pool.queue_time_us":22886,"tablet-download-pool.run_cpu_time_us":1703,"tablet-download-pool.run_wall_time_us":294379,"thread_start_us":182038,"threads_started":2}
I20260709 13:06:03.498737 17110 raft_consensus.cc:359] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:03.499675 17110 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Initialized, Role: LEARNER
I20260709 13:06:03.524686 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:03.533492 15688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.004s
W20260709 13:06:03.534340 15688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.006s	sys 0.004s
W20260709 13:06:03.536863 15686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.009s
W20260709 13:06:03.537389 15686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.001s	sys 0.009s
I20260709 13:06:03.561439 17214 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:03.562810 17214 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:06:03.566576 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 298762us
I20260709 13:06:03.500492 17110 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:03.593107 17110 ts_tablet_manager.cc:1434] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent starting tablet: real 0.109s	user 0.011s	sys 0.000s
I20260709 13:06:03.607950 16329 raft_consensus.cc:1217] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:03.608820 16333 raft_consensus.cc:1217] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:06:03.617342 16333 raft_consensus.cc:1217] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.619764 17219 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:03.624783 17219 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:03.628458 17219 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:03.661515 17214 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:03.714664 17232 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:03.715533 17232 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:03.718257 17232 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:03.730640 17212 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:03.731685 17212 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:03.742201 17212 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:03.881594 17232 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:03.882748 17232 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:03.926599 17213 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:03.927742 17213 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:03.931499 17213 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:04.054008 17222 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.055248 17222 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.058640 17222 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:04.059414 17222 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:04.060344 17222 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.063328 17222 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:04.064123 17222 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.065026 17222 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.077044 17222 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:04.081882 17232 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.129653 17219 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:04.382354 17235 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:04.383078 17219 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:04.386149 17232 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.386943 17232 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.389678 17232 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.391410 17219 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:04.210914 17234 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:04.392840 17234 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:04.395973 17234 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:04.457316 17234 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.458271 17232 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.460734 17233 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:04.383131 17235 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.463531 17232 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.463555 17233 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:04.463070 17234 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.470788 17232 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.471808 17233 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:04.472537 17233 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:04.473208 17233 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:04.474032 17235 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.474781 17235 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:04.471513 17232 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:04.475770 17233 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:04.478868 17233 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.478484 17235 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.484006 17235 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.478503 17232 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.481287 17233 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.480000 17236 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:04.485975 17232 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.482187 17234 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.485988 17233 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.486527 17236 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:04.489698 17236 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:04.490442 17234 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.491525 17234 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.493696 17234 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:04.551854 16865 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.552841 16865 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.555709 16865 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:04.701661 15668 debug-util.cc:398] Leaking SignalData structure 0x7b080031c2a0 after lost signal to thread 14519
I20260709 13:06:04.787806 17212 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.788826 17212 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:04.791985 17212 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.124429 17177 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.125469 17177 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.130493 17177 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.165297 17241 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.166441 17241 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.167044 17239 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.168057 17239 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:05.169723 15542 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.170756 17241 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.171077 17239 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.171674 17241 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.172263 17239 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.172610 17241 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.173950 17239 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.176721 17239 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.176891 17241 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.180464 17058 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.180446 17242 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.181322 17058 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.182036 17242 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.184120 17058 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.185060 17239 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.179795 17240 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.186080 17239 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.187744 17058 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.188707 17239 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.186303 17240 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.177860 17241 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.190702 17241 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.191781 17244 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.192679 17239 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.194964 17240 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.188864 17058 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.198585 17240 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.198660 17244 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.199242 17240 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:05.200811 15611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.004s	sys 0.028s
W20260709 13:06:05.201197 15611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.005s	sys 0.028s
I20260709 13:06:05.207930 17157 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.208601 17157 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.210374 17084 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.211041 17084 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.201299 17240 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.216572 17086 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.202292 17239 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.218739 17086 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.197949 17242 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.201152 17244 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.220860 17239 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.253592 17058 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.225710 17084 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.258680 17241 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.220880 17086 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.273681 17226 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.270560 17157 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.282085 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.274595 17226 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.284267 17230 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.285147 17086 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.285375 15642 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.285928 17239 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.259778 17168 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.287496 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.275147 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.288928 17241 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.294147 15720 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.288807 17058 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.298753 17086 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.298870 17239 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.299949 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.301172 17086 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.290794 15719 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:05.301518 17239 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.294010 17084 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.301858 17246 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.302416 17168 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.302983 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.301198 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.303345 17230 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.305851 17239 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.306463 17246 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.310207 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.310832 15716 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:05.314103 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.315304 17168 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.315876 17168 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.316512 17246 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.316406 17168 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.317210 17084 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.317827 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.318790 15721 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:05.313364 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.306742 17241 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.320323 17084 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.304528 17086 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.310333 17244 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.383908 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65726us
I20260709 13:06:05.385030 17230 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:05.390822 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003202c0 after lost signal to thread 15579
I20260709 13:06:05.376271 17226 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.308568 17245 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.331631 17239 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.313851 17058 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.398483 17239 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.399128 17058 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.400722 17168 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.401670 17086 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:05.404377 17086 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.405107 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.382658 17244 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.408411 17244 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.395087 17245 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.406136 15647 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:05.412060 17245 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.412847 17241 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:05.425231 15611 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.201s (SENT) [suppressed 48 similar messages]
W20260709 13:06:05.492264 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 67094.4us
I20260709 13:06:05.503820 17127 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.504606 17127 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:05.513525 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08000bfc80 after lost signal to thread 15671
I20260709 13:06:05.518128 17127 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.535434 17185 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.529717 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:05.544744 17185 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.555974 17185 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.558171 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.558658 17249 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.559423 17249 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.566560 15647 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.572387 15545 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 143) took 1926 ms. Trace:
I20260709 13:06:05.572970 15545 rpcz_store.cc:276] 0709 13:06:03.645779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.646049 (+   270us) service_pool.cc:224] Handling call
0709 13:06:05.572150 (+1926101us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:06:05.575445 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.576169 15542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 272) took 1951 ms. Trace:
I20260709 13:06:05.574632 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1474) took 1911 ms. Trace:
I20260709 13:06:05.587144 15713 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:05.592242 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.593116 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.593369 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.596725 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.596853 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.587702 15713 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:05.591552 15806 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-00f37d51951a494996e57f1247bd69ee received from {username='slave'} at 127.0.0.1:44878
I20260709 13:06:05.586679 15789 rpcz_store.cc:276] 0709 13:06:03.663075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.573304 (+1910229us) service_pool.cc:224] Handling call
0709 13:06:05.573716 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.574090 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.574125 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:05.574194 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:05.574225 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.574281 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.574418 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:05.574956 17226 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.575667 17155 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.609611 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.610383 15794 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:05.610658 17034 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.610549 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.613942 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.606423 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:05.601594 16970 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.619720 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.613677 15790 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.591080 17185 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.611440 17034 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.619439 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.619338 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.618218 16333 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:05.609709 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.624456 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.624743 15806 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-00f37d51951a494996e57f1247bd69ee on tablet 00f37d51951a494996e57f1247bd69ee with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:05.625138 17180 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.625566 17226 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.613754 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.619879 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.597918 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.629855 15804 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-3d1a63ae20354b95b7bd0e7365b598f8 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:06:05.632051 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.632570 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.633203 15793 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:05.634114 15722 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.634342 17214 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.621387 16970 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.627439 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.634972 17214 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.659742 17034 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.659967 17249 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.660661 17214 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.661959 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:05.664713 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.665073 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.666148 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.666292 17174 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.666568 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:05.667196 15804 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-3d1a63ae20354b95b7bd0e7365b598f8 on tablet 3d1a63ae20354b95b7bd0e7365b598f8 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:05.662804 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.668552 15713 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.669149 17213 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.668988 17086 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.666873 17174 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.664324 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.669811 17213 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.672842 17231 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:05.673225 17086 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.673465 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.673779 17086 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.674021 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.674638 17213 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.674693 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.675182 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.673305 17231 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.669617 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.677182 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.634387 15540 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.681936 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.682073 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:05.683148 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5460 after lost signal to thread 15746
W20260709 13:06:05.683369 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5140 after lost signal to thread 15747
I20260709 13:06:05.684268 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.684151 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.684852 15644 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:05.660655 17078 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.688565 15805 tablet_copy_service.cc:342] P c1927141dc2540dab644a00fd6843fc6: Request end of tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-b106b4017dc84b21a7c6f58814593886 received from {username='slave'} at 127.0.0.1:44878
I20260709 13:06:05.689078 15805 tablet_copy_service.cc:434] P c1927141dc2540dab644a00fd6843fc6: ending tablet copy session 228b1ac5589e48af9bbf6caecd6aeaea-b106b4017dc84b21a7c6f58814593886 on tablet b106b4017dc84b21a7c6f58814593886 with peer 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:05.688787 17078 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.689869 17220 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.694231 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.695343 15719 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.679584 17231 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.691174 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.635561 17185 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.625782 17180 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.705199 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.705605 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.705560 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.686081 17213 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.629026 17155 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.696365 17218 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:05.706449 17127 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.708947 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:05.709681 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 69346.4us
I20260709 13:06:05.709365 17127 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.710157 16963 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.691272 17200 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.736114 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.704906 17084 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.738358 17084 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.739492 17034 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.585729 15542 rpcz_store.cc:276] 0709 13:06:03.624265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.110519 (+1486254us) service_pool.cc:224] Handling call
0709 13:06:05.576065 (+465546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.193512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.194241 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.194306 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:06:05.194341 (+    35us) tablet.cc:662] Decoding operations
0709 13:06:05.194812 (+   471us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.194926 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.194959 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:05.195301 (+   342us) tablet.cc:701] Row locks acquired
0709 13:06:05.195358 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:06:05.195541 (+   183us) write_op.cc:270] Start()
0709 13:06:05.195718 (+   177us) write_op.cc:276] Timestamp: P: 1783602365195471 usec, L: 0
0709 13:06:05.195757 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.196643 (+   886us) log.cc:844] Serialized 535 byte log entry
0709 13:06:05.377355 (+180712us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.420307 (+ 42952us) write_op.cc:301] APPLY: starting
0709 13:06:05.457801 (+ 37494us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.492545 (+ 34744us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.496403 (+  3858us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.525294 (+ 28891us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.525587 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:05.525661 (+    74us) write_op.cc:312] APPLY: finished
0709 13:06:05.526019 (+   358us) log.cc:844] Serialized 23 byte log entry
0709 13:06:05.527166 (+  1147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.527268 (+   102us) write_op.cc:454] Released schema lock
0709 13:06:05.527342 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.527853 (+   511us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.527887 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47274,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":41344,"apply.run_cpu_time_us":3318,"apply.run_wall_time_us":108709,"num_ops":1,"prepare.queue_time_us":15904,"prepare.run_cpu_time_us":17719,"prepare.run_wall_time_us":87190,"raft.queue_time_us":68537,"raft.run_cpu_time_us":3219,"raft.run_wall_time_us":44598,"replication_time_us":181382,"thread_start_us":150639,"threads_started":4,"wal-append.queue_time_us":68420}]]}
I20260709 13:06:05.699038 17078 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.690433 17220 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.746821 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.747041 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.749298 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.750133 15715 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.751070 15720 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.710507 17241 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:05.754586 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003187e0 after lost signal to thread 15820
W20260709 13:06:05.755015 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1ea0 after lost signal to thread 15821
I20260709 13:06:05.704954 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.755860 15640 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:05.756764 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.757382 15640 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:05.749130 16963 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.755689 17257 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:05.759423 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 98957.8us
I20260709 13:06:05.760038 17261 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.746359 17034 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.762497 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.762797 17254 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.763203 17185 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.764196 17226 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.766566 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:05.770344 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:05.775490 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 144762us
I20260709 13:06:05.776253 17174 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:05.777197 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08000d82a0 after lost signal to thread 16358
I20260709 13:06:05.774469 15715 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.765226 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:05.739686 17200 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.781955 17084 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.783044 16970 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.773245 17254 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:05.791093 17180 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.795477 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:05.811120 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 50596.5us
I20260709 13:06:05.807387 16963 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.748090 17213 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.748939 17218 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.770334 17241 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.813479 17034 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.826366 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.810515 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:05.835767 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.845889 17213 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.849539 17127 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.849387 17155 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:05.853726 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:05.860452 17220 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.861763 17241 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.859619 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:05.858455 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 112535us
I20260709 13:06:05.868647 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:05.870937 17229 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.871379 17229 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.871773 17229 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.872781 17254 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.858909 15685 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:05.880795 15540 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 269) took 3229 ms. Trace:
I20260709 13:06:05.884480 17198 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.884681 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.884966 17198 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.885169 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.885393 17198 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.807541 17257 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.886466 17034 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.884761 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.883708 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.891850 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:05.865870 17200 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:05.893498 17180 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.894074 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:05.894101 17180 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.894018 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:05.895808 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.896459 15789 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:05.899994 17244 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.874709 17213 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.901391 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:05.899590 15790 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:05.901847 17244 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:05.903098 17257 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:05.903520 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 70877.3us
I20260709 13:06:05.904196 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:05.895810 17034 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.887998 17153 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.918663 17153 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:05.919152 17153 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.814659 17261 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.855767 17086 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:05.911681 17213 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:05.912729 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.912946 17180 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.914873 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.916471 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.909214 17244 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.916334 15545 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.917829 17034 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.920893 16297 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:05.934320 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.905416 17218 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:05.936825 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.938122 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:05.941560 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74847.7us
I20260709 13:06:05.945184 15644 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.946506 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.947340 15789 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.932026 17238 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.949553 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.953016 15791 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:05.952093 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.953670 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:05.960036 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.882166 15540 rpcz_store.cc:276] 0709 13:06:02.640908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.100590 (+2459682us) service_pool.cc:224] Handling call
0709 13:06:05.870472 (+769882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.772319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.847228 (+ 74909us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.847261 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:06:05.847277 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:05.847640 (+   363us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.847692 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.847726 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:05.847905 (+   179us) tablet.cc:701] Row locks acquired
0709 13:06:05.847918 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:06:05.848054 (+   136us) write_op.cc:270] Start()
0709 13:06:05.848162 (+   108us) write_op.cc:276] Timestamp: P: 1783602365848011 usec, L: 0
0709 13:06:05.848186 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.848803 (+   617us) log.cc:844] Serialized 535 byte log entry
0709 13:06:05.850434 (+  1631us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.850769 (+   335us) write_op.cc:301] APPLY: starting
0709 13:06:05.850859 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.850969 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.851060 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.851307 (+   247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.851459 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:05.851517 (+    58us) write_op.cc:312] APPLY: finished
0709 13:06:05.851691 (+   174us) log.cc:844] Serialized 23 byte log entry
0709 13:06:05.851842 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.851916 (+    74us) write_op.cc:454] Released schema lock
0709 13:06:05.851952 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.852283 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.852309 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":1465,"apply.run_wall_time_us":1465,"num_ops":1,"prepare.queue_time_us":2716,"prepare.run_cpu_time_us":2847,"prepare.run_wall_time_us":87767,"replication_time_us":2086}]]}
I20260709 13:06:05.962014 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:05.952558 17238 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.962271 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.962708 17238 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.948314 17249 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:05.960925 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:05.965878 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:05.967240 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.965765 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:05.958212 17220 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.970934 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.972493 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:05.974470 16298 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:05.969934 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:05.948905 17250 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.980500 17220 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.981284 17264 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.982594 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.983103 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.983574 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.984078 15642 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:05.984982 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.986460 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:05.987605 16298 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:05.961562 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:05.991447 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.993999 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:06.070830 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 105178us
W20260709 13:06:06.077375 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 107542us
I20260709 13:06:06.100389 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.985512 17250 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:05.990696 17241 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.178297 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.992854 17201 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.179363 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:05.976902 17242 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.977087 17196 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.966795 17127 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.180397 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.192713 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:06.189882 17250 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.192509 17264 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:06.178330 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 190770us
I20260709 13:06:06.200589 17213 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:06.204064 17034 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:06.204519 17229 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:06.205502 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.213663 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.214052 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.213838 17231 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.158856 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.178222 17200 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.192776 17246 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.251184 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.215771 17244 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.211941 17198 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.217372 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.209457 15790 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:06.224751 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:06.235472 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 268628us
I20260709 13:06:06.236406 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.239995 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.258211 17264 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.223325 17255 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:06.248764 17231 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.252800 15793 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:06.256829 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.258320 17198 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.258497 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.258771 17034 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:06.259123 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.252350 17254 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:06.251427 17246 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:06.262344 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.262877 17238 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:06.265452 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.218544 17196 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:06.267521 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:06.273283 17255 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.274305 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.280157 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.283079 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.283494 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.282409 17254 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.321059 16327 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:06.322285 17254 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.292631 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.322934 15717 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:06.292311 17246 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.325724 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.326768 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.296514 17244 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.246976 16334 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:06.297619 17238 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:06.293605 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.272675 17078 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:06.300431 17261 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:06.300850 16328 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:06.343609 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.302325 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:06.304421 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.305936 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.339270 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.320375 17255 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.322149 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.292764 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.324923 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.325071 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.345703 15788 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:06.349856 17085 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:06:06.350713 17085 consensus_queue.cc:1243] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:06.350905 16327 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:06.338480 17153 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:06.351861 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.347398 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:06.329274 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65117.5us
I20260709 13:06:06.332212 15796 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:06.332706 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.335860 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.335866 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.313819 17196 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:06.354496 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68293.6us
I20260709 13:06:06.359169 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:06.359752 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:06.360602 17265 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.360988 17265 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.361336 17265 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.350730 15787 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:06.364704 17254 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.365937 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.370314 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:06.367944 17034 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:06.372556 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.373402 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.367368 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.374583 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.375190 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.375494 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.375752 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.377408 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.362149 17261 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.379370 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.380671 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:06.357085 17086 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.386600 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.386475 17215 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:06.386389 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.386446 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.386389 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:06.387838 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.347160 16334 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:06.389168 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:06.382125 17263 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.522240 17263 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:06.522603 17263 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.420048 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.382197 17213 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.446226 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.389042 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.470593 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:06.513326 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 119291us
W20260709 13:06:06.531440 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 152128us
I20260709 13:06:06.521574 15713 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.452095 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:06.535082 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:06.417119 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:06.384114 17034 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.539049 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.377449 17153 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:06.543846 17078 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.538707 17213 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.539992 17180 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.544436 17180 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:06.544891 17180 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.552280 17250 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.554675 17250 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:06.559195 15713 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:06.561141 16326 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:06.384109 17261 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:06.564675 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:06.554404 17180 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:06.576463 17180 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:06.573685 15713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 1799) took 4095 ms (client timeout 2201 ms). Trace:
I20260709 13:06:06.423303 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:07.044418 15713 rpcz_store.cc:269] 0709 13:06:02.471067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.483109 (+ 12042us) service_pool.cc:224] Handling call
0709 13:06:05.529206 (+3046097us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b58001e2798. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1eee 0000000000375939 00007fad2a3551e0 00007fad2a41e0c4 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:05.915374 (+386168us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b1800265bc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25441646 00007fad2537b58e 00007fad253fcf9e 00007fad253fe7de 00007fad2540a27c 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c
0709 13:06:06.439985 (+524611us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b58004a24d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad253620aa 00007fad253e4447 00007fad253fcfe7 00007fad253fe7de 00007fad2540a27c 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c
0709 13:06:06.566845 (+126860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114893824}
I20260709 13:06:06.389637 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.902575 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:06.437485 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:06.969549 15639 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:06.470515 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 86948.4us
I20260709 13:06:06.974426 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.050904 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.052027 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:07.053102 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:06.975553 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.053661 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.054783 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.056310 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.056488 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:06.980396 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.585340 17196 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.123631 16325 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:06.836656 17214 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:06.581471 17246 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.231559 17246 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:06.912403 17215 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.241852 17215 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.244158 17215 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:06.852262 17229 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:06.912360 17227 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:06.911922 17254 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.248124 17227 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.248895 17254 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.250875 17227 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:07.251266 17254 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:06.580039 17261 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.581471 17263 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:06.563263 17265 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.256876 17263 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:07.257341 17265 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:06.417028 17268 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.259570 17268 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:07.260080 17268 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.991801 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 1747) took 1107 ms. Trace:
I20260709 13:06:07.265926 15793 rpcz_store.cc:276] 0709 13:06:05.884872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.886367 (+  1495us) service_pool.cc:224] Handling call
0709 13:06:05.886772 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.280730 (+393958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.991471 (+710741us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003a34d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:06.991688 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841447808}
I20260709 13:06:07.267588 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:07.002667 15638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.006s	sys 0.006s
I20260709 13:06:07.032909 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:07.269935 15638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.006s	sys 0.006s
I20260709 13:06:07.035059 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.042940 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.058135 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.059597 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.274649 16329 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:07.062425 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.063786 17273 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.066619 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.277176 17268 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.068095 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.068425 15715 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:07.281452 17268 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.071557 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.283380 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 1841) took 1467 ms. Trace:
I20260709 13:06:07.283844 15715 rpcz_store.cc:276] 0709 13:06:05.816310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.825514 (+  9204us) service_pool.cc:224] Handling call
0709 13:06:06.566849 (+741335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.281546 (+714697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.283143 (+  1597us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b540017a2d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:07.283274 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704117504}
W20260709 13:06:07.047477 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 569907us
I20260709 13:06:07.082194 15796 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:07.083199 17258 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.090807 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.286562 17213 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.096818 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.108212 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:07.111013 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 546359us
I20260709 13:06:07.118441 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.124887 17196 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:07.135066 17180 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.291085 17180 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.290798 17268 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:07.173236 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 119686us
I20260709 13:06:07.301836 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.302690 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.303519 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.205319 17191 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:07.304147 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.304395 17191 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.304884 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.305940 17258 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.306092 17265 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.306797 17258 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.182776 15792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76331ca323724c289906034e280e8274"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:06:07.304414 17263 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.307593 15792 raft_consensus.cc:606] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.192202 17214 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.223109 15646 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.227560 17278 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.310292 17278 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.234179 16330 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.235020 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:07.238619 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:07.253840 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 72494.7us
I20260709 13:06:07.257694 15716 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.322566 17213 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.323719 17213 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.269596 15793 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:07.328450 17213 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:07.329623 17213 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.332890 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 312) took 1053 ms. Trace:
I20260709 13:06:07.333535 16330 rpcz_store.cc:276] 0709 13:06:06.279371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.279853 (+   482us) service_pool.cc:224] Handling call
0709 13:06:06.280402 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.323641 (+1043239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.332631 (+  8990us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54005f2b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:07.332799 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192871168}
I20260709 13:06:07.331943 17213 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.340806 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.341506 15645 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:07.277513 17261 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.281075 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.067353 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.342670 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:07.343192 15719 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.343668 17288 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.344146 17288 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:07.344540 17288 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.291519 17180 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:07.346532 17180 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.347918 17180 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.303659 17034 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.306958 17191 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.206367 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.163765 15721 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.353935 17273 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:07.355247 17273 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.355628 17273 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:07.356606 17273 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.358945 15719 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:07.305406 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.364703 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:07.365813 17285 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:07.366465 17285 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:07.367499 17285 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:07.370289 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 64962.1us
I20260709 13:06:07.371695 17191 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.371865 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.316697 17278 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:07.318668 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.373168 17191 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:07.374010 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 55433.3us
I20260709 13:06:07.375497 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.376910 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.377879 17263 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.378896 17258 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.379215 17263 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.285593 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:07.380673 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 95136.6us
I20260709 13:06:07.380945 17283 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.381564 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.382609 17153 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.382910 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.325244 15759 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.383914 17283 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:07.384039 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 58868.2us
I20260709 13:06:07.384481 17283 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:07.384552 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.385156 17283 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.324867 17268 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.385633 17034 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.233299 15545 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:07.386374 17268 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.387069 17238 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.387523 17238 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:07.388463 17238 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.316673 17214 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.383102 17153 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:07.397078 17153 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.398417 17191 raft_consensus.cc:1064] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:07.399590 15759 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.400918 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.394063 17238 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.402390 17287 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.402581 17174 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.361968 17273 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.390250 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.411195 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.412884 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:07.412917 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.376833 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.409303 15790 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.391009 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.414987 15610 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.417785 17267 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.418555 17267 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.419179 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.421692 17263 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.422979 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.423730 17244 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.424110 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:07.424686 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 47967.9us
I20260709 13:06:07.424849 17244 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.425238 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.425405 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.425966 17244 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.426728 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.426941 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:07.427241 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.427748 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.427914 17244 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.428505 17218 raft_consensus.cc:1064] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:07.428836 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.430277 17265 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.430932 17265 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.432062 17265 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.431232 17218 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.432720 17265 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.433323 17265 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.420385 17214 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.429466 17288 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.420615 17254 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.430300 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.435649 17244 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.436062 17287 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.437057 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.434919 17180 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:07.438400 17180 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.437852 17244 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.440095 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.440889 17244 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.440876 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.441486 17244 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:07.441970 17244 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.442149 17174 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.441979 15791 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.442216 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.451364 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.457026 17215 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.458894 17277 raft_consensus.cc:1064] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:07.462401 17034 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.465615 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.450076 17250 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:07.461596 17277 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.467437 15713 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:07.468123 17180 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:07.468844 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.469331 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.471802 17246 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:07.472357 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:07.472869 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.488935 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.472029 17250 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.474172 17267 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.454217 17254 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:07.475028 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.475904 15716 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.478567 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.478734 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:07.479722 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:07.482632 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:06:07.401463 17191 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.505061 15791 raft_consensus.cc:606] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:07.486299 17229 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.490072 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:07.482055 17288 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.490998 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:07.491345 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.492312 15795 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.519321 15794 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.491626 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.494637 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.501091 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.503824 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.521211 16332 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:07.522059 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.509457 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.490365 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:07.513346 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.523231 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.515348 15645 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.492813 17153 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.506170 17268 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.524156 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.525031 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.494431 17250 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:07.535943 15794 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:07.541359 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:07.542011 17213 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.539875 15645 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:07.542706 17213 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.544469 17285 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.545123 17285 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.545444 17285 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.545820 17285 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.532639 17196 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.523737 17267 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.525178 17174 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.505992 17284 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:07.560551 15787 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:07.571674 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:07.574687 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.577455 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.556849 17196 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:07.530185 17274 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:07.563637 17268 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.578949 17297 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.582666 15792 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:07.583693 17268 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.586534 17153 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:07.586767 17279 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.587276 17279 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.587695 17279 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.573609 17284 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.591900 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.586607 17268 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:07.634223 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 109298us
I20260709 13:06:07.616974 17263 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.636895 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:07.590945 17261 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:07.591737 17284 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:07.607784 17297 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:07.682966 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:07.688863 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.693986 17153 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.694706 17153 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.695220 17153 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.699355 17283 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.689584 15638 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.687201 17196 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.726326 17196 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.711934 17283 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:07.753255 17261 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:07.755201 17261 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.756477 15638 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
W20260709 13:06:07.760991 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 124190us
I20260709 13:06:07.761911 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:07.763186 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.763782 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.764778 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:07.764915 17261 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.767818 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:07.770020 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:07.771523 16331 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.777117 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.777793 15721 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.777873 15647 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:07.778549 15759 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.781772 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.782051 17180 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.783051 17273 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.697721 17285 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.784443 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.740876 17244 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.785420 17078 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.785224 17267 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.788831 17213 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:07.795766 17153 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.785641 17180 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:07.797547 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:07.798429 17180 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.799319 17153 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.800606 15638 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.780644 17280 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.802570 17295 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.806108 17191 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:07.787784 17297 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.828663 17267 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:07.807152 17284 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.846801 17284 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.808622 17280 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.849519 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:07.852566 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.852805 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.826802 17078 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:07.855933 17280 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.858073 15646 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.806244 17287 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:07.861538 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.864348 15646 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.866798 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.860117 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.793476 17250 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.869421 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.860008 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.877925 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:07.878620 15647 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.867152 17300 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.890702 17314 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:07.891357 17314 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.893385 15640 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.860569 17295 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:07.894666 17300 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.895030 17300 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:07.895972 17300 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:07.896903 17286 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.897310 17300 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.898396 15642 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.899753 17244 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:07.900328 17250 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.903376 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:07.897384 17286 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:07.898406 15638 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.895042 17285 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:07.932243 17306 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:07.933766 17215 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.935549 15641 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:07.956157 15647 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:07.922999 17078 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:07.977947 15646 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:07.983271 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:07.929615 17227 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:07.991905 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 179942us
I20260709 13:06:07.957298 17215 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:07.998656 15646 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.961174 17306 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:07.929296 17268 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.022365 15645 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:08.000541 17313 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:06:08.021708 15718 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:08.024665 15639 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:08.028806 17307 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:08.029449 17307 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.031999 17307 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:08.032968 17238 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.037107 17034 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:08.038103 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe060 after lost signal to thread 14519
I20260709 13:06:08.021984 16331 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.033447 17238 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:08.050937 16333 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:08.055889 17265 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.055959 16332 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:08.064867 17306 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:08.066970 17268 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:08.038506 17034 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.068429 17034 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:08.069365 17034 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.070791 17034 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.018378 17227 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:08.076200 17078 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.078604 17227 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:08.080585 15718 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:08.081380 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.027882 17279 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.114494 15642 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.118158 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.117441 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:08.118139 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.121294 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:08.125064 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 86822.2us
I20260709 13:06:08.125344 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:08.132230 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.133365 15639 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:08.133882 17317 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:06:08.059772 17318 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:08.134316 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.136797 15721 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:08.139818 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe740 after lost signal to thread 15579
I20260709 13:06:08.141193 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.062655 17215 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:08.079573 17238 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:08.161912 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 196249us
I20260709 13:06:08.163209 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.159017 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.157140 15790 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.157334 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.153227 17280 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.159724 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.194226 15791 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:08.181859 17279 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:08.177757 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.151736 17326 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:06:08.134925 17288 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:06:08.182829 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd460 after lost signal to thread 15671
I20260709 13:06:08.183611 17238 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.158056 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.151773 15787 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.196470 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.197253 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.206456 15646 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
W20260709 13:06:08.209566 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.209453 17274 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.210497 17274 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:08.209404 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.211591 17274 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.193109 17215 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.212001 17274 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:06:08.213544 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.194700 17264 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:08.252243 16355 debug-util.cc:398] Leaking SignalData structure 0x7b0800287960 after lost signal to thread 15746
W20260709 13:06:08.264894 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 85832.5us
I20260709 13:06:08.267520 17280 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:08.196126 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:08.213935 17220 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:08.269549 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1fa0 after lost signal to thread 15820
W20260709 13:06:08.296577 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 87276.5us
I20260709 13:06:08.299971 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:08.301688 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:08.305091 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 105895us
I20260709 13:06:08.307403 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:08.311167 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.315056 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:08.315245 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:08.303704 17196 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.307199 17214 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.299382 17250 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:06:08.311141 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1160 after lost signal to thread 16358
W20260709 13:06:08.323164 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.301124 17220 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:06:08.319999 17307 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:08.343745 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:08.360270 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.329627 17307 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.364454 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.367352 15644 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.324007 17280 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:08.306682 17274 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.359239 17196 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:08.327709 17285 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:08.308599 17264 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:08.372831 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.377010 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.376993 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.380002 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.388530 17310 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.375401 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.390103 15792 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:08.356983 17283 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.396456 17309 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.396904 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:08.398488 15646 raft_consensus.cc:606] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.398955 15646 raft_consensus.cc:614] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:08.364950 17307 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:08.408797 15795 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:08.403026 17268 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.403232 17283 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:08.410280 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83377.3us
I20260709 13:06:08.370098 17277 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:06:08.371595 17312 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.418239 17310 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.426090 17283 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:08.427083 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.409982 17268 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:08.431262 15791 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:08.410239 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:08.432972 15791 pending_rounds.cc:85] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 1
I20260709 13:06:08.433758 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:08.434214 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.435925 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.422976 15787 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.437819 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.433254 15791 pending_rounds.cc:107] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:08.440219 15791 raft_consensus.cc:2889] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:08.440384 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.444832 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.440897 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.445714 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.446863 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.445633 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.453554 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.455451 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.458192 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.445628 15796 raft_consensus.cc:2376] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 3. Re-sending same reply.
I20260709 13:06:08.444370 17196 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.463758 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.443465 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.461591 17336 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.415886 17286 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:08.516196 17286 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.487108 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.490056 17268 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:08.491173 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:08.441552 17307 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:08.458686 17280 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.521072 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.457422 17312 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.527390 17336 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:08.534468 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.536988 17299 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.538283 17310 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.542205 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.544510 17268 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.545571 17310 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.542922 17280 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.519418 15642 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.552155 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.555297 17322 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:06:08.575249 17310 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:08.591346 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.592711 15718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:06:08.593420 15718 raft_consensus.cc:606] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:08.537490 17336 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.598338 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:08.606864 17336 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.619311 17320 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.619930 17320 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:08.637928 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.516268 17309 consensus_queue.cc:1175] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c1927141dc2540dab644a00fd6843fc6" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: [2.2-2.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:08.662765 16326 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:08.673095 15641 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.677603 15642 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.678303 17322 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:08.691828 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 266246us
I20260709 13:06:08.719347 15641 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:08.722837 15639 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:06:08.623034 17320 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.692238 17287 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:08.731139 17078 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:08.787382 17078 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.787802 17078 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:08.788625 17078 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:08.761684 17320 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.762699 17250 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.779419 17215 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:08.782713 17341 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.736459 17323 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:06:08.813705 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 326686us
I20260709 13:06:08.803833 15721 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:08.804178 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.818392 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.805056 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:08.802951 17314 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:08.814867 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:08.809342 17215 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:08.810990 16326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 373) took 1339 ms (client timeout 1583 ms). Trace:
I20260709 13:06:08.809361 17213 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.812696 17341 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:08.825982 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 100991us
I20260709 13:06:08.831244 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.839293 15793 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.823690 17153 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.833330 17078 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:08.835933 17220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.022s	sys 0.016s
I20260709 13:06:08.830363 17297 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.866482 17332 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.868181 17318 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.872771 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:08.877018 15645 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.879066 15540 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 144) took 1546 ms. Trace:
I20260709 13:06:08.916251 15540 rpcz_store.cc:276] 0709 13:06:07.333170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.333295 (+   125us) service_pool.cc:224] Handling call
0709 13:06:08.878996 (+1545701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268367,"reported_tablets":1}
I20260709 13:06:08.880151 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:08.887024 17337 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.834672 17213 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:08.907824 15545 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 270) took 1700 ms. Trace:
I20260709 13:06:08.914810 15644 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2. Re-sending same reply.
W20260709 13:06:08.904516 17220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.023s	sys 0.016s
I20260709 13:06:08.926227 17337 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:08.922749 17281 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.923179 17325 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:06:08.848619 17286 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:06:08.849601 17288 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:06:08.941689 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 86395.1us
I20260709 13:06:08.920542 17318 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:08.831645 16326 rpcz_store.cc:269] 0709 13:06:07.471419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.482478 (+ 11059us) service_pool.cc:224] Handling call
0709 13:06:07.764673 (+282195us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1eee 0000000000375939 00007fad2a3551e0 00007fad2a41e0c4 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:08.810784 (+1046111us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54002dee54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:08.810900 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216450688}
I20260709 13:06:08.921285 15545 rpcz_store.cc:276] 0709 13:06:07.175784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.177968 (+  2184us) service_pool.cc:224] Handling call
0709 13:06:08.875814 (+1697846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:07.456352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:07.457014 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:07.457058 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:06:07.457080 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:07.457451 (+   371us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:07.457541 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:07.457578 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:07.457828 (+   250us) tablet.cc:701] Row locks acquired
0709 13:06:07.457849 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:07.470138 (+ 12289us) write_op.cc:270] Start()
0709 13:06:07.471177 (+  1039us) write_op.cc:276] Timestamp: P: 1783602367457953 usec, L: 0
0709 13:06:07.471214 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:06:07.486683 (+ 15469us) log.cc:844] Serialized 591 byte log entry
0709 13:06:07.687451 (+200768us) op_driver.cc:464] REPLICATION: finished
0709 13:06:07.884340 (+196889us) write_op.cc:301] APPLY: starting
0709 13:06:07.884451 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:07.884567 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:07.884711 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:07.927993 (+ 43282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:07.960243 (+ 32250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:07.982126 (+ 21883us) write_op.cc:312] APPLY: finished
0709 13:06:08.018960 (+ 36834us) log.cc:844] Serialized 23 byte log entry
0709 13:06:08.026260 (+  7300us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:08.039149 (+ 12889us) write_op.cc:454] Released schema lock
0709 13:06:08.044910 (+  5761us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:08.047198 (+  2288us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:08.047249 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":178345,"apply.run_cpu_time_us":2722,"apply.run_wall_time_us":163848,"num_ops":1,"prepare.queue_time_us":66627,"prepare.run_cpu_time_us":3928,"prepare.run_wall_time_us":37574,"raft.queue_time_us":104333,"raft.run_cpu_time_us":50213,"raft.run_wall_time_us":174627,"replication_time_us":212094,"thread_start_us":241296,"threads_started":4,"wal-append.queue_time_us":6764}]]}
I20260709 13:06:08.942668 15642 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.853652 17341 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:08.953158 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.927286 17337 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:08.962325 17346 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:06:08.961694 17277 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:08.962863 16331 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:08.950085 17328 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 13:06:08.986250 15718 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.986164 17215 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:08.991995 17191 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:08.993219 17191 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:08.994889 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:08.995641 17191 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:08.996006 15642 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:08.971772 16328 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:08.997691 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:08.977852 17286 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:08.991770 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:08.998656 17307 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.003270 17344 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.004678 17344 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:09.004880 17264 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:09.005085 17344 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.005391 17264 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:09.004066 17337 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.010273 17264 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.029789 17352 raft_consensus.cc:993] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:09.030366 17352 raft_consensus.cc:1081] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:09.027179 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:09.006088 17286 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.034564 17286 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:09.009620 17215 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.041038 16327 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:09.042464 17318 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.043128 17288 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:09.047513 17341 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:09.050494 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:09.057063 17309 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.031396 17306 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:09.070503 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.075176 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:09.075753 17218 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.076062 15794 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:09.076310 17218 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.075668 17180 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:09.071203 16332 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:09.079035 17218 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.079787 17215 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:09.083225 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.083640 17306 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:09.084066 17306 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:09.090348 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:09.093374 17300 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.071200 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:09.113333 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.096454 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:09.117317 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46193.8us
I20260709 13:06:09.118971 17288 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.119505 17288 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.120687 17353 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.121335 17353 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:09.117898 17300 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:09.122390 17353 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:09.124936 17288 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:09.125103 17300 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.140342 15718 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.067903 17325 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:09.145668 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.147269 15721 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:09.131515 17214 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.084867 17306 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.123330 17344 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.154170 17274 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.156852 15645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:06:09.157913 15645 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.158326 15645 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.160336 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.171921 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.184234 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.149866 17214 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:09.148561 17325 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.199569 15645 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.201828 15645 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:09.234366 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.243443 17213 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.186739 17284 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.248090 15540 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 3 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.254223 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:09.194190 17214 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.254879 15715 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.264492 15715 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:09.187966 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.272850 17281 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.293869 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:09.300856 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.299508 17213 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.290339 15643 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:09.314718 15715 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.335284 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.269795 17325 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:09.265714 17284 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.358234 15715 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.331488 15645 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:09.301971 17180 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.322273 15638 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:09.365628 17355 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:06:09.405645 17299 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:09.373350 17244 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.408413 15718 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:09.379546 17344 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:09.380537 17268 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.411908 15645 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:09.313117 17326 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:09.355983 17191 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.406729 17264 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.410020 17263 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.409647 17244 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.387846 15647 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:09.406368 17299 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.415156 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:09.423853 17191 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.412966 17325 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.410858 17180 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.450855 17244 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.464085 17191 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:09.464351 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.470065 17306 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.427526 17196 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:09.424909 17268 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.498754 17268 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.499171 17180 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.488595 17323 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:09.499671 17323 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:09.490849 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.492777 17328 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:09.506634 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.471091 17325 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.507865 15638 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
W20260709 13:06:09.508271 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.509452 17325 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:09.510851 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.510277 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:09.511484 16327 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:09.513459 17180 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.513720 15715 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:09.515926 15788 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:09.521819 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.514087 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:09.526736 15796 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.521458 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:09.516283 17284 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:09.527976 15645 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:09.535578 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.544843 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:09.513862 17180 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.550117 17034 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.551929 17299 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.357312 17281 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.548900 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:09.557554 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.558231 16328 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:09.555580 17034 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.559239 17034 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.561947 17318 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.564149 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:09.555665 17263 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:09.567005 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.569063 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:09.567287 17263 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.574926 17261 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:09.576412 17263 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.593564 15542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 273) took 2097 ms. Trace:
I20260709 13:06:09.594110 15542 rpcz_store.cc:276] 0709 13:06:07.496095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.504131 (+  8036us) service_pool.cc:224] Handling call
0709 13:06:09.593455 (+2089324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25032,"reported_tablets":2}
I20260709 13:06:09.500558 17323 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.600777 17320 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.601078 17323 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.602769 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:09.555848 17180 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.562003 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.568090 17295 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.593832 17337 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.603432 17267 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.597775 17344 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:09.638443 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.617408 17267 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.641546 15713 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:06:09.611028 17283 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:09.617514 17337 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.652276 17267 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.617195 17344 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.616760 17214 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.699913 17353 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.698562 17286 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.698114 17287 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:09.730978 16332 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
W20260709 13:06:09.731463 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 258974us
I20260709 13:06:09.703135 16331 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:09.748370 17296 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:09.749033 17296 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.751571 17296 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:09.733151 17353 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.721369 15640 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:09.756207 17281 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.766683 17337 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:09.754849 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 456626us
I20260709 13:06:09.771436 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:09.779773 15788 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:09.781469 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:09.788691 15796 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
W20260709 13:06:09.789994 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 169648us
I20260709 13:06:09.794747 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:09.799840 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:09.735147 17287 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:09.815339 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.030s
W20260709 13:06:09.815987 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.002s	sys 0.030s
I20260709 13:06:09.823688 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:09.827491 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.834748 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:09.791265 17274 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.838192 16334 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:09.810377 17218 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.840582 17274 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.873313 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.874354 15718 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:09.839020 17306 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:09.889678 15716 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:09.875934 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.883944 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:09.892445 15718 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:09.893373 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.894596 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.884204 17214 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.895299 15718 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:09.864673 17218 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.867184 16331 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.904241 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:09.877244 15721 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:09.888106 17267 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:09.866569 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:09.872803 17274 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.934221 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:09.897946 17078 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:09.893435 17227 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:09.911235 17218 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.926729 17296 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.953984 17078 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.919128 17353 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:09.931793 17279 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.903242 17306 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:10.000664 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62344.1us
I20260709 13:06:10.092876 15715 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:10.103101 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:10.106745 15641 raft_consensus.cc:2368] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3.
W20260709 13:06:10.116279 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 116431us
W20260709 13:06:10.102983 17372 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:06:09.962657 17227 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:10.111464 17363 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:06:10.065650 17279 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:09.999006 17296 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:10.129132 17364 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 13:06:10.130571 17034 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260709 13:06:10.147575 17344 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:10.154513 17361 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.505s	user 0.000s	sys 0.005s
I20260709 13:06:10.158864 17227 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.160730 17287 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.162163 17306 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.171689 17267 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:10.187983 17180 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.002s
I20260709 13:06:10.206259 17180 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.212286 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.213397 16334 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:10.218637 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 112763us
I20260709 13:06:10.235472 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.214387 17306 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.198575 17034 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.243134 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:10.244176 15641 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:10.247843 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 304907us
I20260709 13:06:10.253037 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1104) took 1411 ms. Trace:
I20260709 13:06:10.255138 15795 raft_consensus.cc:2368] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:10.256911 15762 leader_election.cc:400] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3.
I20260709 13:06:10.257383 15762 leader_election.cc:403] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:10.263206 17296 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.253497 15646 rpcz_store.cc:276] 0709 13:06:08.838291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.838433 (+   142us) service_pool.cc:224] Handling call
0709 13:06:08.838983 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.839325 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.839351 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.147710 (+308359us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b2c000014c8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:09.154946 (+  7236us) log.cc:844] Serialized 548 byte log entry
0709 13:06:09.618299 (+463353us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:09.618340 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.618412 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.090227 (+471815us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:10.248701 (+158474us) raft_consensus.cc:1685] finished
0709 13:06:10.248721 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.248847 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142777984,"thread_start_us":461230,"threads_started":1,"wal-append.queue_time_us":492687}
I20260709 13:06:10.269953 17296 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.270498 17296 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.272475 17296 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.274757 17180 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.275468 17279 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.275686 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:10.254483 17323 consensus_meta.cc:287] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.006s
I20260709 13:06:10.276577 17034 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:10.277993 17379 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.279102 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:10.278757 17379 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.279667 16334 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:10.282593 17380 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:06:10.287771 17268 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.288298 17268 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.288962 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:10.289096 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:10.243599 17306 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.290319 17268 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.287277 17296 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.290064 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:10.292196 17377 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:06:10.292269 17296 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.294531 17296 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.249315 17078 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:10.297292 17218 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.299350 17268 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.300380 15788 raft_consensus.cc:2368] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:10.302713 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:10.303623 17296 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:10.304143 17296 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:10.304395 17366 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.654s	user 0.001s	sys 0.003s
I20260709 13:06:10.304492 17296 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.308710 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:10.309309 15794 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.311153 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.309655 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.312587 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.313159 15792 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:10.299779 17218 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.294500 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:10.326455 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84260.5us
I20260709 13:06:10.326459 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.357713 16332 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:10.295786 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:10.359287 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.360023 15713 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:10.313990 15793 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.353555 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:10.365603 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 71197.4us
I20260709 13:06:10.366114 16330 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.346781 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.367811 15722 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.368065 16332 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.368731 16334 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:10.365298 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.372903 15721 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.372267 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.372965 15794 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.374868 16334 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.378609 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.379906 15721 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:10.383242 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:10.292299 17306 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.375608 17318 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3.
I20260709 13:06:10.386458 17379 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.399139 17379 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.389562 17309 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.399919 17309 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:10.395941 16332 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:06:10.400463 17309 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.402077 17285 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.402663 17285 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.399685 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:10.400529 16332 pending_rounds.cc:85] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 2
I20260709 13:06:10.396330 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:10.394083 17375 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.351837 17371 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:10.371026 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.418987 16332 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:10.420359 17341 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:10.424477 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.430651 15794 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:10.418509 15646 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.376523 17227 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.428591 16332 raft_consensus.cc:2917] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:10.429981 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:10.434949 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.399749 17379 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:10.430567 17371 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:10.448357 17391 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:06:10.428622 17375 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.451761 17285 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.454083 15646 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:10.457686 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.512055 16334 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.462591 16332 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.458582 15685 leader_election.cc:400] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:10.463070 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:10.468693 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44059.1us
I20260709 13:06:10.514227 15685 leader_election.cc:403] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:10.514868 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 89641.6us
I20260709 13:06:10.517109 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:10.517958 17367 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.520728 17279 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:10.469206 16331 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 13:06:10.521471 17279 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.505162 15638 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.522724 17368 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.523164 17368 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.523537 17368 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.456957 17227 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:10.527181 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64225.8us
I20260709 13:06:10.505021 17382 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.509877 17277 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.539073 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:10.525252 17318 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.531258 17227 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.531627 17285 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.561585 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:10.558975 15639 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:10.596504 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:10.599176 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:10.599195 15685 leader_election.cc:400] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:10.613308 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.614598 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:10.614852 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:10.616390 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:10.617054 15718 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:10.594954 15542 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:10.591215 17274 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.004s
I20260709 13:06:10.569777 17326 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:10.638154 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.575610 17218 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.590148 17371 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:10.661463 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 44835.4us
I20260709 13:06:10.589883 15638 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:10.573035 17318 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.666007 17318 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.665695 17296 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.666703 17263 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.667308 17263 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.668334 17296 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.597047 17261 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.670111 17261 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.670751 17384 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:10.671329 17384 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.671440 17309 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.672566 17261 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:10.628687 15542 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:10.595747 17341 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:10.677088 15542 catalog_manager.cc:5697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.622604 17213 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.680436 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:10.680338 15542 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:10.685037 16330 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.641505 17325 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.637204 17299 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.567458 17277 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.669667 17263 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.678861 17371 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:10.652859 17274 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.696560 17300 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.693460 16327 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:10.559996 17382 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.698118 17375 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.675366 17326 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:10.686712 17268 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.702216 17379 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.707919 17299 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.623324 17034 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.708835 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:10.673727 17384 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.698133 17309 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.682878 17218 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.703722 17296 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.719664 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:10.728513 16332 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:10.730129 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:10.731302 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:10.714645 17328 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.713658 17300 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.736545 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.734094 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:10.738749 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.740115 16330 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:10.737236 15788 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:10.728292 17379 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.747725 17382 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:10.730494 17344 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:10.735301 17328 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.732779 17279 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.735839 17375 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.745564 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:10.752853 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:10.756196 17274 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.740463 17367 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:10.752691 17379 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.715953 17371 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.750005 17286 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:10.753530 17295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.022s	sys 0.035s
I20260709 13:06:10.718677 17268 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.734907 17296 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.765076 17279 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.782295 17286 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:10.782487 17279 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.782943 17279 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.783597 17286 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.772171 17379 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.788506 17268 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.758320 17328 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.744724 17309 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:10.774505 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:10.763650 17375 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.750033 17341 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.763513 17368 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.759373 17344 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.842475 16334 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
W20260709 13:06:10.837899 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 84943.2us
I20260709 13:06:10.774405 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:10.778093 17295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.023s	sys 0.036s
I20260709 13:06:10.849056 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:10.883390 15718 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.849994 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.884155 15715 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:10.779914 17274 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:10.886541 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:10.888725 15717 raft_consensus.cc:2368] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:10.815681 17277 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:10.771857 17227 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:10.843711 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 245062us
I20260709 13:06:10.888370 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:10.906158 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 226190us
I20260709 13:06:10.846901 17299 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.816270 17399 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:10.767993 17326 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:10.846433 17034 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.967679 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:10.845448 17375 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.944784 15718 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:10.885147 17295 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:10.947584 17296 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.936537 16326 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
W20260709 13:06:10.939525 17407 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.106s	user 0.004s	sys 0.000s
I20260709 13:06:10.815104 17396 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.892728 17274 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:10.957634 15720 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:10.961930 17406 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:10.976925 17295 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:10.977835 17396 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.978267 17396 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.963711 15721 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.977432 17274 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.963263 17227 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:10.982945 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 95884.7us
I20260709 13:06:10.996208 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:11.023612 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:11.025704 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.026441 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:11.027513 17227 raft_consensus.cc:2764] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:11.028349 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:11.029335 17387 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.030081 17387 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.038542 16330 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:11.034261 17299 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:10.982136 17218 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.006219 17300 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:10.981930 17034 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.106532 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:11.107558 15795 raft_consensus.cc:2368] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:11.057030 17213 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.129563 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:11.137112 17213 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.140570 17213 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:11.081513 15721 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:11.144533 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.152911 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.153679 15793 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:11.161681 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.163007 15714 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:11.163981 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.165174 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.091192 17299 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.142563 17283 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.172052 17283 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.172410 17283 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.066490 17399 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.174695 17368 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:11.134902 17388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.023s	sys 0.036s
I20260709 13:06:11.148084 17371 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.129096 17300 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:11.179149 17268 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:11.179688 17268 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:11.178287 17388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.023s	sys 0.036s
I20260709 13:06:11.141688 17244 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:11.183074 17244 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.222944 17034 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:11.225472 17397 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:11.178920 17300 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.227387 15540 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 145) took 2274 ms. Trace:
W20260709 13:06:11.189610 15610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.002s	sys 0.016s
W20260709 13:06:11.248812 15610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.004s	sys 0.016s
W20260709 13:06:11.249215 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 699729us
I20260709 13:06:11.232409 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.233197 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.234952 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.250751 15646 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:11.238250 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.239506 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:11.226236 17397 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.243070 17344 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.243377 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.252252 15685 leader_election.cc:400] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:11.269970 15685 leader_election.cc:403] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:11.255244 15760 leader_election.cc:400] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:11.270462 15760 leader_election.cc:403] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:11.250095 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:11.272451 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:11.273880 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.274724 15639 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:11.258108 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:11.277356 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:11.261116 17227 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.263152 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.270071 15641 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:11.263931 17323 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.264287 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.282613 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:11.269011 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.278209 16334 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:11.244215 15540 rpcz_store.cc:276] 0709 13:06:08.953128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.953282 (+   154us) service_pool.cc:224] Handling call
0709 13:06:11.227327 (+2274045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:09.888675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:10.110950 (+222275us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:10.114790 (+  3840us) write_op.cc:435] Acquired schema lock
0709 13:06:10.117149 (+  2359us) tablet.cc:662] Decoding operations
0709 13:06:10.117569 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:10.117632 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:10.117667 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:10.117894 (+   227us) tablet.cc:701] Row locks acquired
0709 13:06:10.117915 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:10.118062 (+   147us) write_op.cc:270] Start()
0709 13:06:10.118227 (+   165us) write_op.cc:276] Timestamp: P: 1783602370118014 usec, L: 0
0709 13:06:10.118249 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:10.119011 (+   762us) log.cc:844] Serialized 530 byte log entry
0709 13:06:10.674850 (+555839us) op_driver.cc:464] REPLICATION: finished
0709 13:06:10.948057 (+273207us) write_op.cc:301] APPLY: starting
0709 13:06:10.948144 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:10.948234 (+    90us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:10.948366 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:10.948642 (+   276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:10.948792 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:10.948833 (+    41us) write_op.cc:312] APPLY: finished
0709 13:06:10.949023 (+   190us) log.cc:844] Serialized 23 byte log entry
0709 13:06:10.949189 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:10.949267 (+    78us) write_op.cc:454] Released schema lock
0709 13:06:10.949311 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:10.949615 (+   304us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:10.949648 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":504454,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":264332,"apply.run_cpu_time_us":1593,"apply.run_wall_time_us":1593,"num_ops":1,"prepare.queue_time_us":262214,"prepare.run_cpu_time_us":35498,"prepare.run_wall_time_us":396799,"raft.queue_time_us":311561,"raft.run_cpu_time_us":31995,"raft.run_wall_time_us":170793,"replication_time_us":556440,"spinlock_wait_cycles":1408,"thread_start_us":618391,"threads_started":4,"wal-append.queue_time_us":242177}]]}
I20260709 13:06:11.284832 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:11.279105 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:11.221695 17379 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:11.344393 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65380.4us
I20260709 13:06:11.243695 17214 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.285547 17312 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:11.226770 17399 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.354247 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.287237 17376 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.272082 17034 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.362046 15641 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:11.364102 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.348856 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.337983 17405 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:11.356755 17297 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:11.370967 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.371140 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.343034 17325 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:11.347296 17368 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:11.375841 15647 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:11.340395 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:11.384336 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 44066.6us
I20260709 13:06:11.378289 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.364055 17376 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.385723 17376 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.409467 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.337774 17227 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.415503 17408 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.416109 17408 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:11.369232 17034 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:11.368503 17312 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:11.345480 17323 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.387759 17405 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:11.381862 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:11.362272 17214 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.448686 17244 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.424969 17405 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.428450 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.429018 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.447378 17306 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:11.404134 17215 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.413944 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.412032 17325 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:11.412381 17368 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:11.502797 17368 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.428134 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.425009 17323 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:11.419912 17034 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.472939 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.426914 17258 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:11.475353 17214 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.476643 17268 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.479548 17274 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.481276 17300 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.482563 17397 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.466013 15789 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
W20260709 13:06:11.436259 17279 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.004s
I20260709 13:06:11.498227 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.500232 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.483201 17312 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.417285 17299 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.508420 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:11.513758 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.439203 17386 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.515610 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.466447 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.557576 15795 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:11.567847 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.569561 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.439003 17327 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:11.505950 17408 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.578539 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:11.463059 16325 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:11.591533 17078 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:11.594446 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 86111.9us
I20260709 13:06:11.606405 15795 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:06:11.607404 15795 pending_rounds.cc:85] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 2
I20260709 13:06:11.607646 15795 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:11.610267 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.582496 15545 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 1 to 2, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 2 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.594393 15788 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:11.607949 15795 raft_consensus.cc:2917] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:11.612566 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.612927 15795 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.602900 17261 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:11.606491 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:11.517225 15642 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:11.509012 17215 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.623131 16329 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:11.641839 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.575517 15638 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:11.635246 17261 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.603893 17214 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:11.646407 15688 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.589s (SENT) [suppressed 11 similar messages]
I20260709 13:06:11.507032 17306 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.579314 17258 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.617619 17384 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.594667 17279 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.674429 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:11.679908 15639 raft_consensus.cc:2368] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:11.648537 17214 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:11.670262 17326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.045s	sys 0.130s
I20260709 13:06:11.621603 17078 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.687073 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.690351 15718 raft_consensus.cc:2368] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3.
I20260709 13:06:11.692981 17258 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.669448 17298 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:06:11.698154 17396 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.003s
W20260709 13:06:11.688710 17326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.045s	sys 0.130s
I20260709 13:06:11.683219 17379 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.689302 17214 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.702337 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.719158 15638 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:11.719913 17279 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.720364 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.721168 15638 raft_consensus.cc:2368] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:11.680276 17384 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.730235 17384 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.682137 17325 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.698578 17396 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.723213 17344 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:11.744385 17344 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.747223 17344 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.724092 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:11.725013 17375 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.003s
I20260709 13:06:11.727056 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.727520 17261 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.739557 17400 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:11.742483 17306 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.708069 17227 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.708580 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:11.758327 17328 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.951s	user 0.016s	sys 0.006s
I20260709 13:06:11.757560 17400 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.769279 17396 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.762771 17328 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.756261 17218 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:11.809931 17400 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.754565 17375 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.812692 17375 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.814117 15643 raft_consensus.cc:2368] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:11.815524 15646 raft_consensus.cc:2368] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:11.819171 17328 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.763873 17227 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.825018 17214 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.759272 17376 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:11.833992 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:11.834905 16329 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.842481 17376 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:11.842690 15644 raft_consensus.cc:2368] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4.
I20260709 13:06:11.800631 17274 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.851377 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:11.854875 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:11.858249 17215 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.828094 17218 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:11.860950 17283 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.000s
I20260709 13:06:11.842559 17214 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:11.944023 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:11.945638 15644 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.921721 16329 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
W20260709 13:06:11.935930 16330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.021s	sys 0.034s
W20260709 13:06:11.952749 16330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.022s	sys 0.034s
I20260709 13:06:11.942176 17283 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.954245 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:11.862628 17034 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:11.960144 15759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.026s	sys 0.056s
W20260709 13:06:11.974606 15759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.027s	sys 0.056s
W20260709 13:06:11.974967 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 717065us
I20260709 13:06:11.936729 17326 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:11.975775 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:11.850219 17227 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:11.949393 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:11.980135 17261 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.007525 17218 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.010072 15647 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:11.954445 15642 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:12.026878 15719 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.005s	sys 0.029s
I20260709 13:06:12.028441 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:12.012586 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:12.033613 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.034258 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.035557 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:11.980558 17306 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:12.027475 15719 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.029s
I20260709 13:06:12.036522 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:12.038478 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.041432 17078 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:12.042469 17341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.011s	sys 0.029s
I20260709 13:06:12.042641 17078 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.014127 17261 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:12.044492 15787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.006s	sys 0.030s
I20260709 13:06:12.035746 17376 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.087114 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:12.071417 17341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.011s	sys 0.029s
I20260709 13:06:12.099427 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:12.102380 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:11.993858 17326 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.133775 17379 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:12.109498 15718 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:12.080605 17386 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:12.043439 17263 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.114147 15722 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.116387 15714 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.121145 17034 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.083494 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:12.077947 17306 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:12.123767 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:12.081795 17261 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.076736 17274 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.084558 15787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.007s	sys 0.030s
I20260709 13:06:12.126143 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:12.127188 17341 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.174013 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:12.112830 17384 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.078533 17323 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.107380 17376 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.132687 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 401) took 1072 ms. Trace:
I20260709 13:06:12.139051 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:12.139456 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:12.134578 17379 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.155740 15790 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:12.079452 17078 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.168694 15791 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.167872 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.033s
I20260709 13:06:12.140270 17309 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:12.176973 16330 rpcz_store.cc:276] 0709 13:06:11.060040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.060173 (+   133us) service_pool.cc:224] Handling call
0709 13:06:11.060566 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.060997 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.061037 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.127482 (+ 66445us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.953178 (+825696us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.953220 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.953297 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.132385 (+179088us) raft_consensus.cc:1685] finished
0709 13:06:12.132409 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.132611 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":269,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7457,"thread_start_us":824561,"threads_started":1,"wal-append.queue_time_us":984450}
I20260709 13:06:12.179497 15644 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:12.183763 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.013s	sys 0.033s
W20260709 13:06:12.202217 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 554017us
I20260709 13:06:12.153995 16327 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:12.238620 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:12.311973 15688 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.000s	sys 0.079s
W20260709 13:06:12.524415 15688 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.008s	sys 0.106s
W20260709 13:06:12.522330 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 319107us
I20260709 13:06:12.494701 17034 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:12.525624 15762 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:12.242781 15791 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:12.238646 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:12.401885 17312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.005s	sys 0.005s
I20260709 13:06:12.181028 17376 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:12.413116 15796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.012s	sys 0.057s
I20260709 13:06:12.526894 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:12.234170 15612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.020s	sys 0.053s
I20260709 13:06:12.527335 16329 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:12.538125 16300 leader_election.cc:400] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4.
I20260709 13:06:12.538620 16300 leader_election.cc:403] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.527925 15714 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:12.524854 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 878411us
I20260709 13:06:12.237465 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:12.196286 17341 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:12.522472 15645 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.037s	sys 0.050s
W20260709 13:06:12.536854 15796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.014s	sys 0.062s
W20260709 13:06:12.537904 15612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.503s	user 0.028s	sys 0.060s
W20260709 13:06:12.329708 17368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.007s	sys 0.016s
W20260709 13:06:12.546538 15645 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.037s	sys 0.050s
I20260709 13:06:12.452450 17426 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.292413 17218 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:12.448313 15638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.007s
I20260709 13:06:12.241137 17386 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:12.307062 17405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.018s	sys 0.005s
W20260709 13:06:12.527369 17312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.005s	sys 0.006s
I20260709 13:06:12.526400 17388 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.182036 17384 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:12.554000 15638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.004s	sys 0.008s
I20260709 13:06:12.537642 17344 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.548749 17368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.007s	sys 0.017s
I20260709 13:06:12.176776 17274 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.196576 17323 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.525691 17034 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.217981 17309 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.549984 17326 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.549475 17215 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:12.552112 17325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.009s	sys 0.007s
W20260709 13:06:12.562919 17405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.022s	sys 0.011s
I20260709 13:06:12.561429 17078 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.556213 17426 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.566026 17379 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:12.561296 17386 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.566812 17387 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.560240 17218 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:12.602509 17325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.009s	sys 0.007s
I20260709 13:06:12.333179 17306 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.621157 17034 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:12.567608 17408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.017s	sys 0.052s
I20260709 13:06:12.626621 17227 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:12.627204 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 434413us
W20260709 13:06:12.633427 16325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.061s	sys 0.089s
I20260709 13:06:12.616291 16331 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.623432 15759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.002s	sys 0.024s
W20260709 13:06:12.741292 15759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.003s	sys 0.024s
I20260709 13:06:12.616891 17078 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.591387 17344 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:12.734862 15715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.043s	sys 0.057s
I20260709 13:06:12.609587 17215 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:12.750465 15722 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.000s
W20260709 13:06:12.731096 17408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.017s	sys 0.053s
I20260709 13:06:12.569280 17388 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.762188 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:12.763439 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.752476 15722 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:12.727016 17387 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.761404 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:12.753544 15715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.043s	sys 0.057s
W20260709 13:06:12.741608 16325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.061s	sys 0.090s
I20260709 13:06:12.775955 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.780865 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.781708 15788 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:12.782235 17388 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:12.783219 17274 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.783793 17274 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:12.787500 17368 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.788275 17368 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.751161 17078 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.751672 17227 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:12.792754 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.770067 17325 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.799441 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:12.801178 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:12.771953 17387 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:12.770313 17350 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:12.808192 15759 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:12.786293 17278 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.784292 17274 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.784526 17218 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:12.816747 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:12.784492 17384 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:12.788290 17426 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:12.824314 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:12.840626 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:12.844220 17299 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.844758 17299 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:12.845220 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:12.845981 16326 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.847865 15542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 274) took 2695 ms. Trace:
I20260709 13:06:12.851438 17215 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:12.851681 17309 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:12.820856 17350 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:12.811439 17387 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.792537 17078 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.767933 17376 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:12.854478 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 327625us
I20260709 13:06:12.855871 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:12.837520 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 301064us
I20260709 13:06:12.860714 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:12.848248 15542 rpcz_store.cc:276] 0709 13:06:10.152542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.152706 (+   164us) service_pool.cc:224] Handling call
0709 13:06:10.441587 (+288881us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2540ef3a 00007fad2b1c51cc 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:06:12.847796 (+2406209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:10.756837 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:10.883054 (+126217us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:10.886011 (+  2957us) write_op.cc:435] Acquired schema lock
0709 13:06:10.888192 (+  2181us) tablet.cc:662] Decoding operations
0709 13:06:10.975579 (+ 87387us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:10.975661 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:10.975699 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:10.976180 (+   481us) tablet.cc:701] Row locks acquired
0709 13:06:10.976201 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:10.976358 (+   157us) write_op.cc:270] Start()
0709 13:06:10.976474 (+   116us) write_op.cc:276] Timestamp: P: 1783602370976319 usec, L: 0
0709 13:06:10.976495 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:10.977242 (+   747us) log.cc:844] Serialized 1738 byte log entry
0709 13:06:10.979262 (+  2020us) op_driver.cc:464] REPLICATION: finished
0709 13:06:10.979741 (+   479us) write_op.cc:301] APPLY: starting
0709 13:06:10.979822 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:10.980004 (+   182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:10.980123 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:10.980760 (+   637us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:10.980913 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:10.980958 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:11.005352 (+ 24394us) log.cc:844] Serialized 41 byte log entry
0709 13:06:11.021173 (+ 15821us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:11.059380 (+ 38207us) write_op.cc:454] Released schema lock
0709 13:06:11.071285 (+ 11905us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:11.130044 (+ 58759us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:11.136268 (+  6224us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129378,"reported_tablets":5,"spinlock_wait_cycles":220274432,"child_traces":[["op",{"apply.queue_time_us":269,"apply.run_cpu_time_us":3008,"apply.run_wall_time_us":138909,"num_ops":4,"prepare.queue_time_us":365,"prepare.run_cpu_time_us":4418,"prepare.run_wall_time_us":225507,"replication_time_us":2648}]]}
I20260709 13:06:12.880893 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:12.881558 15792 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.798321 17227 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:12.914224 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58416.8us
I20260709 13:06:12.915838 15762 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:12.811674 17325 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.837262 17278 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.872283 17379 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.877482 17215 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.921733 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 1859) took 1515 ms. Trace:
I20260709 13:06:12.923822 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 138) took 1578 ms. Trace:
I20260709 13:06:12.877110 17309 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.912678 17444 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.926887 15645 rpcz_store.cc:276] 0709 13:06:11.345212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.345353 (+   141us) service_pool.cc:224] Handling call
0709 13:06:11.345680 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.345931 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:12.548316 (+1202385us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.923461 (+375145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.923523 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:12.923586 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.923658 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.923771 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36692,"prepare.queue_time_us":1390837,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":57915,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":1909,"thread_start_us":1528144,"threads_started":3}
I20260709 13:06:12.916721 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 407) took 1081 ms. Trace:
I20260709 13:06:12.927307 15796 rpcz_store.cc:276] 0709 13:06:11.406380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.406827 (+   447us) service_pool.cc:224] Handling call
0709 13:06:11.425989 (+ 19162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.426287 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:11.463677 (+ 37390us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.921237 (+1457560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.921309 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:12.921371 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.921473 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.921652 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37219,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":172885,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1456848,"threads_started":2,"wal-append.queue_time_us":1459370}
W20260709 13:06:12.941936 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 139147us
I20260709 13:06:12.912380 17323 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:12.918771 17384 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:12.930262 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89717.7us
I20260709 13:06:12.918418 17446 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.920121 17388 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:12.954491 15792 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:12.958328 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:12.959126 15722 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:12.845604 17299 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:12.873384 17443 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:06:12.931512 17379 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:13.047901 17434 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 13:06:13.048748 17436 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:06:13.050139 17227 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:13.050855 17430 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:06:12.945410 16325 rpcz_store.cc:276] 0709 13:06:11.830856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.833040 (+  2184us) service_pool.cc:224] Handling call
0709 13:06:11.843731 (+ 10691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.851840 (+  8109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.851883 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.852490 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.790639 (+938149us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:12.794593 (+  3954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.806244 (+ 11651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.867278 (+ 61034us) raft_consensus.cc:1685] finished
0709 13:06:12.867311 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.912557 (+ 45246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1463,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"thread_start_us":922284,"threads_started":1,"wal-append.queue_time_us":977347}
W20260709 13:06:13.054188 17433 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:06:13.054719 17274 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.056432 17376 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.058354 17344 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.058918 17386 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.059485 17368 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:13.061656 17261 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.885s	user 0.010s	sys 0.000s
I20260709 13:06:12.955227 17309 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.046108 17445 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.961345 17444 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:13.097623 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 143590us
W20260709 13:06:13.098696 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 238097us
I20260709 13:06:13.099963 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:13.100618 16325 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.082828 16326 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:13.067413 17387 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.044992 17341 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.068599 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:13.090744 17274 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.069581 17388 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.097129 17376 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:13.101625 17445 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.070413 17323 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.070883 17384 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.071169 16331 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:13.074414 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1495) took 1724 ms. Trace:
I20260709 13:06:13.075102 17453 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.074676 17078 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.077431 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:13.080592 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 258189us
I20260709 13:06:13.038991 17218 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:12.932825 17215 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.111927 17368 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.130514 17368 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.130995 17368 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.110021 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 1858) took 1701 ms. Trace:
W20260709 13:06:13.114375 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67275.6us
I20260709 13:06:13.120654 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:13.119098 15647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1499) took 1767 ms (client timeout 1794 ms). Trace:
I20260709 13:06:13.134472 15688 leader_election.cc:400] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:13.127434 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.128110 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.136523 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.122392 15718 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:13.128861 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.129801 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:13.139058 15716 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:13.111402 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:13.127942 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:13.134588 15647 rpcz_store.cc:269] 0709 13:06:11.351312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.403784 (+ 52472us) service_pool.cc:224] Handling call
0709 13:06:13.118847 (+1715063us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54002684d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:13.119007 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253905024}
I20260709 13:06:13.133287 15790 rpcz_store.cc:276] 0709 13:06:11.406081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.406188 (+   107us) service_pool.cc:224] Handling call
0709 13:06:13.106853 (+1700665us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54001374d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:13.106952 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714427648}
I20260709 13:06:13.143006 15688 leader_election.cc:400] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:13.111846 17465 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.147166 17215 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.168843 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:13.151347 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 1868) took 1450 ms. Trace:
I20260709 13:06:13.149382 15791 raft_consensus.cc:2368] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4.
I20260709 13:06:13.156198 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1497) took 1805 ms. Trace:
W20260709 13:06:13.115718 17422 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.413s	user 0.004s	sys 0.009s
I20260709 13:06:13.145033 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.173552 15796 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:13.174633 15788 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:13.171993 15639 rpcz_store.cc:276] 0709 13:06:11.350864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.152164 (+1801300us) service_pool.cc:224] Handling call
0709 13:06:13.155513 (+  3349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.155742 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.155778 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:13.155848 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:13.155892 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.155967 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.156115 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:13.170266 15789 rpcz_store.cc:276] 0709 13:06:11.701259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.701434 (+   175us) service_pool.cc:224] Handling call
0709 13:06:11.701870 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.707670 (+  5800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.707709 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.707773 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.707823 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.151105 (+1443282us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b54004213d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:13.151152 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.151284 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12843392}
I20260709 13:06:13.172719 16297 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:13.179011 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1503) took 1821 ms (client timeout 1614 ms). Trace:
I20260709 13:06:13.097342 17261 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:13.125866 16326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 337) took 1848 ms (client timeout 1717 ms). Trace:
I20260709 13:06:13.116532 17384 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.117964 17387 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:13.133616 17227 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:13.179436 15641 rpcz_store.cc:269] 0709 13:06:11.360392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.370630 (+ 10238us) service_pool.cc:224] Handling call
0709 13:06:13.178800 (+1808170us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540045f1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:13.178935 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2855407744}
I20260709 13:06:13.147614 17447 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.190569 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:13.152536 17445 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:13.186740 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 270984us
I20260709 13:06:13.193913 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:13.150368 17379 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.195823 17277 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.196101 17277 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:13.196327 17277 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.113934 17388 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.188656 16297 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:13.151203 17278 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.155892 17454 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:13.198882 17454 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.151530 17283 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.149121 17078 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.176324 17350 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.112610 17376 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.134517 17323 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:13.191206 16332 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:13.183763 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:13.202865 17376 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.168272 17306 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.203197 17277 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.203557 17323 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.203934 17306 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.178599 17404 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:13.141070 17218 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.182056 17215 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:13.209651 15762 leader_election.cc:400] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:13.186841 17274 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.167042 17465 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.190407 17384 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.192471 17227 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.218327 16327 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:13.216959 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:13.218854 17261 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:13.219578 17428 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.892s	user 0.001s	sys 0.002s
W20260709 13:06:13.217598 17452 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:06:13.220108 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:13.220994 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 1860) took 1814 ms. Trace:
I20260709 13:06:13.209106 17404 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.221454 15787 rpcz_store.cc:276] 0709 13:06:11.406662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.409250 (+  2588us) service_pool.cc:224] Handling call
0709 13:06:11.415433 (+  6183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.415711 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.415740 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.416302 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.196877 (+780575us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:12.210993 (+ 14116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.264398 (+ 53405us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.167197 (+902799us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:13.220651 (+ 53454us) raft_consensus.cc:1685] finished
0709 13:06:13.220693 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.220929 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5575424,"thread_start_us":758437,"threads_started":1,"wal-append.queue_time_us":895135}
I20260709 13:06:13.192998 17447 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.224452 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:13.225245 16327 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:13.226244 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 213) took 2200 ms. Trace:
I20260709 13:06:13.226603 15719 rpcz_store.cc:276] 0709 13:06:11.026241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.027544 (+  1303us) service_pool.cc:224] Handling call
0709 13:06:11.027933 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.057172 (+ 29239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.057206 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.132065 (+ 74859us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.269086 (+137021us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:12.041715 (+772629us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.042288 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.042370 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.115155 (+1072785us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:13.213456 (+ 98301us) raft_consensus.cc:1685] finished
0709 13:06:13.226064 (+ 12608us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.226172 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28828,"prepare.queue_time_us":178980,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":36899,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":19929,"spinlock_wait_cycles":26152704,"thread_start_us":819834,"threads_started":2,"wal-append.queue_time_us":535254}
I20260709 13:06:13.228695 17078 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:13.229285 17078 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.231789 17078 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:13.214622 17455 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.118739 15638 rpcz_store.cc:276] 0709 13:06:11.350322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.825936 (+475614us) service_pool.cc:224] Handling call
0709 13:06:11.826432 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.826732 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:12.593323 (+766591us) log.cc:844] Serialized 14 byte log entry
0709 13:06:13.074011 (+480688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:13.074084 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:13.074137 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.074212 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.074349 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96590,"prepare.queue_time_us":956564,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":129132,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":1075725,"threads_started":2,"wal-append.queue_time_us":500743}
I20260709 13:06:13.237401 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:13.209728 17277 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:13.214473 17215 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:13.262750 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53248.3us
I20260709 13:06:13.264335 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:13.265651 17323 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:13.268098 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:13.269687 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:13.269848 17446 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4.
I20260709 13:06:13.275312 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:13.277305 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:13.276739 17261 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:13.277824 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:13.278414 17449 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.280616 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.282320 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:13.280180 17277 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:13.283464 16328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 388) took 2977 ms (client timeout 3331 ms). Trace:
I20260709 13:06:13.283646 17277 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.285413 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.287213 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.278301 17299 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.291728 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:13.292980 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.295125 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:13.184821 16326 rpcz_store.cc:269] 0709 13:06:11.276475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.281356 (+  4881us) service_pool.cc:224] Handling call
0709 13:06:12.836415 (+1555059us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:13.110753 (+274338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8191232}
I20260709 13:06:13.296854 15611 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:13.297176 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 71213.9us
I20260709 13:06:13.298779 15644 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:13.299789 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.274052 17388 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.284487 17350 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:13.284021 16328 rpcz_store.cc:269] 0709 13:06:10.306130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.306817 (+   687us) service_pool.cc:224] Handling call
0709 13:06:13.280410 (+2973593us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540066eed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:13.283370 (+  2960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3918969216}
I20260709 13:06:13.276759 17283 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:13.305194 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.284396 17261 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.306263 17396 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.306742 17460 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:13.307425 17274 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:13.280014 17444 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:06:13.318719 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 150012us
I20260709 13:06:13.283989 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.322145 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.322582 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.323110 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.424479 15792 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:13.323951 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:13.425885 15794 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.324469 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:13.430210 15795 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.324745 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.325471 15796 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.290467 17277 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.330030 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.328183 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:13.432663 15647 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.308825 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 1943) took 1889 ms. Trace:
I20260709 13:06:13.433588 15715 rpcz_store.cc:276] 0709 13:06:11.419040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.420394 (+  1354us) service_pool.cc:224] Handling call
0709 13:06:11.420998 (+   604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.450449 (+ 29451us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:11.492081 (+ 41632us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.867807 (+1375726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.867865 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:12.867909 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.308597 (+440688us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b540003d254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:13.308644 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.308770 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15451,"prepare.queue_time_us":51429,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":87327,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12314,"spinlock_wait_cycles":67088256,"thread_start_us":1359769,"threads_started":2,"wal-append.queue_time_us":1293078}
I20260709 13:06:13.366768 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:13.436765 15644 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.309170 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:13.327988 17405 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.327292 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:13.326350 17465 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:13.313393 17376 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:06:13.329308 17283 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.343910 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 342) took 1252 ms. Trace:
I20260709 13:06:13.442278 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.584846 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.596973 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.600816 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:13.530791 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.609091 15789 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:13.566424 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.610822 15796 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:13.604118 15790 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:13.431254 15793 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:13.326265 17350 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.348332 17274 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.679986 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1511) took 1676 ms. Trace:
I20260709 13:06:13.309971 17464 raft_consensus.cc:2764] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:13.344842 17218 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:13.291308 17449 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.367787 17344 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:13.598899 17405 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.699458 15646 rpcz_store.cc:276] 0709 13:06:12.003066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.229295 (+226229us) service_pool.cc:224] Handling call
0709 13:06:12.229758 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.403025 (+173267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.403070 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.403129 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:12.403172 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.654143 (+1250971us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000aa354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:13.679668 (+ 25525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.679876 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397756672}
I20260709 13:06:13.711229 15643 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.420015 17443 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.419632 17312 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.422031 17396 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.626255 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:13.689383 17388 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.328192 17466 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:13.711818 17274 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.367563 17460 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.717450 17384 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.806594 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:13.807229 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 386526us
I20260709 13:06:13.721302 17405 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.709348 17454 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:13.812500 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.814379 15794 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:13.814675 15789 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
W20260709 13:06:13.817878 16333 consensus_meta.cc:287] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.547s	user 0.017s	sys 0.011s
I20260709 13:06:13.818245 16333 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:13.758977 17299 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:13.771971 16326 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.890446 15795 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:13.949151 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.950217 15789 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:13.952744 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:13.953503 15789 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:13.598477 16331 rpcz_store.cc:276] 0709 13:06:12.082061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.123396 (+ 41335us) service_pool.cc:224] Handling call
0709 13:06:13.326394 (+1202998us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54006cfcd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:13.333996 (+  7602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055456640}
I20260709 13:06:13.724027 17344 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:13.948681 16325 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.848s	user 0.023s	sys 0.027s
W20260709 13:06:13.999220 15760 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.019s	sys 0.039s
W20260709 13:06:13.999614 15760 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.019s	sys 0.039s
W20260709 13:06:13.999886 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 597274us
I20260709 13:06:13.772857 17312 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.773046 17396 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.776396 17443 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:13.966040 17442 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:13.816103 17384 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.817394 17466 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.946591 17299 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:13.999918 16325 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:14.028690 16329 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:14.030843 17344 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.031064 17299 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.027717 17460 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:14.033006 17368 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.901s	user 0.012s	sys 0.006s
I20260709 13:06:14.033481 17368 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.035866 17368 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.038317 17466 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.039417 17312 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.044217 17449 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.014454 17261 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.050657 17283 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.023236 17442 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.057512 17350 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.061532 17396 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:14.062574 17455 consensus_meta.cc:287] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.014s
I20260709 13:06:14.062686 17384 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.062997 17455 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.063628 17443 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.064281 17442 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:14.093403 15610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.007s
W20260709 13:06:14.094376 15610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.007s	sys 0.007s
I20260709 13:06:14.096181 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:14.096979 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 787830us
W20260709 13:06:14.098029 15611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.011s
W20260709 13:06:14.100514 15611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.011s
W20260709 13:06:14.101043 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 680065us
W20260709 13:06:14.102982 15644 consensus_meta.cc:287] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.003s
I20260709 13:06:14.103605 15644 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:14.105468 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:14.106843 15646 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:14.102661 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:14.108776 15647 consensus_meta.cc:287] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.675s	user 0.023s	sys 0.008s
I20260709 13:06:14.115245 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:14.120450 15643 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:14.134110 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.135363 15794 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:14.137835 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.142705 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.143788 15794 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:14.130288 15647 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:14.146538 16327 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.047717 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.155336 16331 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:14.156502 17285 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.158273 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 343) took 1058 ms. Trace:
I20260709 13:06:14.159024 16325 rpcz_store.cc:276] 0709 13:06:13.099519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.099668 (+   149us) service_pool.cc:224] Handling call
0709 13:06:14.157932 (+1058264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:14.160422 17375 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:14.163117 17375 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.166344 17376 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.159755 17328 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.171159 17328 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.174319 17285 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.177999 17285 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.180379 17375 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.187178 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.184792 17328 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.189872 17442 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.189872 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.190850 17442 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.191849 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.192723 16328 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
W20260709 13:06:14.235551 17277 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.680s	user 0.023s	sys 0.016s
I20260709 13:06:14.236200 17277 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.251390 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.257604 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.258845 15794 raft_consensus.cc:2368] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3.
W20260709 13:06:14.259919 15791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 157) took 1500 ms (client timeout 1940 ms). Trace:
W20260709 13:06:14.260504 15791 rpcz_store.cc:269] 0709 13:06:12.759514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.761163 (+  1649us) service_pool.cc:224] Handling call
0709 13:06:14.259369 (+1498206us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400152f54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:14.259675 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875016576}
I20260709 13:06:14.269023 17384 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.262696 17442 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:14.268980 15685 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.007s	sys 0.020s
W20260709 13:06:14.272707 15685 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.008s	sys 0.020s
I20260709 13:06:14.278872 17384 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.282264 16297 leader_election.cc:400] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3.
I20260709 13:06:14.282703 16297 leader_election.cc:403] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.283303 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 344) took 1181 ms. Trace:
I20260709 13:06:14.283836 16333 rpcz_store.cc:276] 0709 13:06:13.102058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.102180 (+   122us) service_pool.cc:224] Handling call
0709 13:06:14.282874 (+1180694us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54004d85d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:14.283098 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301104000}
I20260709 13:06:14.290876 16334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 417) took 1072 ms. Trace:
W20260709 13:06:14.295243 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 180393us
W20260709 13:06:14.295014 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 739314us
I20260709 13:06:14.297441 17277 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.298625 17215 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.302073 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:14.293215 16334 rpcz_store.cc:276] 0709 13:06:13.219190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.219413 (+   223us) service_pool.cc:224] Handling call
0709 13:06:13.219671 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.223118 (+  3447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.223156 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:13.223203 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:13.223232 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.289595 (+1066363us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b54004b4954. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:14.289707 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.290390 (+   683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7431936}
I20260709 13:06:14.300320 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:14.307138 17309 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.308879 17306 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.309341 17215 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.311934 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:14.312556 17325 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.318753 17447 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.320438 17384 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.320717 16326 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
W20260709 13:06:14.322678 17405 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.005s
I20260709 13:06:14.329720 17344 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3.
I20260709 13:06:14.327302 15790 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.338848 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1603) took 1013 ms. Trace:
I20260709 13:06:14.328845 17384 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.339363 15790 rpcz_store.cc:276] 0709 13:06:13.325783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.613001 (+287218us) service_pool.cc:224] Handling call
0709 13:06:14.326148 (+713147us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:14.326700 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.338370 (+ 11670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.338728 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253287680}
I20260709 13:06:14.328405 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.329341 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.344934 17384 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.345469 17384 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.349677 17384 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.349035 17445 raft_consensus.cc:1064] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:14.347384 17405 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.331730 16327 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:14.307651 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:14.353591 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.354871 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:14.355517 17445 raft_consensus.cc:1068] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Unable to promote non-voter 228b1ac5589e48af9bbf6caecd6aeaea: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:14.356523 17487 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.360212 17405 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.362764 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:14.362860 17274 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.003s
I20260709 13:06:14.362857 15788 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:14.363447 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 431) took 1093 ms. Trace:
I20260709 13:06:14.364722 17447 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.364275 17274 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.363899 16326 rpcz_store.cc:276] 0709 13:06:13.270160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.334172 (+ 64012us) service_pool.cc:224] Handling call
0709 13:06:14.363214 (+1029042us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b540066e4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:14.363344 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7323904}
I20260709 13:06:14.366425 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.276878 17442 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:14.367501 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 60108us
I20260709 13:06:14.363849 17445 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:14.369602 17274 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.369645 17445 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.370311 17445 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:14.369374 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:14.372042 17227 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.371565 17445 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.373186 17458 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:14.367538 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 463214us
I20260709 13:06:14.379462 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.379614 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.375303 17445 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.380609 15643 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:14.380749 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.375303 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:14.382125 15788 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:14.382972 17404 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.386090 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.376614 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 413) took 1166 ms. Trace:
I20260709 13:06:14.387144 15788 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:14.386936 16329 rpcz_store.cc:276] 0709 13:06:13.210413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.210616 (+   203us) service_pool.cc:224] Handling call
0709 13:06:14.028454 (+817838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.029219 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.376195 (+346976us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54002ac6d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:14.376417 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880039168}
I20260709 13:06:14.388785 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.379256 17227 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.392987 17227 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.393496 17227 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.395380 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.390311 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.390764 16297 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.391076 16331 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:14.391181 17447 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.397960 17447 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.398478 17447 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.400302 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.378681 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.401549 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.404287 15643 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:14.397153 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:14.411074 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 428) took 1147 ms. Trace:
I20260709 13:06:14.398015 17404 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.411811 17404 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.412266 17404 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.381623 15789 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:14.405928 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.411506 16327 rpcz_store.cc:276] 0709 13:06:13.263214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.264026 (+   812us) service_pool.cc:224] Handling call
0709 13:06:14.410872 (+1146846us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54005ae954. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:14.411009 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009329536}
I20260709 13:06:14.416807 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.418308 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.418196 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.419312 15721 raft_consensus.cc:2368] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:14.419221 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.418381 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:14.420091 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46156.2us
I20260709 13:06:14.421314 17408 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.422147 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:14.385941 17442 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.423616 15541 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 3 to 4, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.410406 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.426738 17379 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:14.432636 17379 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:14.413822 17405 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:14.427716 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:14.431850 15545 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 245) took 4124 ms. Trace:
I20260709 13:06:14.434123 17078 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.433151 15541 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.434158 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.437175 17078 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.434016 17379 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.440135 17078 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.441430 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.442454 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 174) took 1104 ms. Trace:
I20260709 13:06:14.442862 15796 rpcz_store.cc:276] 0709 13:06:13.338756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.611712 (+272956us) service_pool.cc:224] Handling call
0709 13:06:14.441080 (+829368us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:14.442399 (+  1319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447850752}
I20260709 13:06:14.434870 15545 rpcz_store.cc:276] 0709 13:06:10.307364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.337723 (+ 30359us) service_pool.cc:224] Handling call
0709 13:06:14.431600 (+4093877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:13.103641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:13.104210 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:13.104242 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:06:13.104264 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:13.104581 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:13.104653 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:13.104691 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:13.104875 (+   184us) tablet.cc:701] Row locks acquired
0709 13:06:13.104893 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:13.105039 (+   146us) write_op.cc:270] Start()
0709 13:06:13.105152 (+   113us) write_op.cc:276] Timestamp: P: 1783602373105000 usec, L: 0
0709 13:06:13.105179 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:13.111059 (+  5880us) log.cc:844] Serialized 530 byte log entry
0709 13:06:13.268916 (+157857us) op_driver.cc:464] REPLICATION: finished
0709 13:06:14.005313 (+736397us) write_op.cc:301] APPLY: starting
0709 13:06:14.011007 (+  5694us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:14.022589 (+ 11582us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:14.040204 (+ 17615us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:14.040517 (+   313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:14.040734 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:14.040802 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:14.041065 (+   263us) log.cc:844] Serialized 23 byte log entry
0709 13:06:14.041295 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:14.041404 (+   109us) write_op.cc:454] Released schema lock
0709 13:06:14.041456 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:14.054992 (+ 13536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:14.058153 (+  3161us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1643972,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":706429,"apply.run_cpu_time_us":2232,"apply.run_wall_time_us":48192,"num_ops":1,"prepare.queue_time_us":206582,"prepare.run_cpu_time_us":25021,"prepare.run_wall_time_us":103546,"raft.queue_time_us":16050,"raft.run_cpu_time_us":15624,"raft.run_wall_time_us":327500,"replication_time_us":163594,"thread_start_us":398493,"threads_started":4,"wal-append.queue_time_us":83796}]]}
W20260709 13:06:14.444133 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.443851 15643 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.422169 17408 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.447614 17408 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.454900 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.454664 15541 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 3, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.456094 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.458068 17277 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:14.458638 17277 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:14.456166 17325 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:14.459589 17325 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:14.454875 17404 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.480528 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.481401 15719 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:14.482558 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:14.483088 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 49044.3us
I20260709 13:06:14.483373 15722 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:14.484447 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.484505 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:14.485637 17215 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.486235 17215 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.486153 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.486581 17442 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.486754 17215 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.486263 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58736.5us
I20260709 13:06:14.485181 15722 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:14.485685 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.493427 15716 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:14.494304 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.494910 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.495569 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.496363 15719 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:14.496134 17227 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.459848 17277 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.510070 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.510380 17325 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.517246 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.497902 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.518082 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.498687 17445 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.533888 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.535341 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.536859 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.538045 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.538365 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.545974 17423 raft_consensus.cc:2764] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:14.547043 17227 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.547894 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.529793 15640 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:14.555784 15714 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:14.545974 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.538069 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.562052 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.531769 17404 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.518734 17447 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.566942 17227 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:14.620034 17227 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.620469 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.621383 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.621888 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.622736 15718 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:14.623363 15639 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
W20260709 13:06:14.587764 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 49870.1us
W20260709 13:06:14.625118 17488 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:14.606217 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:14.604336 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.573549 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.626034 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.587388 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:14.618954 17485 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.587859 17445 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:14.627872 17227 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:14.636647 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.637614 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.642140 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.568161 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:14.618853 17263 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.662279 17263 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.662810 17263 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.663107 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.664288 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.646570 15788 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:14.646672 17485 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.655509 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.679014 15717 raft_consensus.cc:2368] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:14.656051 15796 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.657254 15644 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:14.658013 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:14.681679 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:14.682073 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 123021us
I20260709 13:06:14.684823 17408 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.659365 17447 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.685858 17454 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.654033 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.686477 17454 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.686973 17454 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:14.687008 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45179.7us
I20260709 13:06:14.688308 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.691901 17309 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.692538 17309 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.693084 17309 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.694187 15638 raft_consensus.cc:2368] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3.
W20260709 13:06:14.699577 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.567642 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.640836 17384 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.671325 17368 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.700865 15646 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:14.669579 17445 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:14.701660 17485 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.710209 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.711783 15720 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:14.719372 17447 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.719985 17447 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.720413 17447 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.717514 17455 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.721604 17455 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.722157 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.723596 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.733916 17274 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.734313 17445 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.734623 17263 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.734889 17274 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.736945 17263 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.737802 17477 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.740278 17384 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:14.742195 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.742195 15713 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.746511 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.748584 15796 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:14.751080 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.747586 17368 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.752779 17400 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.753093 15715 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.753422 17400 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:14.754490 17368 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.755468 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.757550 17400 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:14.766675 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:14.767362 15789 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:14.776587 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 70899us
I20260709 13:06:14.780377 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:14.780020 17489 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:14.787544 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.792687 17215 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.793367 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.794227 15790 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:14.795666 17215 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.798087 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.802095 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:14.806315 16331 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:14.791893 17274 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.805281 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.808943 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.815680 15719 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:14.820710 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.823361 15796 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.820235 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.828307 16297 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.830706 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.831099 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.831456 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.832139 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.832348 17455 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:14.832890 17495 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.236s	user 0.006s	sys 0.000s
I20260709 13:06:14.833635 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.834134 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.834319 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:14.838006 17309 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.839685 17477 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:14.840276 17477 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.840444 17309 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.841507 15722 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:14.842417 17485 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.850193 15788 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:14.851478 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:14.859130 16297 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:14.873132 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.866616 17274 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.889560 17274 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:14.889650 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.875324 15717 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.890244 17274 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.869356 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:14.894788 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.898903 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.900180 16331 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:14.902647 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.906250 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.909200 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.912370 17485 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:14.874997 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.860558 17455 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:14.930270 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67123.3us
I20260709 13:06:14.939716 15722 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.940129 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:14.943063 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 56885us
I20260709 13:06:14.918041 17326 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:14.950393 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 74297.7us
I20260709 13:06:14.954370 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.955487 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.956069 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.955880 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:14.958971 15792 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:14.961980 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:14.963320 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:14.966872 15720 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:14.994544 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.978017 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:14.968472 17309 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.015545 17309 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:15.014771 16328 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:15.016126 17309 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.969511 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.979453 17394 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:14.966831 17379 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:14.979730 17423 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:15.014839 17387 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.026067 17387 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:15.025952 17379 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.026539 17387 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.028527 17379 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.011008 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:14.980713 17445 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:06:14.987658 17454 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.019769 17408 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:15.019858 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:14.982990 17447 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.020630 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.031415 17454 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.032001 15720 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:15.032258 17485 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:14.965237 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:15.020912 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.032652 17485 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:15.021222 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:15.033615 17485 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.034730 17485 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.035725 15713 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:15.037274 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:14.978391 15610 connection.cc:256] RPC call timeout handler was delayed by -1.76382829399995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:06:15.038846 15610 connection.cc:256] RPC call timeout handler was delayed by -1.1031974869999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:06:15.039022 15719 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.039301 15722 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:15.024044 17394 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.040248 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.040493 17328 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:14.980002 17325 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.042037 17325 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:15.042475 17423 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.043848 17325 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:14.968626 17326 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:15.045795 17394 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.046180 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.046818 15647 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:15.046882 17326 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.041090 17328 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.054913 17477 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.056600 17328 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.058235 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.059078 17274 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.060367 16331 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.061504 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:15.061978 15646 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:15.062361 15647 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:15.028144 17309 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.060165 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.070183 17477 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.070457 17487 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.071861 17487 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.072295 17379 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.073053 17487 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.073472 17394 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.074328 17312 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:15.073954 17394 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.015568 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:15.075712 17388 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:15.076512 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61001.2us
I20260709 13:06:15.076622 17394 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.065769 15713 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.065657 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:15.067099 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.067834 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:15.067905 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.068543 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.068785 17447 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.078058 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:15.081260 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:14.964030 17455 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:15.082571 15645 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:15.083357 15641 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:15.094105 15647 raft_consensus.cc:2368] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:15.084141 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.154062 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:15.157622 15791 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:15.141009 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.156585 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:15.152112 16329 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:15.158129 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.099951 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.099841 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.100741 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.158150 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.186038 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.187970 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.189632 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.073491 17487 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.095703 17408 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.202235 15794 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.194386 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.173996 17394 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.194684 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:15.190590 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.194448 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.189960 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.195266 15717 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:15.199177 15639 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:15.188655 15643 raft_consensus.cc:2376] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:15.221827 17408 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.224560 17227 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:15.222409 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.137797 17454 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:06:15.224583 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.225781 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.232583 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.268661 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:15.230398 17078 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.239657 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.221724 17487 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.156031 17483 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.276997 15645 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:15.202661 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:15.223800 17312 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.225168 17458 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.229979 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.282439 15791 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.221985 17328 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.223202 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.283222 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.238440 17387 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.252079 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.152354 17274 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.203645 15715 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.288250 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.260608 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.137969 17350 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.209726 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.229945 17442 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:15.223105 15642 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:15.237378 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:15.098546 17309 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:15.263211 15713 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.264048 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:15.221669 16298 leader_election.cc:336] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.033s (SENT)
I20260709 13:06:15.273777 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.276806 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.237285 17455 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.252089 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:15.278362 15688 connection.cc:256] RPC call timeout handler was delayed by -2.1959549150000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 13:06:15.283408 15647 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
W20260709 13:06:15.304098 15688 connection.cc:256] RPC call timeout handler was delayed by -1.907319566999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 13:06:15.274482 15788 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:15.276630 17483 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.268445 17408 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.205654 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.289278 15641 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:15.295495 15795 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.296079 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.291499 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.250308 17423 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:15.305992 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:15.307960 15789 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.309969 17485 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.285957 17388 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:15.310951 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.313439 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.314100 15792 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.314281 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:15.319667 15793 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.318944 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:15.324542 17387 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:15.328729 15793 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:15.330140 15791 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:15.330801 15795 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
W20260709 13:06:15.333803 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 96663.8us
I20260709 13:06:15.334616 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.310436 17485 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:15.338408 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:15.342530 15793 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.339156 15641 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:15.340153 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 118659us
I20260709 13:06:15.315946 17350 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:15.349519 17350 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:15.318418 17477 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.356437 15787 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:15.358170 17447 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.318176 17388 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.345552 17485 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.337984 17458 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.384032 15794 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:15.381363 17388 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.386757 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:15.360265 17277 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.328586 17454 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:15.371155 17447 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:15.409798 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:15.362695 17309 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:15.412803 16297 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:15.421459 15793 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:15.402532 17227 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:15.389577 17477 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.436420 15792 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:15.430473 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:15.389922 17344 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:15.429844 17400 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:15.452476 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49137.3us
I20260709 13:06:15.442317 17350 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:15.455490 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.442253 17227 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:15.452454 17326 raft_consensus.cc:2764] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:15.456167 17350 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:15.460347 17350 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.476282 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.476526 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.477159 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.477945 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:15.478581 15713 raft_consensus.cc:2376] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3. Re-sending same reply.
I20260709 13:06:15.479508 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.480425 15715 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:15.453879 17386 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.469517 17350 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.490168 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:15.373951 17483 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.495352 17483 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.497584 15646 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:15.503243 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.506745 15713 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:15.503803 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.506973 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.509927 15717 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:15.457814 17447 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.507392 17513 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.502063 17477 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:15.507524 17514 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.524278 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:15.526039 17309 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:15.527444 17487 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.524662 17514 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.529997 17227 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.531839 17514 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:15.532953 17445 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.534085 17405 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:15.534500 17405 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.486665 17400 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:15.535377 17405 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.536307 17400 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.536938 17405 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.538174 17309 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:15.538635 17309 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:15.539516 17309 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.540939 17215 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.541107 17309 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.541414 17215 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:15.542699 17215 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.544407 17215 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.546283 17394 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:15.546860 17394 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.524603 17447 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:15.549424 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 264017us
I20260709 13:06:15.533404 17445 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:15.555836 17326 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.556782 17394 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:15.557418 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:15.559787 15541 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 271) took 4858 ms. Trace:
I20260709 13:06:15.560312 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:15.559994 17445 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.562045 17445 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.563001 17386 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.563398 17519 raft_consensus.cc:1064] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:15.564927 16298 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:15.563908 17519 raft_consensus.cc:1068] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Unable to promote non-voter 228b1ac5589e48af9bbf6caecd6aeaea: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:15.563515 17386 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:15.564801 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 299719us
W20260709 13:06:15.587285 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.588104 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.588699 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.588864 15789 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:15.560178 15541 rpcz_store.cc:276] 0709 13:06:10.701042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.701284 (+   242us) service_pool.cc:224] Handling call
0709 13:06:11.207736 (+506452us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2540ef3a 00007fad2b1c51cc 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:06:15.559711 (+4351975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:14.674150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:14.674942 (+   792us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:14.674998 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:06:14.675020 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:14.675776 (+   756us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:14.675873 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:14.675905 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:14.676443 (+   538us) tablet.cc:701] Row locks acquired
0709 13:06:14.676496 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:06:14.676676 (+   180us) write_op.cc:270] Start()
0709 13:06:14.676849 (+   173us) write_op.cc:276] Timestamp: P: 1783602374676611 usec, L: 0
0709 13:06:14.676890 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:06:14.715466 (+ 38576us) log.cc:844] Serialized 1350 byte log entry
0709 13:06:14.954559 (+239093us) op_driver.cc:464] REPLICATION: finished
0709 13:06:15.298680 (+344121us) write_op.cc:301] APPLY: starting
0709 13:06:15.298782 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:15.298942 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:15.299096 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:15.299745 (+   649us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:15.300042 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:15.300145 (+   103us) write_op.cc:312] APPLY: finished
0709 13:06:15.354759 (+ 54614us) log.cc:844] Serialized 35 byte log entry
0709 13:06:15.358131 (+  3372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.358234 (+   103us) write_op.cc:454] Released schema lock
0709 13:06:15.358293 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:15.358727 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.358761 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":166166,"reported_tablets":6,"spinlock_wait_cycles":304740608,"child_traces":[["op",{"apply.queue_time_us":327795,"apply.run_cpu_time_us":2918,"apply.run_wall_time_us":67382,"num_ops":3,"prepare.queue_time_us":214132,"prepare.run_cpu_time_us":4410,"prepare.run_wall_time_us":75631,"replication_time_us":277448,"thread_start_us":331139,"threads_started":2}]]}
I20260709 13:06:15.590296 17274 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.640991 17408 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.642455 15796 raft_consensus.cc:2368] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
W20260709 13:06:15.643409 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 81234.3us
W20260709 13:06:15.644711 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 154669us
I20260709 13:06:15.646207 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:15.651434 17408 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:15.653697 15542 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 5 to 6, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:15.656353 17268 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.656786 17268 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.657611 17268 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.659289 17268 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.663152 15542 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.645569 15760 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:15.681309 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45201.8us
I20260709 13:06:15.584115 17458 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:06:15.584306 17388 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:06:15.591651 17394 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 13:06:15.711566 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 452471us
W20260709 13:06:15.768677 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 123183us
I20260709 13:06:15.770670 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.747496 17400 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:15.778028 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 213138us
W20260709 13:06:15.778366 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 62188.5us
I20260709 13:06:15.756496 17379 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:15.791827 17520 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.792410 15760 leader_election.cc:400] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:15.795128 17350 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:15.795323 15760 leader_election.cc:403] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.796809 17525 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.797286 17525 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.798295 17525 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.795632 17542 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.773748 17078 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:15.786772 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 104296us
I20260709 13:06:15.799795 17525 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.787890 17274 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.790112 17379 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.713208 17524 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:06:15.825892 17537 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:15.826234 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.828045 17400 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.828313 17386 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:15.834142 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.881132 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.821213 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:15.840301 16331 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:15.834911 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:15.843889 17388 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:15.861606 15796 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:15.862316 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50340.5us
I20260709 13:06:15.911127 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.912259 15762 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.862504 17325 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:15.869199 17509 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:06:15.915992 15716 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.917248 15718 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:15.917380 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 105096us
I20260709 13:06:15.921684 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:15.927711 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.927752 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:15.932490 17529 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.934892 17325 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.935916 17325 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.936259 17325 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:15.936934 17533 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.937495 17533 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.938964 17405 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.939607 17405 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:15.940065 15717 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:15.944983 17423 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.945483 17423 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.946432 17423 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.947721 17423 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.953202 17458 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.953655 17458 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:15.954422 17458 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.955637 17458 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.914285 17400 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.960180 17400 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:15.913884 17078 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.962127 17379 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.927342 17404 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:15.965097 15719 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:15.838325 17485 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:15.968055 17485 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:15.969228 17531 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:06:15.970000 17455 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.970381 17455 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:15.971175 17455 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:15.884121 17537 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.973775 17423 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:06:15.973882 15721 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.963553 17379 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:15.978317 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 56746.8us
I20260709 13:06:15.876412 17274 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:15.984453 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.987324 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:15.991925 15722 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:15.993419 17454 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:06:16.002329 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 184133us
W20260709 13:06:16.008936 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.010167 17442 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:16.012588 17442 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:16.012979 17442 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.002326 17455 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.016248 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:15.989207 17386 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:16.016793 17537 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:16.024945 17326 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.032564 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:16.034623 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.040712 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63289.9us
I20260709 13:06:16.025087 17386 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:16.046816 17386 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:16.041301 17487 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.007s
I20260709 13:06:16.058662 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.054011 17326 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.061431 17227 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:16.072376 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.073012 15646 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:16.074584 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.075337 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:16.079113 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.079862 15639 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:16.083767 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.085479 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.088357 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.089113 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:16.090529 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 47229.2us
I20260709 13:06:16.090637 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.091996 17274 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.092734 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.093664 15647 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:16.093577 17519 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.094234 17519 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:16.094308 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.095112 17485 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.098219 17514 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.098924 17312 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:16.092815 17539 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.099406 17312 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:16.089234 17277 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.100373 17312 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.088973 17529 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:16.105218 17529 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:16.089161 17522 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.106127 17522 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:16.106611 17522 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.107883 17405 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.107741 17325 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.109687 15641 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.105998 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.112149 15796 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:16.097689 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.108816 17325 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.066306 17227 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.095211 17519 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.118304 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.119874 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.120111 15647 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.120697 15646 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:16.084945 17533 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.105584 17529 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:16.137729 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.140085 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.101617 17312 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.140820 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.145453 15639 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:16.120007 17485 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.152695 15685 leader_election.cc:400] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:06:16.150169 17423 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:16.156184 16300 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.500s (SENT)
I20260709 13:06:16.138618 17539 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.156466 17423 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:16.147063 17309 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:06:16.157410 17539 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.157539 17423 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.156303 17524 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:16.160933 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.161419 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.163755 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:16.164342 15791 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:16.164397 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 58548.7us
I20260709 13:06:16.138468 17513 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.164651 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:16.162492 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.163214 15789 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:16.166777 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.168650 15647 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:16.170274 17445 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:16.170908 17445 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.173079 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.147024 17454 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.179756 17521 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:16.182916 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:16.183671 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.184566 15794 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:16.153162 17455 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:16.179788 17545 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.180374 17521 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.205086 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.197983 15791 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:16.206378 15721 raft_consensus.cc:2410] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:16.189157 17408 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.205055 17379 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.207880 17379 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.209206 17227 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:16.210383 15720 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:16.188513 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.177968 17350 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.211794 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.212925 15721 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:16.214165 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:16.216512 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.217336 15794 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:16.216804 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.218834 15789 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:16.189152 17326 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.224367 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.206065 17442 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.226660 15792 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.228662 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.204634 17545 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:16.231868 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.212337 17379 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.213704 17350 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:16.187366 17537 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:06:16.221685 17328 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:16.264855 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 51162us
I20260709 13:06:16.206211 17455 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.228032 17078 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.229698 17227 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:16.285539 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 56924.7us
I20260709 13:06:16.266649 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.292217 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:16.288142 15787 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:16.271150 17350 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.262061 17514 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.298198 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.300840 15639 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.286240 17328 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.271714 17445 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.306922 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.347882 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.284755 17458 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.305935 17544 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.309604 17547 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:06:16.313187 17215 consensus_meta.cc:287] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.768s	user 0.013s	sys 0.017s
I20260709 13:06:16.297107 17513 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:06:16.315156 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.291168 17533 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:16.333712 17545 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.338109 17542 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:16.294818 17227 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.221249 17529 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.391402 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.398854 15713 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:16.399950 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 193503us
I20260709 13:06:16.340873 17328 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.401064 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:16.408978 16300 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.642s (SENT)
I20260709 13:06:16.373646 17387 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:16.380146 17544 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:16.386147 17525 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.306608 17521 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.288693 17485 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.401652 17524 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.382479 17477 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:16.405822 17542 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:16.415815 17274 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.408326 17326 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:16.441850 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.442366 16300 leader_election.cc:336] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.975s (SENT)
I20260709 13:06:16.445003 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.413107 17560 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:16.422128 17544 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.446673 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.399430 17533 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.425402 17454 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.424975 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42116 (request call id 75) took 1973 ms. Trace:
I20260709 13:06:16.422329 17522 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:16.480399 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.424587 17387 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.449584 17442 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:16.488260 16329 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.490082 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:16.472545 17400 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.490459 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.491714 17215 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:16.518081 17556 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:06:16.519429 17538 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:16.519937 17538 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.520308 17538 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.517880 17215 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.521401 17215 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:16.522428 17559 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:16.522032 17326 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.525727 15639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:16.517529 17532 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:16.517992 17530 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:16.551693 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61327.8us
I20260709 13:06:16.508368 17542 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.554462 17522 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.554313 17533 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:16.525806 17387 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:16.547520 17386 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:06:16.508991 17519 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:06:16.568925 15789 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.570552 15791 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.548216 17458 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.571288 17455 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.571722 15794 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.548193 16327 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:16.574239 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.577983 15791 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.478087 17388 rpcz_store.cc:276] 0709 13:06:14.437261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.441438 (+  4177us) service_pool.cc:224] Handling call
0709 13:06:14.452993 (+ 11555us) log.cc:844] Serialized 487 byte log entry
0709 13:06:14.687909 (+234916us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b18003525a0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad2535fb0b 00007fad253e4b63 00007fad2540c752 00007fad254049fa
0709 13:06:14.877711 (+189802us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b18003525a0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:06:16.407585 (+1529874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42351,"raft.queue_time_us":207738,"raft.run_cpu_time_us":769,"raft.run_wall_time_us":771,"spinlock_wait_cycles":29295872,"thread_start_us":34598,"threads_started":1,"wal-append.queue_time_us":79291,"wal-append.run_cpu_time_us":2106,"wal-append.run_wall_time_us":1016010}
I20260709 13:06:16.476891 17560 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.580019 15794 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.580873 17560 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:16.551285 17530 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:16.584018 17530 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.590101 15639 raft_consensus.cc:606] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:16.589576 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.592396 15791 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.604135 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.608345 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.609247 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.608731 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.585220 17350 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:16.572397 17454 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.572748 17386 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:16.618167 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.619700 17386 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:16.625589 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.626091 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.627218 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.627416 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.628144 17388 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.628746 17388 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.630119 17483 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.589567 17227 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.593889 17487 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:16.632627 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.643800 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.646768 15688 leader_election.cc:400] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:16.650082 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.651268 15719 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:16.654196 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.653883 17344 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:16.642104 17477 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.698833 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:16.700601 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 55161.1us
W20260709 13:06:16.701013 16300 leader_election.cc:336] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.761s (SENT)
W20260709 13:06:16.704516 17312 consensus_meta.cc:287] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
I20260709 13:06:16.701619 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.709267 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.713158 17458 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:16.713676 17487 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:06:16.713726 17458 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:16.707839 16300 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.838s (SENT) [suppressed 40 similar messages]
I20260709 13:06:16.715256 17483 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.677320 17477 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.716666 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.718199 17477 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:16.718937 17532 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:16.719316 17532 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.717505 17485 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.720216 17532 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.721335 17532 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.722015 17548 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:16.722419 17548 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:16.722566 17485 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.722762 17350 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:16.715307 17458 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.723342 17548 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.721894 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.726750 17458 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.726915 17530 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.728246 17548 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.732661 17487 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.733723 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:16.734783 17328 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.737079 17328 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.738456 15610 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.708864 17525 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:16.743018 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.743942 17530 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:16.731945 17325 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:06:16.758675 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.760133 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.742695 17545 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:16.764639 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.767001 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.750761 17525 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:16.769164 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 379205us
I20260709 13:06:16.768425 17530 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.772104 17325 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.765511 17215 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.763933 17328 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.783102 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.786375 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.775638 17530 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.788663 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.789968 15791 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:16.785454 17525 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.737619 17544 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.785174 17350 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:16.792340 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.793372 15794 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:16.792477 17530 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.796669 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.797435 17328 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:16.797328 17525 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:16.798535 17582 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:16.788174 17487 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.818403 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.819660 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.812595 17525 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:16.816402 17530 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.816529 17538 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.806795 17350 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:16.820595 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 112782us
I20260709 13:06:16.820724 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.822007 17328 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.823758 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.826905 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.828281 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.829053 17405 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.821417 17525 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:16.830103 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.824889 17312 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.822278 17487 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.832557 17388 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.832580 17483 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.836704 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:16.839200 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.830947 17454 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.838827 17530 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:16.844028 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.842083 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.852041 15647 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:16.852250 17454 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.843441 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.852871 17454 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:16.843787 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.854395 15640 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 2: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:16.855458 17454 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:16.856950 15639 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:16.845217 17350 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:16.851188 17529 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.864743 17544 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.868572 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.868196 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:16.874668 15794 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.839740 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.878793 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:16.879469 15787 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.881249 17379 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:16.881969 17585 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 13:06:16.881851 17379 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:16.883170 17483 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.883714 17483 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.868755 17538 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.884162 17447 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.884976 17447 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:16.885407 17447 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.883247 17379 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.888093 15532 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17db433a32844f26aa2fe7c2d4e4bf66 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:16.889181 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.891983 17530 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.877341 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.895920 15640 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:16.897149 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:16.897971 15791 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:16.898047 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.898376 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.898742 15643 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.901304 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.901926 15639 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.903962 15794 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:16.906172 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:16.909651 15791 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.911042 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:16.911517 15789 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:16.912173 15794 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:16.915937 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.916762 15645 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.919636 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.926690 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.928139 15643 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:16.929623 17483 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.892529 17530 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.940634 17530 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:16.938089 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:16.945362 17541 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:16.945869 17541 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:16.946267 17541 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.946445 17525 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:16.947858 17525 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.948010 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:16.948661 15714 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.949205 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:16.950258 15715 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:16.950026 17545 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.950397 15719 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.951893 17215 raft_consensus.cc:1064] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:16.952203 15722 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:16.953660 15713 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.954865 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.955449 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.956105 15717 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:16.951700 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:16.956758 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:16.956243 15642 raft_consensus.cc:2410] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:06:16.959733 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.917830 17400 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.970175 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.970810 15647 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:16.963012 15639 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:16.977547 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:16.978389 16329 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
W20260709 13:06:16.977624 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58094us
I20260709 13:06:16.979530 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:16.982782 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.984110 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:16.983508 15545 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.989784 15793 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:16.988607 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:16.997515 15714 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:16.989274 17400 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:17.002185 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.026050 15716 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:17.026340 15641 raft_consensus.cc:2410] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:17.026506 15716 pending_rounds.cc:85] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 5
I20260709 13:06:17.026891 15716 pending_rounds.cc:107] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:17.027181 15716 raft_consensus.cc:2889] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:17.027330 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.001399 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.028910 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.029888 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.025553 17400 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.002950 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:17.034019 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54585.4us
I20260709 13:06:17.034700 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.037068 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.038401 16327 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:17.038551 17485 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.039104 17485 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.040606 17379 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.041225 17485 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:17.006255 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.043129 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.043231 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.043973 15646 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 1.
I20260709 13:06:17.044801 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.045440 15646 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 2: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:17.010833 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:17.046497 17485 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.046984 17485 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:17.047454 17485 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.010985 17227 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.011261 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.048835 15542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 146) took 3907 ms. Trace:
I20260709 13:06:17.049670 15545 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.012661 17215 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.021001 17521 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.967398 17519 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:06:17.010295 17513 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.011977 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.060083 15718 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:17.061013 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.061013 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.061401 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.051964 15639 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:17.052690 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.064561 15722 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.996083 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:17.053583 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 60889us
I20260709 13:06:17.066119 16329 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:17.067533 15647 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:17.065729 15722 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:17.053709 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.055337 15645 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:17.056658 15643 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.059446 15641 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.072167 15545 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.066982 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.050323 17350 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:17.078052 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.078207 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:16.990149 17545 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.079272 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.016800 17541 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.079610 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.111361 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.079648 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.033341 17447 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.079046 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.119259 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.078569 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.077127 15545 catalog_manager.cc:5697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 3, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:06:17.122152 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 43637us
I20260709 13:06:17.082791 15718 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:17.107733 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 56788.4us
I20260709 13:06:17.122905 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.109592 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.112972 15646 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.124553 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.123482 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:17.126194 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.128010 15793 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:17.130153 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.139931 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:17.140170 15793 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:17.133821 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.077858 17487 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.157572 15644 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:17.161360 15721 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:17.151870 15647 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.153131 15639 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:17.049201 15542 rpcz_store.cc:276] 0709 13:06:13.141803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.141955 (+   152us) service_pool.cc:224] Handling call
0709 13:06:14.353458 (+1211503us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2540ef3a 00007fad2b1c51cc 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:06:17.048779 (+2695321us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:16.007442 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:16.037610 (+ 30168us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:16.037650 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:06:16.037665 (+    15us) tablet.cc:662] Decoding operations
0709 13:06:16.038158 (+   493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:16.038222 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:16.038253 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:16.038567 (+   314us) tablet.cc:701] Row locks acquired
0709 13:06:16.038586 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:16.038730 (+   144us) write_op.cc:270] Start()
0709 13:06:16.038853 (+   123us) write_op.cc:276] Timestamp: P: 1783602376038684 usec, L: 0
0709 13:06:16.038880 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:16.077931 (+ 39051us) log.cc:844] Serialized 968 byte log entry
0709 13:06:16.180158 (+102227us) op_driver.cc:464] REPLICATION: finished
0709 13:06:16.474040 (+293882us) write_op.cc:301] APPLY: starting
0709 13:06:16.476646 (+  2606us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:16.488591 (+ 11945us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:16.515448 (+ 26857us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:16.585947 (+ 70499us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:16.601953 (+ 16006us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:16.608933 (+  6980us) write_op.cc:312] APPLY: finished
0709 13:06:16.616770 (+  7837us) log.cc:844] Serialized 29 byte log entry
0709 13:06:16.616991 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:16.617087 (+    96us) write_op.cc:454] Released schema lock
0709 13:06:16.617133 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:16.617551 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:16.617576 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62916,"reported_tablets":7,"spinlock_wait_cycles":107159808,"child_traces":[["op",{"apply.queue_time_us":257558,"apply.run_cpu_time_us":2977,"apply.run_wall_time_us":168525,"num_ops":2,"prepare.queue_time_us":248451,"prepare.run_cpu_time_us":3822,"prepare.run_wall_time_us":113512,"replication_time_us":141107,"thread_start_us":297223,"threads_started":2}]]}
I20260709 13:06:17.161352 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:17.162617 15639 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:17.162688 15644 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:06:17.161561 15646 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.164700 15639 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:17.169231 15641 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.064921 17227 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:06:17.177088 15716 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:17.074560 17525 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:06:17.181452 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.175900 15644 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:17.179822 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.174361 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.151002 17387 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:17.191351 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.183944 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.188287 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.150413 17567 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:17.150592 17312 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.201894 17312 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.202332 17312 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.162189 17350 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:17.205132 17350 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.150880 17572 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:17.206385 17572 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:17.207338 17572 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.200143 17387 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:17.200333 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.182111 17519 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.214272 15643 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:17.211297 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:17.220232 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.221086 15644 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:17.181036 17483 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:17.218551 15639 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:17.218946 15714 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:17.219169 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.225049 15646 raft_consensus.cc:2376] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3. Re-sending same reply.
I20260709 13:06:17.222508 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:17.226279 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.227047 15713 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:17.227499 15713 pending_rounds.cc:85] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 2
I20260709 13:06:17.227741 15713 pending_rounds.cc:107] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:17.227988 15713 raft_consensus.cc:2889] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:17.225198 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.232964 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.179113 17328 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:17.241101 15642 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.241582 15641 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:17.242086 15720 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:17.245973 15789 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:17.176383 17487 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.248971 15794 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:17.249831 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.275925 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.251737 15793 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:17.259387 17589 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:17.247179 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.271656 15646 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:17.281881 15641 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:17.217710 17387 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.214027 17579 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.219786 17519 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:17.296248 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.221728 15787 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:17.230450 17521 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.217455 17545 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:06:17.235241 17567 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:17.319283 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:17.288269 17388 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:17.314980 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.269179 17483 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:17.265420 17485 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.306859 17521 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.324754 17487 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:17.303529 17519 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.344477 17447 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:17.324859 17567 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:17.345659 17568 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:17.346271 17568 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:17.347249 17568 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.348686 17568 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:17.328413 17591 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:17.287932 17514 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.337889 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:17.266453 17400 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:17.344022 17521 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.303642 17542 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.296113 17442 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:17.369349 15715 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:17.371269 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 137920us
I20260709 13:06:17.337610 17326 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.306675 17537 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:06:17.365200 17455 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.396692 17455 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.399238 17455 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:17.364871 17404 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:17.400149 17404 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:17.401247 17404 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.402884 17560 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:17.403352 17560 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:17.404274 17560 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.354192 17545 consensus_queue.cc:1243] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:17.312265 17386 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:17.351150 17312 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:17.390494 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 168116us
I20260709 13:06:17.405682 17560 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.416205 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.419514 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:17.422806 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.423552 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.424053 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.394662 17274 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:17.428892 15722 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
W20260709 13:06:17.431202 15688 leader_election.cc:336] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.570s (SENT)
I20260709 13:06:17.439960 15647 raft_consensus.cc:2368] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
W20260709 13:06:17.442029 15688 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.614s (SENT)
I20260709 13:06:17.407447 17326 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.432164 16326 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEARNER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:06:17.453596 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.151s (SENT)
I20260709 13:06:17.457139 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.424654 17545 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:06:17.426864 17522 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:17.427464 17215 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:17.426874 17309 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:17.441919 17274 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.475834 17326 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:17.462999 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 160948us
I20260709 13:06:17.433121 17447 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:17.484090 17274 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:17.481451 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:17.462877 17477 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.478861 17400 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:17.501497 17590 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:06:17.506599 17326 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.518735 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.453239 17483 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:17.529405 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 49595.4us
I20260709 13:06:17.531421 17572 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.531729 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:17.531401 17571 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:17.538766 16300 leader_election.cc:336] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.540s (SENT)
I20260709 13:06:17.539345 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.505065 17477 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.548293 15639 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:17.549041 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:17.539105 17529 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.000s
I20260709 13:06:17.554697 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.548874 17575 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:17.522101 17350 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:17.543668 17572 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:17.568758 17350 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:17.553268 17485 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:17.553625 17312 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:17.544072 17544 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.540666 17538 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.538461 17571 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:17.570135 17541 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:17.570554 17538 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.571012 17538 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.571192 17571 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:17.574330 17350 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:17.578999 17388 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.576067 17519 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.579516 17388 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.572989 17571 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.578651 17350 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.582547 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:17.588671 16328 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.590338 17350 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.592195 17312 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.592965 17312 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.595438 17312 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:17.597122 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:17.599812 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:17.600059 15716 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.600499 15641 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:17.601722 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.602407 15720 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:17.603487 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:17.603741 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.604599 17312 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:17.604981 17312 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.605340 17312 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:17.606652 15640 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:17.598198 15719 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:17.598855 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:17.551676 17326 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:06:17.618558 17326 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:17.618964 17326 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:17.619781 17326 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:17.620965 17604 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:06:17.621033 17326 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.623512 17477 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:17.625105 17605 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:17.626664 15719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:06:17.627447 15719 raft_consensus.cc:606] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:17.627820 17530 raft_consensus.cc:993] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:06:17.628413 17530 raft_consensus.cc:1081] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:06:17.639273 15643 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:17.646786 15716 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:17.648684 15793 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:17.649771 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:17.651711 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:17.655606 15796 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:17.655678 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.660420 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:17.663185 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.666764 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.587512 17519 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:17.648092 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:17.648383 15719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
W20260709 13:06:17.774524 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.923089 15719 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:06:17.910403 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 242484us
W20260709 13:06:17.910742 17387 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.602s	user 0.019s	sys 0.010s
I20260709 13:06:17.912175 15646 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:17.912276 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 249960us
I20260709 13:06:17.912755 17544 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.913372 15792 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:17.668725 17525 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:17.654773 17529 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:06:17.656857 17325 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.915635 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:17.729053 15795 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:17.923506 15719 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.931139 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:17.933712 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.928572 17521 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.562s	user 0.015s	sys 0.002s
I20260709 13:06:17.951992 17312 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:17.922538 17227 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.957916 17442 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:17.930202 17379 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:06:17.933816 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 278230us
I20260709 13:06:17.989648 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:17.950810 17568 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.584s	user 0.016s	sys 0.004s
I20260709 13:06:17.957405 17567 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:17.928247 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:17.994062 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.950486 16328 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:17.991652 17519 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:17.948980 17387 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.002175 17400 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.014459 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:18.016137 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:18.017628 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:17.959237 17325 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:18.021044 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 89308.2us
I20260709 13:06:18.005307 17455 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.981237 17521 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.049321 15644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76331ca323724c289906034e280e8274"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:18.054109 15644 raft_consensus.cc:606] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:18.054607 15644 raft_consensus.cc:614] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:18.048635 15688 leader_election.cc:400] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:18.049916 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.050118 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.051191 15641 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:18.056262 15643 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:18.051698 15645 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.063952 15645 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.065704 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.066716 15645 raft_consensus.cc:2376] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2. Re-sending same reply.
I20260709 13:06:18.068002 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.070144 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.070531 15641 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:18.091686 16325 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:18.020705 17404 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.996675 17442 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.113363 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.114243 15643 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.032088 17544 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:18.121328 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:18.008005 17567 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.130829 15720 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:18.140523 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1090) took 1076 ms. Trace:
I20260709 13:06:18.141031 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.142033 15643 raft_consensus.cc:2376] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2. Re-sending same reply.
W20260709 13:06:18.141777 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 93322.8us
I20260709 13:06:18.143371 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.144452 15643 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:18.141096 15715 rpcz_store.cc:276] 0709 13:06:17.052640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.052746 (+   106us) service_pool.cc:224] Handling call
0709 13:06:17.053094 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.376442 (+323348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.129088 (+752646us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54003bae54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:18.129328 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727145600}
I20260709 13:06:18.156770 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.158578 15641 raft_consensus.cc:2368] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:06:18.127980 17606 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.145797 17525 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:18.071837 17568 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 13:06:18.170300 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 211254us
I20260709 13:06:18.170789 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.174891 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.176308 15643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:18.177116 15643 raft_consensus.cc:606] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:18.146024 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.134629 17544 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:18.181720 17612 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:06:18.182011 17579 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:18.182915 17567 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:18.186465 17388 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.003s
I20260709 13:06:18.174118 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:18.222796 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48783.4us
I20260709 13:06:18.192503 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:18.194401 17326 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.005s
I20260709 13:06:18.195205 17568 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:18.195858 17442 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.229462 17568 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:18.196031 17538 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.004s
W20260709 13:06:18.198840 17350 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.003s
I20260709 13:06:18.199856 17325 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:18.202364 17571 consensus_meta.cc:287] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.008s
I20260709 13:06:18.240154 17538 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.203325 17312 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.177574 15643 raft_consensus.cc:614] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:18.208103 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:18.161837 17519 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:18.155049 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.165388 17454 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:18.236543 15793 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:18.211513 17544 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.236931 15718 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:18.169684 17560 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:06:18.235532 17568 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.217535 15719 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.217128 17579 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:18.127065 17545 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:18.216357 15638 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:18.255623 15721 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.242488 17442 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:06:18.256779 17387 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:18.257189 15643 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.259231 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.238358 17524 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:18.304343 15719 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.229350 16325 raft_consensus.cc:1217] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:06:18.277244 15715 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:18.228592 17388 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.254215 17325 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.306741 15644 raft_consensus.cc:2376] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2. Re-sending same reply.
W20260709 13:06:18.314811 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 297255us
I20260709 13:06:18.285454 17519 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:18.319088 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.323192 15647 raft_consensus.cc:2368] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:18.285884 15642 raft_consensus.cc:2376] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2. Re-sending same reply.
I20260709 13:06:18.325390 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:18.309911 17524 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:18.254760 17525 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.319002 17568 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.320749 16325 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:18.320176 17521 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.337380 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:18.342157 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 189515us
I20260709 13:06:18.344594 15640 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:18.344936 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:18.345531 16330 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.345726 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:18.328298 17404 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:18.330533 17524 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.316323 17325 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.352962 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:18.353391 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.353929 15794 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:18.354262 15796 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
W20260709 13:06:18.347998 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 117075us
I20260709 13:06:18.356000 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.356830 15796 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:18.357848 15793 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:18.341990 17617 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.358942 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:18.361685 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.366667 15794 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:18.367637 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:18.373178 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.374341 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:18.374927 15796 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.375690 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.376495 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.327204 17579 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.375509 17477 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:18.379464 17579 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.381254 15642 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.381520 17227 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:18.352649 17541 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:18.382076 17227 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.388166 17530 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:18.388695 17530 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:18.377306 15789 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:18.392028 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.392629 15640 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.395857 15793 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:18.360628 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:18.344663 17483 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:18.404686 15796 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:18.397396 17477 consensus_queue.cc:1243] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 3.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:18.373950 16328 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:18.414690 17455 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.415261 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:18.416687 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:18.417296 16328 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:18.365816 17617 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.419569 17617 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.411818 17487 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.419952 17606 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:18.420401 17487 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.412657 17404 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.412559 17620 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:18.428119 15721 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:18.436005 15796 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:18.442335 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:18.450672 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 105044us
I20260709 13:06:18.478510 15796 pending_rounds.cc:85] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 2
I20260709 13:06:18.478869 15796 pending_rounds.cc:107] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:18.479192 15796 raft_consensus.cc:2889] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.420883 17538 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:18.436461 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.494875 15793 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:18.497289 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:18.503832 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:18.409235 17532 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:18.492913 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:18.491151 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 123585us
I20260709 13:06:18.511610 17350 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:18.515986 15792 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:18.520540 15789 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.425339 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.394519 17521 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:06:18.422875 17325 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:18.421818 17388 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:18.422500 17487 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:18.517514 17467 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:06:18.474305 17529 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:18.492991 17477 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:18.535374 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:18.373112 17519 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.415282 17455 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.389562 17530 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:18.544929 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 73204.3us
I20260709 13:06:18.564181 15789 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:18.543176 17454 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:18.570559 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:18.535272 17635 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.494141 17404 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.542786 17350 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.584658 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:18.543002 17487 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.528927 17442 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:06:18.542882 17532 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:18.543939 15638 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:18.565477 17624 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:06:18.548440 17388 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.597884 15790 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:18.670337 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:18.642184 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:18.542682 17485 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:18.672063 17606 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.697597 17606 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.699586 17404 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:18.700161 17388 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.702847 17388 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:18.705858 17634 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:06:18.711540 17400 consensus_meta.cc:287] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.691s	user 0.005s	sys 0.005s
I20260709 13:06:18.712136 17400 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.713047 16329 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:18.718842 17532 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.721408 17606 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:18.645509 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97779.5us
I20260709 13:06:18.529685 17626 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:06:18.721853 17483 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.548563 17529 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.722654 17483 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.724395 17529 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.671959 15647 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:18.673207 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:18.673983 17350 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:18.726732 16327 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.728315 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.734745 16327 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:18.664628 17525 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.736209 17525 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.736934 16328 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:18.742257 17388 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:18.743086 17388 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.690873 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:18.694177 17455 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:18.712898 17641 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:18.716240 17544 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:18.571242 17312 consensus_queue.cc:1175] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:18.690188 17642 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:18.759204 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 223892us
W20260709 13:06:18.794490 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 69043.4us
I20260709 13:06:18.794975 17541 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:18.795394 17541 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:18.796231 17541 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.798056 17626 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:18.775591 15640 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:18.780582 15641 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:18.783635 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:18.782124 16330 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:18.801122 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:18.803982 15794 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:18.819764 15644 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:18.826469 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:18.833664 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.835094 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.837553 16334 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:18.827970 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:18.665319 17487 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:18.884281 15715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:06:18.885325 15715 raft_consensus.cc:606] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:18.885708 15715 raft_consensus.cc:614] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:18.811460 17541 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.781219 16331 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:18.891351 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63574.9us
I20260709 13:06:18.819514 17477 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:18.899565 15647 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:18.833492 17400 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.880702 17642 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:18.833806 17454 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:18.909405 17227 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.006s
I20260709 13:06:18.891993 17641 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:18.901495 17644 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.895772 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:18.863217 17620 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:18.887094 17483 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:18.906117 17643 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:19.010694 15688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.053s
W20260709 13:06:19.010350 17613 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:06:19.004199 17545 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:19.028822 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:19.021292 15688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.003s	sys 0.053s
I20260709 13:06:18.893491 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:19.043148 15639 raft_consensus.cc:2376] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3. Re-sending same reply.
W20260709 13:06:19.043648 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 539908us
I20260709 13:06:19.002627 17642 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.048002 17477 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:19.045629 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.019565 17483 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.020500 17485 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:19.056944 15688 leader_election.cc:400] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:06:19.062733 15688 leader_election.cc:403] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.063750 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:19.006669 17227 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:18.912861 17400 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.058997 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:19.070843 15646 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:19.059476 17571 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.057351 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 164787us
I20260709 13:06:19.041426 17519 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:19.011050 17620 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:19.058548 17640 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:06:19.041313 17647 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:19.065970 17626 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.071241 17483 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.056946 17635 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:19.010517 17641 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.019929 17644 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.100229 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:19.101348 15644 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:19.069203 17485 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.099080 17544 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:19.076994 17571 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.025180 17643 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:19.137195 17524 consensus_meta.cc:287] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.776s	user 0.009s	sys 0.003s
I20260709 13:06:19.118432 17487 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.133016 17350 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.136308 17653 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.078794 17454 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.094334 17647 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:19.172210 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 106875us
I20260709 13:06:19.215552 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:19.111109 17635 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.176373 17487 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.215749 17648 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:06:19.216933 17568 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.872s	user 0.008s	sys 0.004s
I20260709 13:06:19.161502 17575 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:19.170836 17519 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:19.169575 17524 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.234772 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:19.200717 17626 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:19.223328 17646 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:19.178735 17350 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.281448 17575 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.248780 17649 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.182s
I20260709 13:06:19.171463 17653 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:19.327915 17656 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.110s	user 0.005s	sys 0.005s
I20260709 13:06:19.234134 17663 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.236124 17487 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.276401 17568 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 13:06:19.343753 17652 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:06:19.333520 17227 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.424835 17542 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.424990 15787 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:19.425859 17400 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.428256 17620 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:19.438617 17657 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:06:19.472884 17655 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:06:19.380818 17650 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:06:19.442777 17647 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.432775 17667 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:19.434705 17483 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.436697 17641 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.319365 17646 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.510021 17485 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.435084 17542 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.511864 17663 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:19.538054 15686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.003s	sys 0.007s
W20260709 13:06:19.544898 15686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.003s	sys 0.007s
I20260709 13:06:19.532935 17644 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.534052 17642 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.466702 17626 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:19.560066 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 344972us
I20260709 13:06:19.571492 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:19.574357 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 369) took 1003 ms. Trace:
I20260709 13:06:19.553514 17485 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.546082 17635 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.546345 17660 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.537122 17571 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:19.598995 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.016s	sys 0.020s
I20260709 13:06:19.574813 16333 rpcz_store.cc:276] 0709 13:06:18.570508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.699858 (+129350us) service_pool.cc:224] Handling call
0709 13:06:18.700220 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.791515 (+ 91295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.791555 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.792217 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.103886 (+311669us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:19.466569 (+362683us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.466855 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.466957 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.574103 (+107146us) raft_consensus.cc:1685] finished
0709 13:06:19.574125 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.574282 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97759,"raft.queue_time_us":85286,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":37076,"thread_start_us":654498,"threads_started":2,"wal-append.queue_time_us":389785}
I20260709 13:06:19.555812 17579 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.546389 17643 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:19.603333 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.017s	sys 0.021s
I20260709 13:06:19.556552 17663 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:19.471674 17519 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.572774 17644 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.540352 17667 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.570377 17619 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:19.602171 17483 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.617585 17658 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:06:19.617409 17483 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.619009 17635 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.606205 17641 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.619851 17641 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.601296 17524 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:19.621552 17663 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:19.616539 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45211.2us
I20260709 13:06:19.619215 17646 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.631516 15688 leader_election.cc:400] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:19.633041 15688 leader_election.cc:403] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.610810 17672 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.637903 17671 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:19.627637 17541 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.736s	user 0.006s	sys 0.008s
I20260709 13:06:19.640130 15638 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:19.616340 17575 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:19.602170 17485 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:19.648263 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.640635 15638 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:19.659482 17542 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:19.660349 17673 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:19.643868 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.624953 17641 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.614508 17579 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.675210 17682 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:19.643265 17672 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.678658 17579 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.623611 17644 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.663534 17646 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:19.690771 17667 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.691394 17532 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:19.691295 17579 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:19.691964 17532 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.691983 17579 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.627643 17619 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.694166 17579 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.694885 17663 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:19.695623 17619 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.695458 17663 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.697587 17672 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.697916 17579 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.698522 17579 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.699594 15638 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.700692 17579 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.700861 15638 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.700922 17485 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.612259 17660 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:19.669647 17671 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.703785 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.679694 17682 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.704439 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:19.705066 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.705787 15717 raft_consensus.cc:2368] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3.
I20260709 13:06:19.705618 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.671551 17653 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.707583 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.708931 17682 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.710934 15713 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:19.712990 17388 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.724520 15718 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:19.714735 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:19.726284 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:19.726447 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.715292 17672 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.685156 17641 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.718886 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:19.716073 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.733083 15715 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:19.697602 17663 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.737565 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.740365 15719 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:19.741689 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.738147 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:19.738976 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:19.723919 17545 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.744403 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:19.747444 15714 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.745935 17312 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:19.731457 17619 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.699646 17646 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.748804 17312 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:19.755436 17312 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:19.756214 17312 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.756886 17646 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.757411 17312 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:19.725487 17541 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:19.750655 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.784901 15716 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:19.751349 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.736724 17388 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:19.786823 17388 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:19.788764 17673 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3.
I20260709 13:06:19.788131 17388 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.790055 17541 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.790748 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 257) took 2318 ms. Trace:
I20260709 13:06:19.792364 17541 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.791265 15722 rpcz_store.cc:276] 0709 13:06:17.472810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.472950 (+   140us) service_pool.cc:224] Handling call
0709 13:06:17.473302 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.554380 (+ 81078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.554408 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.554916 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.084861 (+529945us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b180035b660. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:06:18.320218 (+235357us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:18.543102 (+222884us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.003386 (+460284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.790298 (+786912us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54003bcc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:19.790365 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.790425 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:19.790443 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.790651 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":262786,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":122397,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":35665,"spinlock_wait_cycles":190153856,"thread_start_us":907178,"threads_started":3,"wal-append.queue_time_us":804368,"wal-append.run_cpu_time_us":3648,"wal-append.run_wall_time_us":1352855}
I20260709 13:06:19.785825 15715 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:19.763268 17644 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.765820 17404 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.766150 16326 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:19.739034 17641 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.774713 17483 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.803439 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.775826 15713 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:19.779554 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:19.821581 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1258) took 1409 ms. Trace:
I20260709 13:06:19.837720 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.837954 15717 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:19.837184 15643 rpcz_store.cc:276] 0709 13:06:18.473683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.705191 (+231508us) service_pool.cc:224] Handling call
0709 13:06:18.705602 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.755040 (+ 49438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.755085 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.785685 (+ 30600us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.074688 (+289003us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:19.074730 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.820981 (+746251us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b5400345654. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:19.821060 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.821133 (+    73us) raft_consensus.cc:1685] finished
0709 13:06:19.821153 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.821464 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24711,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10057,"spinlock_wait_cycles":112693120,"thread_start_us":190775,"threads_started":1,"wal-append.queue_time_us":336318}
I20260709 13:06:19.839075 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.745221 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.729315 17671 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.795516 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:19.803529 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.746459 17532 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.752754 17545 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.848230 15714 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:19.858964 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:19.842133 15721 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:19.782809 17660 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.863372 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:19.863492 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 453) took 1791 ms. Trace:
I20260709 13:06:19.864230 16334 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:19.864154 16325 rpcz_store.cc:276] 0709 13:06:18.115193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.145694 (+ 30501us) service_pool.cc:224] Handling call
0709 13:06:18.206874 (+ 61180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.344038 (+137164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.863198 (+1519160us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5400506020. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad25409a02 00007fad25405dd6 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:19.863427 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8617856}
I20260709 13:06:19.865274 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.868366 17545 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.872911 15638 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:19.873586 15638 pending_rounds.cc:85] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 5
I20260709 13:06:19.874010 15638 pending_rounds.cc:107] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:19.788161 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:19.803249 17404 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.879905 15722 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:19.812604 17525 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.818725 17487 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.883649 17671 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.884338 17404 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:19.812216 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:19.885540 15638 raft_consensus.cc:2889] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:19.886119 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.886512 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 173) took 1472 ms. Trace:
I20260709 13:06:19.887001 15638 rpcz_store.cc:276] 0709 13:06:18.413781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.730004 (+316223us) service_pool.cc:224] Handling call
0709 13:06:18.730446 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.639990 (+909544us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54000e2020. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad254081c0 00007fad25409231 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c
0709 13:06:19.886264 (+246274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.886456 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87815552}
I20260709 13:06:19.888633 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:19.837150 17641 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.812189 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 360) took 1482 ms. Trace:
I20260709 13:06:19.897729 16326 rpcz_store.cc:276] 0709 13:06:18.329411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.330547 (+  1136us) service_pool.cc:224] Handling call
0709 13:06:19.765770 (+1435223us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1eee 0000000000375939 00007fad2a3551e0 00007fad2a41e0c4 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:19.765927 (+   157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.811846 (+ 45919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.812110 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19093376}
I20260709 13:06:19.899667 17542 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:19.900317 17542 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.906045 17542 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:19.906057 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:19.907581 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64150.1us
I20260709 13:06:19.908996 17671 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:19.910221 17671 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:19.910597 17671 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:19.921651 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.928572 17379 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:06:19.930747 15647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 175) took 1218 ms (client timeout 1614 ms). Trace:
W20260709 13:06:19.931310 15647 rpcz_store.cc:269] 0709 13:06:18.712407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.727890 (+ 15483us) service_pool.cc:224] Handling call
0709 13:06:19.930456 (+1202566us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000e8dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:19.930620 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391529728}
I20260709 13:06:19.932250 17671 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:19.933717 17671 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:19.888057 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:19.955183 15645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1585) took 1892 ms (client timeout 1667 ms). Trace:
I20260709 13:06:19.954532 17379 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.957897 17379 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:19.960909 17379 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:19.963372 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.896680 17619 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:19.957211 15790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1676) took 2289 ms (client timeout 1874 ms). Trace:
W20260709 13:06:19.967461 15790 rpcz_store.cc:269] 0709 13:06:17.660010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.729815 (+ 69805us) service_pool.cc:224] Handling call
0709 13:06:19.948970 (+2219155us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540047c7d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:19.949061 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678519168}
W20260709 13:06:19.956290 15645 rpcz_store.cc:269] 0709 13:06:18.062410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.067703 (+  5293us) service_pool.cc:224] Handling call
0709 13:06:19.954951 (+1887248us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540019c154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:19.955088 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989731200}
I20260709 13:06:19.909546 17350 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:19.970417 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.895298 17625 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:19.982940 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:19.987411 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:19.988070 15793 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:19.989029 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:19.989563 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:19.989598 15793 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:19.990821 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:19.992910 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:20.000782 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88067us
I20260709 13:06:20.000938 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:19.965078 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:20.003502 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.003597 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.004452 15795 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:19.961696 17326 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:19.974448 17600 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:19.985174 17542 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:20.002817 17537 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:20.016376 17600 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:20.049352 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.069319 17400 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:20.069718 15718 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:20.011291 17326 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.103550 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.076037 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.075340 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.075649 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.105175 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.104322 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.132715 15643 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:20.075994 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.130151 15646 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:20.134196 15644 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:20.138147 15545 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 275) took 4763 ms. Trace:
W20260709 13:06:20.139941 15688 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.667s (SENT)
I20260709 13:06:20.140390 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:20.146039 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 191943us
W20260709 13:06:20.146731 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.069610 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:20.138566 15545 rpcz_store.cc:276] 0709 13:06:15.375302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.375516 (+   214us) service_pool.cc:224] Handling call
0709 13:06:20.138082 (+4762566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:17.512859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:17.513490 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:17.513548 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:06:17.513567 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:17.514228 (+   661us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:17.514281 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:17.514317 (+    36us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:17.514737 (+   420us) tablet.cc:701] Row locks acquired
0709 13:06:17.514753 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:17.514912 (+   159us) write_op.cc:270] Start()
0709 13:06:17.515033 (+   121us) write_op.cc:276] Timestamp: P: 1783602377514864 usec, L: 0
0709 13:06:17.515054 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:17.552496 (+ 37442us) log.cc:844] Serialized 1672 byte log entry
0709 13:06:17.952588 (+400092us) op_driver.cc:464] REPLICATION: finished
0709 13:06:18.332159 (+379571us) write_op.cc:301] APPLY: starting
0709 13:06:18.336458 (+  4299us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:18.354669 (+ 18211us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:18.366243 (+ 11574us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:18.383890 (+ 17647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:18.384072 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:18.384120 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:18.384341 (+   221us) log.cc:844] Serialized 41 byte log entry
0709 13:06:18.384521 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:18.384628 (+   107us) write_op.cc:454] Released schema lock
0709 13:06:18.384672 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:18.385013 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:18.385040 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":214781,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":360583,"apply.run_cpu_time_us":2510,"apply.run_wall_time_us":56529,"num_ops":4,"prepare.queue_time_us":352145,"prepare.run_cpu_time_us":3839,"prepare.run_wall_time_us":63013,"replication_time_us":404215,"thread_start_us":459056,"threads_started":2}]]}
I20260709 13:06:20.142796 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:20.035320 17621 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.155817 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:20.153568 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84046us
I20260709 13:06:20.155047 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.157269 15720 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:20.158053 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:20.157895 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59391us
I20260709 13:06:20.167171 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.168715 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.103179 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.170914 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.155107 17619 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.178862 17619 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.179141 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.180322 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.181072 17619 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.143414 15542 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 3 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 5 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:20.070003 17400 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.182519 15542 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 3, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:20.184248 15542 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 3 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 4 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.150113 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.186076 15542 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:20.177274 15688 leader_election.cc:336] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.807s (SENT)
I20260709 13:06:20.099213 17529 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.042464 17542 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.158994 17379 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.192348 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.197722 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:20.152518 17625 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:20.181408 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.201061 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.044237 17537 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:20.201857 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 46091.3us
I20260709 13:06:20.203413 17537 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:20.203687 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:20.201148 17312 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:20.204321 17312 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:20.204375 15795 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:20.205591 17483 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:20.205801 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.206166 17483 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:20.207330 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:20.207994 15795 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.207036 17483 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.191453 15542 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.209935 17617 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:20.210109 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.210906 15645 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.210608 17617 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.213115 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.213084 17617 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.204757 17312 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.177043 17388 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:20.217967 17388 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.218509 17388 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.217803 15542 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:20.219460 15542 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 4, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:20.174252 17641 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:20.224617 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.221453 17600 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:20.162729 17560 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:20.228233 17672 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:20.221263 17379 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.229069 17560 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:20.229449 17560 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:20.196645 17529 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.162505 17621 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.224496 17625 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.224987 15542 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:20.241312 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.225229 15645 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:20.239809 17653 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.248931 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.195708 17454 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:20.250883 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.251151 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.251595 15714 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:20.252240 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.253202 15721 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:20.254184 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.252348 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.255981 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.256237 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.256788 15641 raft_consensus.cc:2376] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:20.258143 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.262771 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.263651 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.271986 15795 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:20.241919 17692 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:20.269902 15716 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:06:20.275519 15716 pending_rounds.cc:85] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:06:20.275367 17692 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.275939 15716 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:06:20.264829 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.276350 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.277599 17692 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.278725 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.282895 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:20.237191 15638 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:20.220889 17654 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:20.241062 17542 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:20.276351 15716 raft_consensus.cc:2917] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:06:20.287225 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:20.221568 17525 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:20.224346 17694 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:20.289090 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.310369 15645 raft_consensus.cc:2376] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2. Re-sending same reply.
I20260709 13:06:20.239323 17529 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.236925 17326 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:20.291772 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.229686 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1254) took 1825 ms. Trace:
I20260709 13:06:20.235954 17400 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.300987 15716 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:20.234545 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.303656 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.245070 17575 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:20.317934 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 160990us
I20260709 13:06:20.324136 15795 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:20.332398 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:20.247224 17653 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.353454 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.263823 17641 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.329478 17654 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:20.382840 17654 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:20.383242 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.383947 17654 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.384994 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.348479 17694 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:20.388995 17694 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.390095 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.391927 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.392719 15788 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:20.393787 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.394484 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.397145 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.398406 15789 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:20.402345 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.403590 15647 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:20.329223 15642 rpcz_store.cc:276] 0709 13:06:18.404259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.408807 (+  4548us) service_pool.cc:224] Handling call
0709 13:06:19.710090 (+1301283us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:19.956557 (+246467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.974695 (+ 18138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.981058 (+  6363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.982525 (+  1467us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:20.001331 (+ 18806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.007290 (+  5959us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.229483 (+222193us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000e8dd0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:20.229618 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540238336}
I20260709 13:06:20.404989 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:20.419704 17695 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:06:20.422000 17690 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.366s	user 0.005s	sys 0.000s
I20260709 13:06:20.385571 17654 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.434257 17379 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.449040 15642 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:20.451318 15642 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:20.230283 17560 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.466289 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.515105 15789 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:20.518208 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.537220 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.538008 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.538990 15793 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:20.553102 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.554657 15790 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:20.400841 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.695230 15644 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 1.
I20260709 13:06:20.622498 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1671) took 2939 ms. Trace:
I20260709 13:06:20.613657 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:20.697263 15791 rpcz_store.cc:276] 0709 13:06:17.654067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.654180 (+   113us) service_pool.cc:224] Handling call
0709 13:06:17.654519 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.668258 (+ 13739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.915301 (+247043us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.409592 (+494291us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b180027c8e0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a
0709 13:06:19.938847 (+1529255us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:19.983633 (+ 44786us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.244905 (+261272us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:20.244942 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.245636 (+   694us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:20.593254 (+347618us) raft_consensus.cc:1685] finished
0709 13:06:20.593288 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.593528 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2226,"raft.queue_time_us":2411,"raft.run_cpu_time_us":9154,"raft.run_wall_time_us":260805,"spinlock_wait_cycles":30141952,"thread_start_us":209527,"threads_started":1,"wal-append.queue_time_us":274394}
I20260709 13:06:20.349910 17575 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:20.701504 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 475249us
W20260709 13:06:20.697292 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 494781us
I20260709 13:06:20.671515 15641 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:20.550354 17400 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:20.700528 16297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.026s	sys 0.033s
W20260709 13:06:20.609858 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 277559us
I20260709 13:06:20.710189 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.711831 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:20.713702 16297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.026s	sys 0.033s
I20260709 13:06:20.592032 17326 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.714653 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 705146us
I20260709 13:06:20.717311 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:20.702800 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.022s	sys 0.013s
I20260709 13:06:20.718876 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.786172 15641 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:20.787582 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:20.788532 15641 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:20.723201 15760 leader_election.cc:400] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3.
I20260709 13:06:20.789593 15760 leader_election.cc:403] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:20.698643 17641 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.626662 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:20.699945 17530 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.769163 16334 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:20.772528 17621 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:20.782011 17625 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.711835 17660 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:20.784265 17312 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.569s	user 0.021s	sys 0.007s
I20260709 13:06:20.838063 17312 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.840492 17600 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3.
I20260709 13:06:20.840734 17312 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:20.785022 17653 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:20.794821 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:20.785712 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.023s	sys 0.013s
I20260709 13:06:20.807273 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:20.823027 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.840138 17455 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:20.837731 17660 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:20.852684 17579 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:20.709650 17388 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:20.861390 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66669us
I20260709 13:06:20.857872 17693 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:20.808471 17706 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:06:20.866415 17701 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:20.861985 17579 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.791857 16330 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:21.019750 17326 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:20.892513 17693 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:20.718608 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:21.089959 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 366991us
W20260709 13:06:21.091971 15640 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.762s	user 0.027s	sys 0.043s
I20260709 13:06:21.092468 15640 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:21.092931 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:21.094632 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 384166us
W20260709 13:06:21.103302 15638 consensus_meta.cc:287] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.815s	user 0.018s	sys 0.006s
I20260709 13:06:21.106287 15638 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:21.123251 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:21.125072 16330 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:21.057065 17693 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.122272 17702 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.108011 17701 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:21.116086 17710 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:21.157411 17660 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:21.157997 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:21.160389 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:21.168093 17529 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.151629 17701 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.170490 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.185024 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:21.151242 17625 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:21.132009 17646 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:06:21.190480 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 72931us
I20260709 13:06:21.193912 16334 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:06:21.175275 17710 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.199275 16334 pending_rounds.cc:85] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 3
W20260709 13:06:21.176226 17681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.011s	sys 0.043s
I20260709 13:06:21.204197 16334 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:06:21.190142 17672 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:21.186393 17701 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.218447 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:21.220872 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.222532 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.205664 16334 raft_consensus.cc:2917] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:06:21.192303 17400 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:21.189990 17660 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:21.225054 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.229460 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.180720 17600 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:21.237999 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:21.243223 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.154836 17702 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.246373 15644 raft_consensus.cc:2410] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:21.227415 17312 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:21.230840 16334 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:21.227191 17653 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:21.289762 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 81761.4us
I20260709 13:06:21.207579 17388 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.252074 17483 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:21.232537 17525 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.217063 17672 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.206122 17710 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.285444 16332 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:21.189564 17529 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.268172 17326 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:21.268361 17715 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:21.269210 17721 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:21.269984 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.270473 17579 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.271066 17575 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:21.274622 17642 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.276628 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.278036 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1601) took 1018 ms. Trace:
I20260709 13:06:21.282631 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.283092 17702 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:21.285552 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:21.244939 17660 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:21.337273 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:21.200816 17625 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.248796 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:21.339169 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 90520.3us
I20260709 13:06:21.290791 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.339838 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.297786 17646 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.292542 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:21.340144 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:21.258451 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.290197 17653 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.301908 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:21.294834 17672 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.311956 15640 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:21.315068 15646 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:21.296097 17673 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.314285 15645 rpcz_store.cc:276] 0709 13:06:20.259572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.311260 (+ 51688us) service_pool.cc:224] Handling call
0709 13:06:20.512063 (+200803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.512653 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:21.009878 (+497225us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.206311 (+196433us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.214873 (+  8562us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.215019 (+   146us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:21.223528 (+  8509us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.223917 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.223992 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.277720 (+ 53728us) raft_consensus.cc:1685] finished
0709 13:06:21.277801 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.277960 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":528320,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":347,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":9470,"spinlock_wait_cycles":54176256,"thread_start_us":481229,"threads_started":2,"wal-append.queue_time_us":160855}
W20260709 13:06:21.336591 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.336194 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:21.265945 17400 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:21.340011 15644 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
W20260709 13:06:21.385308 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45539.5us
I20260709 13:06:21.341997 15643 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:21.349836 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:21.390507 17681 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:21.392489 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.389660 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:21.344023 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52763.8us
I20260709 13:06:21.393213 15646 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:21.340670 17660 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.342690 17725 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.329335 17642 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:21.356724 17654 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.927s	user 0.022s	sys 0.005s
I20260709 13:06:21.342422 17579 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.416726 15645 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:21.399549 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.386940 17653 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.342772 17541 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.329335 17575 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:06:21.345003 16327 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:21.394995 17483 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.438380 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:21.385154 17646 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:21.447276 15639 raft_consensus.cc:2410] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:21.447397 16334 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:21.447453 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44912.3us
W20260709 13:06:21.440292 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 135507us
I20260709 13:06:21.342527 17525 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.413879 17312 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:21.456121 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63136.4us
I20260709 13:06:21.456955 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.438365 17705 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.393428 17673 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.460413 15645 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:21.460378 15647 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:21.395385 17728 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.458536 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.468458 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.446211 17694 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:21.394477 17681 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:06:21.469391 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.472699 16334 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:21.477468 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:21.478278 15790 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:21.478327 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.479825 16327 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.470983 17728 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.480647 17728 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.485502 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:21.490093 17654 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:21.490702 17654 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.491156 17654 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.494860 16327 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:21.495508 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1609) took 1233 ms. Trace:
I20260709 13:06:21.495945 15647 rpcz_store.cc:276] 0709 13:06:20.317481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.404584 (+ 87103us) service_pool.cc:224] Handling call
0709 13:06:21.495333 (+1090749us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400346054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:21.495452 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674044800}
I20260709 13:06:21.496423 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.497264 17388 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:21.498283 17455 raft_consensus.cc:670] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:21.498591 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.499420 17388 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.499557 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:21.503935 17663 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:21.504534 17663 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.505069 17663 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.507367 17653 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:21.470155 17541 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:21.509270 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:21.500633 17654 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:21.500625 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:21.516084 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:21.516021 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:21.523605 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:21.524086 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:21.524276 15720 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:21.518064 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:21.518460 15646 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:21.461642 17600 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:21.474076 17694 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.519788 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:21.429795 17725 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:21.487776 17312 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.520804 15721 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:21.526665 15719 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:21.537132 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:21.538190 15714 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:21.539908 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1273) took 1464 ms (client timeout 1773 ms). Trace:
W20260709 13:06:21.540339 15638 rpcz_store.cc:269] 0709 13:06:20.074978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.097812 (+ 22834us) service_pool.cc:224] Handling call
0709 13:06:21.539726 (+1441914us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b54002dad54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:21.539846 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121195264}
I20260709 13:06:21.513780 17732 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:21.533670 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:21.503384 17525 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:21.514102 17541 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.556912 17541 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.541447 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:21.534709 17694 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:21.532363 17739 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.526710 17579 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.539722 17653 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:21.470237 17705 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.554082 17529 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.552899 15717 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:21.502216 17693 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.555557 17732 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.485308 17400 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.563762 17388 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.592686 17693 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:21.592953 17705 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:21.593238 16333 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:21.596827 15647 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:21.620618 15647 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:21.622624 15647 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:21.624423 15647 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:21.566864 15642 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:21.579100 15714 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:21.646788 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 115492us
W20260709 13:06:21.652856 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 120166us
I20260709 13:06:21.658777 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.659569 17312 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:21.660025 17312 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.660439 17312 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:21.672775 17312 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:21.674341 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 217225us
I20260709 13:06:21.575536 17625 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:21.594300 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:21.680830 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.704516 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:21.600309 17654 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:21.687206 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 231710us
I20260709 13:06:21.689829 16329 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:21.599421 17732 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:21.569200 17579 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.619741 17646 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:21.712532 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:21.721612 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1708) took 1139 ms. Trace:
I20260709 13:06:21.716960 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:21.722126 15794 rpcz_store.cc:276] 0709 13:06:20.582187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.712269 (+1130082us) service_pool.cc:224] Handling call
0709 13:06:21.721527 (+  9258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.731699 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:21.733815 15794 raft_consensus.cc:2376] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5. Re-sending same reply.
I20260709 13:06:21.572474 17739 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.646445 17388 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.770051 17740 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.787158 17739 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.787874 17388 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.787892 15638 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:21.764115 17654 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:21.808027 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.764302 15794 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.738479 17673 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.768815 17483 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:22.028219 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.029867 15792 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:21.980839 15611 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.734s (SENT) [suppressed 27 similar messages]
W20260709 13:06:22.032480 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51693.8us
I20260709 13:06:22.033979 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:21.983322 15796 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:22.035503 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:22.036161 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 478388us
I20260709 13:06:22.048458 17744 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.056274 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.057312 15793 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:22.060786 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1613) took 1739 ms. Trace:
I20260709 13:06:21.827667 17737 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:21.827520 17388 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:21.985476 17653 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.065809 15792 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:22.042599 17579 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:21.835223 17654 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:21.888652 17672 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:21.858635 17663 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:21.853511 17738 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:22.144325 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 55588us
W20260709 13:06:22.117698 15688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.020s	sys 0.014s
I20260709 13:06:22.299836 17388 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:22.250793 17728 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.004s
I20260709 13:06:22.068643 17673 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:22.243185 17710 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.000s
I20260709 13:06:22.068128 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.069263 17744 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.101384 15794 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:22.122241 15722 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:22.078378 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:22.254066 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.317351 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 206345us
W20260709 13:06:22.303725 15688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.020s	sys 0.020s
I20260709 13:06:22.028677 17617 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.068625 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.306931 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:22.324908 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:22.298511 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 264573us
I20260709 13:06:22.309054 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:22.326375 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.117985 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.310657 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.066382 15641 rpcz_store.cc:276] 0709 13:06:20.320911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.802606 (+481695us) service_pool.cc:224] Handling call
0709 13:06:20.803164 (+   558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.803881 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.803915 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.476507 (+672592us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b2c000014c8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:21.484113 (+  7606us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.839349 (+355236us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:21.839411 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.839522 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.041059 (+201537us) raft_consensus.cc:1685] finished
0709 13:06:22.041086 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.060725 (+ 19639us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2746,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":184,"spinlock_wait_cycles":2991872,"thread_start_us":354782,"threads_started":1,"wal-append.queue_time_us":554537}
I20260709 13:06:22.061743 17723 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:22.258548 17660 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
W20260709 13:06:22.258320 17701 consensus_meta.cc:287] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.020s	user 0.009s	sys 0.004s
I20260709 13:06:22.252801 17706 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.324697 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.339860 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 231) took 1233 ms. Trace:
I20260709 13:06:22.328043 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.143715 17730 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 13:06:22.160848 17312 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.334444 15788 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:22.301602 17725 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.335640 15714 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.061952 17732 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.340469 15791 rpcz_store.cc:276] 0709 13:06:21.102024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.102184 (+   160us) service_pool.cc:224] Handling call
0709 13:06:21.416075 (+313891us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:21.416262 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.416457 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:21.601388 (+184931us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.335137 (+733749us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.335330 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.335381 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:22.335443 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.335512 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.335634 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290125,"prepare.queue_time_us":612930,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":7243,"raft.queue_time_us":304089,"raft.run_wall_time_us":11051,"spinlock_wait_cycles":256256384,"thread_start_us":622963,"threads_started":3,"wal-append.queue_time_us":442180}
I20260709 13:06:22.144337 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:22.312916 17740 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:22.324750 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 815220us
I20260709 13:06:22.087836 17737 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.063261 17759 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.284s
I20260709 13:06:22.311813 17388 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.305830 17653 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.363348 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:22.359689 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:22.367161 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:22.368631 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:22.369215 15796 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.144661 17753 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.215s
I20260709 13:06:22.317348 17728 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.341854 17741 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.333173 17710 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.376608 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.382331 15796 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:22.343029 17706 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.385150 17706 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:22.385236 17744 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.386512 17756 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.339119 17617 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.366110 16328 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:22.387720 17641 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:22.340786 17660 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.388698 17729 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:22.362504 17740 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.402483 17740 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:22.402828 17694 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.000s
I20260709 13:06:22.403584 17653 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:22.395305 17541 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.003s
I20260709 13:06:22.404224 17541 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.387796 17312 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:22.406507 17541 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.338869 17723 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.390976 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:22.317833 17673 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.371110 17635 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:22.341814 17701 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.408166 17660 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.423841 17672 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:22.425388 17701 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:22.398403 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 71218.2us
I20260709 13:06:22.428064 17723 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:22.429917 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.430538 17617 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.430650 15722 raft_consensus.cc:2376] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 4. Re-sending same reply.
I20260709 13:06:22.431213 17617 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.432843 17710 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:22.433015 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.284843 16325 raft_consensus.cc:2955] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:22.433775 15717 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:22.434092 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:22.408675 15644 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:22.403282 17694 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.391944 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.409574 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.370129 17654 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.425545 17728 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:22.435840 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.436491 15714 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:22.433100 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.409283 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:22.393842 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.396521 17756 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:22.463102 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 53911.2us
I20260709 13:06:22.468843 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:22.469724 15796 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.473953 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.474611 15717 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:22.437515 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:22.459335 15719 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:22.478267 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.479348 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:22.479909 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 103380us
I20260709 13:06:22.373261 17758 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:06:22.483716 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.482826 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.454589 17730 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.486909 17312 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:22.465808 16331 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:22.488078 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.425580 17673 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:22.488619 15645 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:22.497805 15645 pending_rounds.cc:85] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 5
I20260709 13:06:22.487334 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.457271 17326 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:22.408957 16328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 372) took 1694 ms (client timeout 1947 ms). Trace:
W20260709 13:06:22.487315 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51433.2us
I20260709 13:06:22.493671 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:22.498137 15645 pending_rounds.cc:107] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:22.499109 15645 raft_consensus.cc:2889] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.476861 17756 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.498435 15788 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:22.498128 15639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 178) took 2280 ms (client timeout 2899 ms). Trace:
I20260709 13:06:22.501554 15796 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:22.484485 17672 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.394586 17741 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.490500 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:22.484838 17617 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:22.491310 17710 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:22.485936 17660 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.557973 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:22.558714 15788 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:22.503492 15639 rpcz_store.cc:269] 0709 13:06:20.209972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.212865 (+  2893us) service_pool.cc:224] Handling call
0709 13:06:22.487538 (+2274673us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000e83d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:22.490666 (+  3128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835884416}
I20260709 13:06:22.567770 15788 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:22.571696 15788 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:22.558037 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.574229 17660 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:22.579205 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48370.4us
I20260709 13:06:22.490680 17635 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:06:22.494777 17646 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:06:22.493999 17579 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:06:22.583074 16326 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:22.581045 17710 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:22.497185 17725 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:06:22.587683 17312 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:22.594841 17672 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.595458 17672 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.596144 17672 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.595503 17312 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.598248 17771 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:22.598717 17771 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:22.599083 17741 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.599588 17710 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.557001 17673 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:06:22.500198 16328 rpcz_store.cc:269] 0709 13:06:20.714368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.725143 (+ 10775us) service_pool.cc:224] Handling call
0709 13:06:22.144152 (+1419009us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:22.400786 (+256634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9264512}
W20260709 13:06:22.594165 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 106902us
I20260709 13:06:22.603575 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.583354 17663 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.578914 17732 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.581171 17660 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.599694 17771 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.593582 17617 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:22.608201 17738 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:22.615391 17738 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.607659 17388 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.616025 17738 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.615568 17617 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.617100 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1624) took 1459 ms. Trace:
W20260709 13:06:22.594197 16326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 373) took 1878 ms (client timeout 2025 ms). Trace:
W20260709 13:06:22.617919 16326 rpcz_store.cc:269] 0709 13:06:20.715800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.739963 (+ 24163us) service_pool.cc:224] Handling call
0709 13:06:22.483200 (+1743237us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:22.592982 (+109782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10367232}
I20260709 13:06:22.607941 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.619222 15718 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:22.619148 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.611332 17740 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:22.623379 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 133147us
I20260709 13:06:22.617484 15644 rpcz_store.cc:276] 0709 13:06:21.157949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.389412 (+231463us) service_pool.cc:224] Handling call
0709 13:06:21.418811 (+ 29399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.435964 (+1017153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.616862 (+180898us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000aa354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:22.617044 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275543424}
I20260709 13:06:22.628113 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.629148 15718 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:22.637792 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.638105 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.638972 15720 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.641837 15717 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:22.643153 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.643854 15717 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.646348 16298 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:22.713534 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.722088 15718 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:22.735091 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 154780us
I20260709 13:06:22.736943 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:22.738394 17771 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.746501 17634 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.746765 17740 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.748003 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.749348 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.759599 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.759379 15717 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:22.756945 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.761413 15716 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:22.753973 15720 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:22.762708 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.764145 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.765326 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.766402 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:22.768195 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.769160 15720 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.621577 17625 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.768151 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.767182 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:22.770212 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:22.780175 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.795158 15718 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:06:22.801899 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.811681 15716 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:22.755324 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1606) took 2494 ms. Trace:
I20260709 13:06:22.737115 17737 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.865988 17694 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.871230 17672 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.640959 17732 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.174s
I20260709 13:06:22.882588 17732 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:22.883096 17732 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:22.884099 17732 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.818984 15642 rpcz_store.cc:276] 0709 13:06:20.261000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.452327 (+191327us) service_pool.cc:224] Handling call
0709 13:06:21.543915 (+1091588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.675912 (+131997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.754997 (+1079085us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002dad50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:22.755208 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504650624}
I20260709 13:06:22.825783 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:22.916767 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:22.826131 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58054.8us
I20260709 13:06:22.918241 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:22.920872 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:22.826609 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:22.922078 15796 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.925814 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:22.925297 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:22.816893 17388 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.946749 17730 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:22.885603 17732 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.837692 17764 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:22.821714 17625 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:22.846551 17772 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:06:22.851936 17740 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.979267 17740 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:22.903299 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.966284 17770 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:22.975315 15760 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.509s (SENT)
I20260709 13:06:22.983821 17770 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:22.984431 15760 leader_election.cc:336] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.530s (SENT)
I20260709 13:06:22.985081 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:22.950979 17741 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:22.986217 17741 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:22.842566 17758 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:22.989205 17758 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:22.989636 17625 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:22.992471 17758 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:23.008749 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84381.7us
I20260709 13:06:23.036556 15796 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:22.982705 17634 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:22.834661 15720 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
W20260709 13:06:23.056452 15790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.027s	sys 0.027s
W20260709 13:06:23.084388 15790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.028s	sys 0.028s
I20260709 13:06:23.086269 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1713) took 1266 ms. Trace:
I20260709 13:06:23.086850 15790 rpcz_store.cc:276] 0709 13:06:21.820143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.820326 (+   183us) service_pool.cc:224] Handling call
0709 13:06:22.024055 (+203729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.024506 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:22.070491 (+ 45985us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.486990 (+416499us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18003c8920. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:06:23.085579 (+598589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.085654 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:23.085717 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.085861 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.086167 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26260,"prepare.queue_time_us":44389,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":115,"spinlock_wait_cycles":36636416,"thread_start_us":598302,"threads_started":1,"wal-append.queue_time_us":1019707}
I20260709 13:06:22.977099 17764 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.117910 17779 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:23.123911 15717 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.124044 17779 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.131706 17740 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.133473 17770 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.136298 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.136570 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.137322 17756 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.000s
I20260709 13:06:23.141906 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.081777 17758 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.084070 17730 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:23.058271 17781 raft_consensus.cc:2764] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:06:23.193111 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 105282us
I20260709 13:06:23.193620 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.194298 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.142304 17764 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.203707 17672 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.102219 17782 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.191684 17770 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:23.256212 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 183) took 1787 ms (client timeout 2080 ms). Trace:
W20260709 13:06:23.256659 15638 rpcz_store.cc:269] 0709 13:06:21.468438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.541195 (+ 72757us) service_pool.cc:224] Handling call
0709 13:06:23.256039 (+1714844us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54002db754. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:23.256154 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527112448}
I20260709 13:06:23.258916 17732 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.259456 17732 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.266292 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.268040 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.221798 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.220010 15760 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.683s (SENT)
W20260709 13:06:23.233404 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.270346 15796 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
W20260709 13:06:23.236373 17738 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.620s	user 0.001s	sys 0.007s
I20260709 13:06:23.222357 17730 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:23.278218 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.241114 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 1954) took 1184 ms. Trace:
I20260709 13:06:23.279497 15791 rpcz_store.cc:276] 0709 13:06:22.056613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.573470 (+516857us) service_pool.cc:224] Handling call
0709 13:06:22.585068 (+ 11598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.585366 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.585393 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.585841 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.068982 (+483141us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:23.069062 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.069182 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.240765 (+171583us) raft_consensus.cc:1685] finished
0709 13:06:23.240793 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.241024 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4245,"raft.queue_time_us":2516,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4471,"thread_start_us":471748,"threads_started":1,"wal-append.queue_time_us":653442}
I20260709 13:06:23.199815 17756 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.246832 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1630) took 1795 ms. Trace:
W20260709 13:06:23.255323 17785 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:06:23.255901 17770 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.282526 15645 rpcz_store.cc:276] 0709 13:06:21.451892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.467883 (+ 15991us) service_pool.cc:224] Handling call
0709 13:06:22.488078 (+1020195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.499634 (+ 11556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.246565 (+746931us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000e83d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:23.246752 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324241152}
I20260709 13:06:23.274876 17642 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.275251 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:23.284657 17775 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.687s	user 0.000s	sys 0.012s
I20260709 13:06:23.276225 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:23.274927 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.239468 17779 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.091101 17600 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.407766 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.374966 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 154963us
I20260709 13:06:23.309263 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.297932 15719 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:23.453204 15795 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:23.461205 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 1949) took 1406 ms. Trace:
I20260709 13:06:23.380604 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.444239 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.453685 16332 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:23.463773 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.299901 16298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.028s	sys 0.075s
W20260709 13:06:23.465200 16298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.037s	sys 0.084s
W20260709 13:06:23.466207 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 819884us
I20260709 13:06:23.268803 15792 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
W20260709 13:06:23.459532 15685 leader_election.cc:336] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.874s (SENT)
I20260709 13:06:23.468487 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.468487 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.461719 15795 rpcz_store.cc:276] 0709 13:06:22.054869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.059345 (+  4476us) service_pool.cc:224] Handling call
0709 13:06:23.274761 (+1215416us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:23.461138 (+186377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19841280}
I20260709 13:06:23.464707 15788 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:23.284799 16328 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:23.313516 17660 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 13:06:23.474184 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.473364 17600 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:23.472640 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.477260 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
W20260709 13:06:23.458546 17710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.003s	sys 0.029s
W20260709 13:06:23.374270 17787 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:23.285005 17770 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.405283 17732 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.336164 17788 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.479573 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.459347 17560 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.297802 17782 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.425144 17530 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.458489 17625 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:23.480800 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.467808 15760 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.757s (SENT)
I20260709 13:06:23.476747 17756 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.461244 17758 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:23.481667 17710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.004s	sys 0.029s
I20260709 13:06:23.506551 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.459807 17738 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.504001 17728 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:23.320199 17764 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.478909 17660 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.518337 17730 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.528765 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1716) took 1529 ms. Trace:
I20260709 13:06:23.527061 15760 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:23.522554 17782 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.537861 17600 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:23.540360 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.540521 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 72741.1us
I20260709 13:06:23.551309 17738 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.532876 17758 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.529750 17625 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.564138 17764 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:23.564936 17625 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.566304 17660 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.569963 17758 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:23.570827 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 102167us
I20260709 13:06:23.531661 17530 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.589401 17710 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:23.591936 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 124437us
I20260709 13:06:23.587009 17761 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:23.557142 17726 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.578862 15715 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:23.524638 17788 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:23.597848 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.598181 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:23.539402 17728 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.601816 17710 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.603480 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2090) took 1174 ms. Trace:
I20260709 13:06:23.603730 17710 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:23.603856 15721 rpcz_store.cc:276] 0709 13:06:22.428962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.429075 (+   113us) service_pool.cc:224] Handling call
0709 13:06:22.429385 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.474086 (+ 44701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.474119 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.474158 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:22.474186 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.603246 (+1129060us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b5400095e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:23.603291 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.603416 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102352768}
I20260709 13:06:23.599668 17545 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.607714 17545 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.610658 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:23.617580 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:23.618813 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:23.619094 17732 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.619645 17736 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:23.620051 17736 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:23.620175 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:23.617295 17660 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:23.620887 17756 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.624989 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:23.627020 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:23.620651 17736 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.636570 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.637503 15718 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:23.638163 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.630591 17756 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:23.639395 17756 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:23.639567 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:23.639833 17756 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.640130 15717 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:23.641023 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:23.641342 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.627970 17732 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.628829 17737 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.642597 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:23.643427 17782 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:23.643173 15717 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.542076 15789 rpcz_store.cc:276] 0709 13:06:21.999379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.126415 (+1127036us) service_pool.cc:224] Handling call
0709 13:06:23.126719 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.126937 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:23.434948 (+308011us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.528128 (+ 93180us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.528424 (+   296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.528485 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:23.528534 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.528598 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.528712 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7799,"prepare.queue_time_us":396972,"raft.queue_time_us":439,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":3368,"spinlock_wait_cycles":23983488,"thread_start_us":391184,"threads_started":2,"wal-append.queue_time_us":84004}
I20260709 13:06:23.649034 17728 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.649621 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2096) took 1031 ms. Trace:
I20260709 13:06:23.650085 15719 rpcz_store.cc:276] 0709 13:06:22.618698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.618858 (+   160us) service_pool.cc:224] Handling call
0709 13:06:23.649396 (+1030538us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54003868d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:23.649556 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533161344}
I20260709 13:06:23.650427 17530 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.651288 17483 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:23.651798 17483 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.652212 15717 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:23.653625 17788 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:23.655287 17766 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 1.370s	user 0.012s	sys 0.000s
I20260709 13:06:23.656488 15716 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:23.658532 15713 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:23.625171 17660 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.662976 17660 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.663223 17761 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.663738 17761 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.642200 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.670403 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:23.671962 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.669493 17530 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.674223 17530 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.675918 17525 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.676323 17545 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.676517 17525 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:23.677489 17525 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.678202 17530 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.673523 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 470) took 2115 ms. Trace:
I20260709 13:06:23.679291 16325 rpcz_store.cc:276] 0709 13:06:21.558581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.565313 (+  6732us) service_pool.cc:224] Handling call
0709 13:06:21.708279 (+142966us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:21.774502 (+ 66223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.774540 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:22.233362 (+458822us) log.cc:844] Serialized 513 byte log entry
0709 13:06:22.284676 (+ 51314us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:22.864699 (+580023us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.129801 (+265102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.129941 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.654637 (+524696us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:23.669507 (+ 14870us) raft_consensus.cc:1685] finished
0709 13:06:23.673302 (+  3795us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.673439 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4488,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":220,"spinlock_wait_cycles":68645760,"thread_start_us":302469,"threads_started":2,"wal-append.queue_time_us":51323}
I20260709 13:06:23.669675 17728 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:23.686615 17728 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.697456 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.706113 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.710196 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 83224us
I20260709 13:06:23.711201 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.712212 15792 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:23.712921 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:23.715543 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:23.724443 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.724418 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.725416 15713 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 2: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:23.725425 15717 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:23.726511 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.731470 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:23.733193 17795 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:06:23.734026 16328 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:23.735162 16297 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:23.735278 17530 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:23.735944 17732 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:23.736426 17732 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:23.736833 17732 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.737169 17702 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:23.737573 17702 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:23.737975 17702 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.739135 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.753278 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:23.715880 17483 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.735327 17770 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.735965 17530 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:23.714308 17759 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:06:23.764806 17681 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.783627 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 276) took 1151 ms. Trace:
I20260709 13:06:23.761173 17710 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:23.794351 17530 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.787261 17728 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.778561 17736 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.782261 17770 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.796211 17741 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.824368 17788 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.824916 17788 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.829665 17732 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.843789 17732 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.831023 17736 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.832247 17756 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.837450 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:23.846822 15760 leader_election.cc:336] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.773s (SENT)
I20260709 13:06:23.836154 17770 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:23.849495 16300 connection.cc:256] RPC call timeout handler was delayed by -1.2708484219999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:06:23.822912 17575 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:23.857023 17756 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.857149 17745 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:23.857627 17745 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:23.855607 16300 connection.cc:256] RPC call timeout handler was delayed by -1.1328702679999196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2899s for a response
I20260709 13:06:23.858546 17745 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.859170 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:23.859935 17745 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.861397 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.861501 17739 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.861882 17759 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:23.862150 17739 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:23.862654 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.862425 17759 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:23.863260 15644 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:23.096086 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.864285 17739 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:23.864539 17759 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:23.859885 16328 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:23.865105 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.865412 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.866426 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.867681 15639 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:23.866410 15542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 147) took 6381 ms. Trace:
I20260709 13:06:23.868577 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:23.868999 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.862094 15645 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:23.869731 15638 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:23.870761 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.872681 15641 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:23.869175 15644 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.878134 15716 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:23.853839 17706 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:23.784967 15714 rpcz_store.cc:276] 0709 13:06:22.632405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.633445 (+  1040us) service_pool.cc:224] Handling call
0709 13:06:22.633836 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.655042 (+ 21206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.655085 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.655693 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.056436 (+400743us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:23.678758 (+622322us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b180019ae60. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:06:23.773860 (+ 95102us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.774295 (+   435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.774405 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.774465 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:23.783213 (+  8748us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.783508 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93817,"prepare.queue_time_us":730333,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":54644,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":45805,"spinlock_wait_cycles":16053248,"thread_start_us":495067,"threads_started":2,"wal-append.queue_time_us":436532}
I20260709 13:06:23.878290 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:23.893266 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:23.868628 15542 rpcz_store.cc:276] 0709 13:06:17.482633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.482813 (+   180us) service_pool.cc:224] Handling call
0709 13:06:23.864014 (+6381201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:20.889327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:21.030229 (+140902us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:21.040569 (+ 10340us) write_op.cc:435] Acquired schema lock
0709 13:06:21.048294 (+  7725us) tablet.cc:662] Decoding operations
0709 13:06:21.157491 (+109197us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:21.157547 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:21.157575 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:21.226223 (+ 68648us) tablet.cc:701] Row locks acquired
0709 13:06:21.226241 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:21.226399 (+   158us) write_op.cc:270] Start()
0709 13:06:21.226529 (+   130us) write_op.cc:276] Timestamp: P: 1783602381226347 usec, L: 0
0709 13:06:21.226546 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:06:21.234163 (+  7617us) log.cc:844] Serialized 3170 byte log entry
0709 13:06:21.533900 (+299737us) op_driver.cc:464] REPLICATION: finished
0709 13:06:21.582330 (+ 48430us) write_op.cc:301] APPLY: starting
0709 13:06:21.582454 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:21.582772 (+   318us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:21.583009 (+   237us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:21.751387 (+168378us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:21.751715 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:21.751794 (+    79us) write_op.cc:312] APPLY: finished
0709 13:06:21.975068 (+223274us) log.cc:844] Serialized 65 byte log entry
0709 13:06:22.025270 (+ 50202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:22.049568 (+ 24298us) write_op.cc:454] Released schema lock
0709 13:06:22.055532 (+  5964us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:22.183976 (+128444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:22.184515 (+   539us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":312186,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":48114,"apply.run_cpu_time_us":5257,"apply.run_wall_time_us":506617,"num_ops":8,"prepare.queue_time_us":598473,"prepare.run_cpu_time_us":44954,"prepare.run_wall_time_us":497636,"raft.queue_time_us":122367,"raft.run_cpu_time_us":7588,"raft.run_wall_time_us":62975,"replication_time_us":307159,"thread_start_us":620128,"threads_started":4,"wal-append.queue_time_us":155738,"wal-append.run_cpu_time_us":33452,"wal-append.run_wall_time_us":1600254}]]}
W20260709 13:06:23.897693 15715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1129) took 3626 ms (client timeout 1773 ms). Trace:
W20260709 13:06:23.898234 15715 rpcz_store.cc:269] 0709 13:06:20.249183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.249847 (+   664us) service_pool.cc:224] Handling call
0709 13:06:23.875564 (+3625717us) spinlock_profiling.cc:243] Waited 3.27 s on lock 0x7b54001e6c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:23.875674 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7520644480}
I20260709 13:06:23.905090 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:23.905772 16332 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:23.855525 17788 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:23.923933 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1148) took 1156 ms. Trace:
I20260709 13:06:23.931254 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.937366 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.940471 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.925607 15720 rpcz_store.cc:276] 0709 13:06:22.767095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.093158 (+326063us) service_pool.cc:224] Handling call
0709 13:06:23.093637 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.093867 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:23.799696 (+705829us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.923475 (+123779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.923549 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:23.923614 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.923709 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.923862 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":587286,"prepare.queue_time_us":724917,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":241286,"threads_started":2}
W20260709 13:06:23.943732 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 190518us
I20260709 13:06:23.946236 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.950711 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.951304 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.951629 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.951865 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.952067 15790 raft_consensus.cc:2368] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:23.952787 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.952879 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.954044 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.955241 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.955950 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:23.902938 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:23.960489 15720 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.960274 15685 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:23.961613 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.979352 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.980835 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.963573 15638 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.964187 15792 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:23.983713 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:23.986510 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3846244200000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:06:23.987419 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2838244199999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:06:23.989327 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:23.990087 15791 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:23.991521 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.992133 15643 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:23.993237 15647 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:23.992159 15639 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:23.994778 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.994951 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:23.995822 15644 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:23.989871 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:23.996953 15643 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:23.997437 15720 raft_consensus.cc:2376] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3. Re-sending same reply.
I20260709 13:06:23.997884 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:23.929251 17737 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.922447 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:23.959272 17765 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.576s	user 0.005s	sys 0.013s
I20260709 13:06:23.906143 17741 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:06:24.007215 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.009586 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.010114 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.025146 15790 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 1.
I20260709 13:06:24.028554 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:24.029496 15638 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.030138 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:24.011592 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.032003 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:24.032891 15714 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.012421 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:23.942034 17745 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.031625 15795 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:24.037058 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.037235 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.037837 15640 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:24.019692 15720 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.942227 17729 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.902868 17706 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:24.022297 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 118045us
I20260709 13:06:24.023803 15715 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.023947 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:24.054302 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.055042 15790 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:24.056558 15646 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:24.057956 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48627.9us
I20260709 13:06:23.989169 17530 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.992899 17760 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:23.967499 17545 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.042027 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.008320 17739 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.061446 15640 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.059662 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:24.071481 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 131848us
I20260709 13:06:23.989450 16325 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:24.072922 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.062597 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:24.011251 17770 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:24.064774 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:24.065636 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:24.079412 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:24.091053 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.069851 17525 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.105428 17728 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.106267 17728 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.107012 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 494) took 3016 ms. Trace:
I20260709 13:06:24.107635 16331 rpcz_store.cc:276] 0709 13:06:21.090330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.095484 (+  5154us) service_pool.cc:224] Handling call
0709 13:06:22.293587 (+1198103us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:22.293842 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.500934 (+207092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.106644 (+1605710us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54007904d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:24.106923 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335457792}
I20260709 13:06:24.114570 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.062093 17810 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:24.082160 17759 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.073820 17530 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.087893 17660 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.080765 17760 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.077698 17625 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.091610 17814 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.084322 17786 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:24.135705 17625 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.058230 17745 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.102097 17738 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.057893 17729 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.088300 16326 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:24.156654 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.115769 17728 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:24.120657 17810 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.159548 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.160247 15647 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:24.083598 17739 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:24.150477 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 248308us
I20260709 13:06:24.159333 17625 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.150206 15714 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:24.136794 17760 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.214390 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:24.214493 15791 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:24.171226 15646 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:24.173035 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.227756 15788 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
W20260709 13:06:24.180823 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.187664 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.114655 17741 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:06:24.188342 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.137213 17814 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:24.189129 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:24.189600 17810 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.196858 17745 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:24.202087 17770 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.203840 17739 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.219995 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.220896 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.230412 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:24.233398 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.235357 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:24.182241 17738 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:24.230846 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:24.236128 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.137359 17786 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.243122 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.317353 15638 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
W20260709 13:06:24.314059 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 248843us
I20260709 13:06:24.318921 15715 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:24.318241 15646 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.383888 17625 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:24.400599 17816 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:06:24.437013 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:24.423110 17776 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.815s	user 0.005s	sys 0.014s
I20260709 13:06:24.317365 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.240057 17525 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:24.282263 17767 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.445668 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.446094 17767 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.446494 17767 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.446970 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.446538 17525 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.448066 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.449134 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.283558 17818 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:24.369333 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.425721 17706 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:24.375361 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 145019us
W20260709 13:06:24.247328 17761 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.002s
I20260709 13:06:24.454572 17745 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:24.271301 17811 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:06:24.247503 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:24.309231 17777 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.421583 17786 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.380198 17697 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:24.266669 17770 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:24.443738 17817 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:06:24.444645 17812 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:06:24.372462 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 141666us
I20260709 13:06:24.431154 17625 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.479707 17625 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.400313 17814 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.454700 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.484537 16332 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.452520 17818 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:24.450994 17530 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:24.453042 17729 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:24.469899 17826 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:06:24.455317 17761 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.470240 17770 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.456167 17821 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:06:24.473920 17702 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.735s	user 0.005s	sys 0.008s
I20260709 13:06:24.473937 17728 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:24.489665 17819 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.505045 17842 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.505264 17819 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:24.505555 17842 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:24.505843 17819 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.489452 17818 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.466192 17777 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.476022 17738 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.513581 17777 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.503646 17702 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.515744 17702 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.519209 17819 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.506673 17842 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:24.399901 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 211631us
I20260709 13:06:24.381922 15638 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.553200 15610 leader_election.cc:400] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:24.553978 15610 leader_election.cc:403] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:24.397656 15644 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.556411 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.553712 15638 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.557062 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.257913 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.557731 15644 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:24.556692 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.558516 15643 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:24.559543 15644 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.560493 15643 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:24.561251 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.563664 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.566273 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.566732 15640 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 1.
I20260709 13:06:24.568856 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.571987 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.567479 15639 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:24.319339 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:24.575107 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.576213 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 256778us
I20260709 13:06:24.577538 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.578296 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.442576 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.582965 15714 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:24.558531 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:24.584571 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.586009 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:24.584746 15638 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:24.454710 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:24.588418 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.588737 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.586261 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.438519 15715 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:24.591214 15720 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.592264 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.593144 15720 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.593493 15715 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:24.596199 15718 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.596657 15715 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:24.600518 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 144467us
I20260709 13:06:24.600510 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2094) took 2162 ms. Trace:
I20260709 13:06:24.602398 15722 rpcz_store.cc:276] 0709 13:06:22.437793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.438070 (+   277us) service_pool.cc:224] Handling call
0709 13:06:22.438443 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.455856 (+ 17413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.455903 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.456553 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.553429 (+ 96876us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:22.553496 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.553612 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.807358 (+1253746us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:06:24.206697 (+399339us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:24.599953 (+393256us) raft_consensus.cc:1685] finished
0709 13:06:24.600002 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.600289 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16924,"raft.queue_time_us":17087,"raft.run_cpu_time_us":12218,"raft.run_wall_time_us":1349388,"spinlock_wait_cycles":65340928,"thread_start_us":64826,"threads_started":1,"wal-append.queue_time_us":110481}
I20260709 13:06:24.606608 17848 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:24.607970 17848 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.607970 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:24.610411 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 187128us
I20260709 13:06:24.460668 17575 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:24.616906 17741 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.596657 15646 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:24.620359 17848 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.623027 17759 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.624120 16330 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.624759 17756 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.627979 17756 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.629196 17530 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.632550 17575 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.628943 17840 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:24.632203 17761 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:24.638773 17575 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:24.629550 17745 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.646560 17729 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.664518 17745 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.664973 17767 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.666882 17745 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.668133 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.669234 15793 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:24.669791 17760 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:24.656133 17830 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.657521 17831 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:24.651258 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:24.655496 17814 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.669098 17767 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.660468 17819 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.663362 17575 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:24.672593 15793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 1961) took 2610 ms (client timeout 1556 ms). Trace:
I20260709 13:06:24.672535 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.624243 17759 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:24.674564 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 55420us
W20260709 13:06:24.674487 15793 rpcz_store.cc:269] 0709 13:06:22.060139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.066525 (+  6386us) service_pool.cc:224] Handling call
0709 13:06:24.667685 (+2601160us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:24.669727 (+  2042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3337600}
I20260709 13:06:24.660871 17818 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:24.680166 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 72615.2us
I20260709 13:06:24.670267 17760 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.687759 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:24.689042 15722 raft_consensus.cc:2376] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3. Re-sending same reply.
I20260709 13:06:24.689985 17777 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:24.693964 17741 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:24.694075 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:24.694772 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:24.695797 17760 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.696391 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.702821 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.688814 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.707970 16329 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:24.655624 17828 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.666911 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1717) took 2640 ms. Trace:
I20260709 13:06:24.715051 17831 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.715646 17831 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:24.709991 15787 rpcz_store.cc:276] 0709 13:06:22.026336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.027812 (+  1476us) service_pool.cc:224] Handling call
0709 13:06:22.309727 (+281915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.335225 (+ 25498us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:22.368280 (+ 33055us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.546098 (+1177818us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18003409c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:06:23.586667 (+ 40569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.586725 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:23.586783 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.586880 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.666443 (+1079563us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400219dd0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:24.666738 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18604,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2702,"raft.queue_time_us":938,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":570090112,"thread_start_us":40253,"threads_started":1,"wal-append.queue_time_us":1215590,"wal-append.run_cpu_time_us":1530,"wal-append.run_wall_time_us":1069924}
I20260709 13:06:24.693403 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.663450 17840 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:24.727898 16331 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.726861 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.733417 17575 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.733661 17818 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:24.736019 17848 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:24.628961 17756 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.727768 17753 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:24.750573 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 99611.3us
I20260709 13:06:24.755682 17851 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:24.755824 17850 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:24.756534 17851 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:24.716997 17831 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.728308 17840 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:24.753361 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:24.747356 17753 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:24.777557 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.778061 17753 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.779728 17753 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.779902 17759 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.757697 17850 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:24.781970 17850 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:24.778612 16329 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:24.784017 17831 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.783821 17850 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.761530 17756 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:24.788182 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:24.785542 17850 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.781113 17745 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.792763 16298 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.794088 17818 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.794931 17745 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:24.784039 17840 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.800202 17840 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:24.803325 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 211306us
I20260709 13:06:24.806049 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:24.806486 17729 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.823320 17575 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.804867 17851 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.836218 17575 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.838073 17729 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.843348 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:24.825651 17818 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:06:24.846472 17852 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.849047 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.860170 15641 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:24.873034 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.879431 17842 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.883076 17575 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:24.889348 17736 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.902722 17738 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.903304 17738 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.903764 17738 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.903535 17625 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:24.905923 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 182182us
W20260709 13:06:24.906152 17810 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.005s
I20260709 13:06:24.907008 17702 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:24.912521 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:24.913507 17575 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.913658 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:24.926530 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:24.950021 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 101219us
I20260709 13:06:24.951002 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.952859 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.954556 17849 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:24.954829 17575 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:24.955315 17575 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.955964 17575 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.956884 17525 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.958714 17834 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:24.954427 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.934641 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.955240 17849 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:24.915409 17760 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.968511 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:24.973001 15719 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:24.973806 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:24.974485 15714 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:24.974603 17829 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.975507 15717 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:24.971843 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:24.975618 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.926467 17810 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:24.965075 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:24.914567 17736 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:24.982118 17530 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.971833 17761 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.937181 17850 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.001693 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:24.983966 17849 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:25.014189 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61428.1us
I20260709 13:06:25.017108 15720 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:25.017167 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 81591.1us
I20260709 13:06:25.018824 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:25.020139 16325 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:25.021875 17756 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:25.022007 17852 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.023588 16330 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:25.023830 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 381) took 1140 ms. Trace:
I20260709 13:06:25.024351 16328 rpcz_store.cc:276] 0709 13:06:23.883469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.893231 (+  9762us) service_pool.cc:224] Handling call
0709 13:06:23.898161 (+  4930us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:24.099262 (+201101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.113066 (+ 13804us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:24.692395 (+579329us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b2c00047568. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:24.693294 (+   899us) log.cc:844] Serialized 52 byte log entry
0709 13:06:24.825112 (+131818us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:24.935817 (+110705us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.023220 (+ 87403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.023349 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.023406 (+    57us) raft_consensus.cc:1685] finished
0709 13:06:25.023495 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.023641 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53072,"prepare.queue_time_us":41023,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":132262,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":22960,"spinlock_wait_cycles":32079232,"thread_start_us":393631,"threads_started":3,"wal-append.queue_time_us":188759}
I20260709 13:06:25.029822 17834 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.032735 17834 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:25.033465 17621 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:25.033952 17851 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.034574 17851 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:25.035154 17851 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.035652 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:25.036765 17760 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:25.037549 17621 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:25.037812 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:25.038343 17621 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:25.038972 17621 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.038980 17837 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.041080 17837 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.043823 17837 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:25.032516 17738 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.044466 17837 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.045364 17660 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.048404 17736 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:25.048810 17660 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:25.049870 15716 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:25.048830 17738 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:25.054207 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 82457.9us
W20260709 13:06:25.058060 17855 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.293s	user 0.004s	sys 0.000s
I20260709 13:06:25.060575 17745 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:25.024267 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69992us
I20260709 13:06:25.061000 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:25.063912 16331 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.006237 17761 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:25.007560 17850 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.063927 17745 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:25.066105 17850 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.066335 17745 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:25.067569 17745 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.068850 17745 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.024922 17702 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:25.066349 17761 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.070626 17702 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:25.071916 17702 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.072562 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.074196 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.071800 17761 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.075169 15638 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:25.075984 16333 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:25.080580 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:25.081794 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:25.081894 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.024194 17810 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:25.098940 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:25.081699 16328 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:25.109146 17852 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:25.110227 17852 consensus_queue.cc:1243] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:25.105195 15646 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:25.121023 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.127889 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.129340 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:25.129805 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 117445us
I20260709 13:06:25.130160 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.130733 15644 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:25.130954 15641 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:25.132105 15644 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:25.132355 15641 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:25.137633 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:25.142601 15716 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:25.086723 17760 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:25.151458 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:25.153187 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:25.164394 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:25.163846 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.158402 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:25.191315 17763 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 2.918s	user 0.003s	sys 0.020s
W20260709 13:06:25.193325 17721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.497s	user 0.009s	sys 0.015s
W20260709 13:06:25.193833 17721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.585s	user 0.010s	sys 0.015s
I20260709 13:06:25.195358 17721 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:25.195767 17721 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:25.196662 17721 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:25.197906 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.209568 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 100009us
I20260709 13:06:25.182129 17621 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:25.211025 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 185807us
W20260709 13:06:25.211581 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.211486 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.211818 15640 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.231388 17782 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.231902 17782 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:25.233080 17782 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:25.255788 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.208664 17738 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:25.263262 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.243999 16331 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:25.262514 17721 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.277508 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:25.278242 16328 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:25.265465 17621 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.285640 17621 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.285630 15640 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:25.282415 15717 raft_consensus.cc:2376] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3. Re-sending same reply.
I20260709 13:06:25.291587 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:25.292655 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 386) took 1407 ms. Trace:
I20260709 13:06:25.293041 16327 rpcz_store.cc:276] 0709 13:06:23.884987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.893363 (+  8376us) service_pool.cc:224] Handling call
0709 13:06:25.291236 (+1397873us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:25.292569 (+  1333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8167808}
I20260709 13:06:25.305342 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:25.305989 15638 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:25.306223 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.307186 15640 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:25.307365 17810 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.307824 17810 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:25.308185 17810 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.285542 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.310791 15645 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:25.313680 17721 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.314230 17721 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:25.314364 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49151.7us
I20260709 13:06:25.315337 17721 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.315650 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:25.317023 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:25.318600 17776 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:25.341097 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 1985) took 1382 ms. Trace:
I20260709 13:06:25.341710 15791 rpcz_store.cc:276] 0709 13:06:23.958188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.990688 (+ 32500us) service_pool.cc:224] Handling call
0709 13:06:25.340562 (+1349874us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54004213d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:25.340811 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334082816}
I20260709 13:06:25.351351 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:25.362432 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.364723 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.375849 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.379102 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:25.381315 17788 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.366955 17782 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.381852 17575 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.394299 17575 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.394086 17737 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:25.395153 17575 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:25.396399 17575 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.396834 17575 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:25.397250 17575 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.401034 15640 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:25.383503 17851 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.422150 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:25.375257 17849 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.438822 17483 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.438509 17850 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.439333 17483 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:25.439924 15714 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:25.448225 17701 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:25.450322 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:25.450740 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.454279 17701 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:25.456281 15639 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:25.455659 17701 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:25.470408 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.471158 15639 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:25.476272 17701 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.477793 17701 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.467242 17745 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:25.499388 17873 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.500139 17873 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:25.500538 17873 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.478382 17851 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.499527 17843 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.483559 17849 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:25.448429 17483 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.508059 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.506916 17625 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:25.513027 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.517987 17843 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.518994 17802 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.537953 17745 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.537402 17802 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.539508 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:25.540333 17745 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.540603 17802 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:25.543192 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:25.520124 17575 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.520327 17810 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.521124 17851 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.522899 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:25.548296 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:25.511454 17842 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.631s	user 0.016s	sys 0.002s
I20260709 13:06:25.558597 17851 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:25.560192 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.560634 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:25.561270 17831 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:25.562036 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:25.562119 17831 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:25.563894 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.567013 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.560205 17851 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.546381 17843 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.588367 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:25.590339 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:25.586422 17761 consensus_meta.cc:287] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.001s
W20260709 13:06:25.711951 17874 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:06:25.824082 15761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.031s
W20260709 13:06:25.855580 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.919729 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.892208 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.895191 17575 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.603562 17843 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:06:25.896523 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.618046 17697 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:06:25.902637 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:25.613284 17745 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:25.591769 17842 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.906706 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:25.913187 15761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.031s
W20260709 13:06:25.914276 15759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.022s
W20260709 13:06:25.914968 15716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.005s	sys 0.018s
I20260709 13:06:25.923476 15639 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
W20260709 13:06:25.914652 15646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.010s
W20260709 13:06:25.939397 15759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.001s	sys 0.023s
W20260709 13:06:25.939841 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 709212us
W20260709 13:06:25.940513 15716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.005s	sys 0.018s
I20260709 13:06:25.905251 17761 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:25.917479 15638 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:25.978502 15644 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:25.979745 17483 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.950672 15717 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:06:25.963718 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:26.012882 15645 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.949928 15643 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:25.950922 15718 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:06:26.008361 15646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.010s
W20260709 13:06:26.016655 17809 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.953s	user 0.008s	sys 0.004s
I20260709 13:06:26.018168 17673 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:26.019088 17673 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:26.023021 17873 consensus_meta.cc:287] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.522s	user 0.014s	sys 0.002s
I20260709 13:06:26.023698 17873 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:26.024927 17871 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.132s	user 0.003s	sys 0.006s
I20260709 13:06:26.027697 17810 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.029178 17873 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.015100 15718 pending_rounds.cc:85] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 1
I20260709 13:06:26.046618 15718 pending_rounds.cc:107] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:26.047013 15718 raft_consensus.cc:2889] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.938061 15641 raft_consensus.cc:2376] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3. Re-sending same reply.
W20260709 13:06:25.986891 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.029914 17851 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:25.941402 17697 consensus_queue.cc:1243] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:25.946671 17843 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.072819 17843 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:25.965351 17850 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:25.982781 17721 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.936627 17745 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:26.034001 17831 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:25.962536 17729 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:25.963143 17702 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.942454 17802 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:25.978510 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76128.9us
I20260709 13:06:25.987006 17621 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.038837 15541 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 4, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.041778 17761 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:26.043525 17673 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.044803 17819 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.073889 17851 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.082929 17745 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.945938 17781 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.176s
I20260709 13:06:26.080708 17852 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.107259 15760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.015s
W20260709 13:06:26.107689 15760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.003s	sys 0.015s
W20260709 13:06:26.107996 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 543909us
I20260709 13:06:26.073818 17843 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.104516 17819 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:26.112571 15647 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:26.091317 17831 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.089095 17702 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.097934 17625 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:26.123399 15645 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:26.084860 17850 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:26.123188 17625 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:26.093766 17802 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:26.115363 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.014s	sys 0.034s
I20260709 13:06:26.123567 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:26.173602 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.016s	sys 0.050s
I20260709 13:06:26.122658 17702 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:26.174851 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 857867us
I20260709 13:06:26.133435 15541 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.110220 17852 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.125800 17782 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.179891 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.115731 17621 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.132941 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:26.121814 17831 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.176098 17575 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.127962 17701 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:06:26.183697 17782 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:26.228438 15791 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:26.231372 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 98319.4us
I20260709 13:06:26.199224 17673 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:26.233687 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 59137us
I20260709 13:06:26.190476 16326 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
W20260709 13:06:26.248430 15721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.028s
W20260709 13:06:26.248924 15721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.029s
I20260709 13:06:26.212024 17850 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:26.249672 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1176) took 1116 ms. Trace:
I20260709 13:06:26.252969 15792 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.203116 17575 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.253364 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.259874 15541 catalog_manager.cc:5697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 2 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.247203 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:26.280848 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:26.245875 17818 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:26.203235 17625 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.265448 15721 rpcz_store.cc:276] 0709 13:06:25.132847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.192109 (+ 59262us) service_pool.cc:224] Handling call
0709 13:06:25.192423 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.192752 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:25.565814 (+373062us) log.cc:844] Serialized 14 byte log entry
0709 13:06:26.249325 (+683511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:26.249378 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:26.249425 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.249492 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.249607 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5777,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":2705,"thread_start_us":1030524,"threads_started":2}
I20260709 13:06:26.265412 17843 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.201076 17819 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.294965 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:26.294682 17779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.008s	sys 0.025s
I20260709 13:06:26.251372 17761 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:06:26.300951 17779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.008s	sys 0.025s
I20260709 13:06:26.307034 17851 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.307790 17851 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:26.309882 17890 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:06:26.309973 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.311430 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.312692 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.285426 17701 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:26.264721 17673 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.313885 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:26.314466 17819 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.314652 17851 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:26.314929 15792 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:26.315327 17851 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:26.315877 17673 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:26.315747 17851 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.316447 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:26.301474 15787 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.317232 15788 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:26.318056 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:26.318742 15788 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:26.319646 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.319566 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:26.320274 15788 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:26.321149 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:26.305492 17560 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.322083 17560 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:26.322510 17560 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.314028 15541 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.324347 15541 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 4, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.315937 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:26.326503 17852 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:26.326851 17575 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:26.327195 17852 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.327499 17575 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:26.327641 17852 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.328081 17575 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:26.329331 17802 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:26.316713 17851 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.330662 17625 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.296417 17873 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.328151 17852 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.266391 17850 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.343524 15792 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.344347 17885 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:26.363646 15788 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:26.369513 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.303916 17786 raft_consensus.cc:2764] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:26.330890 17831 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:26.404578 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:26.329147 17575 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.421461 15794 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 2: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:26.281711 17782 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.304205 17729 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:26.372655 17885 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:26.437902 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88432.9us
I20260709 13:06:26.443275 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1662) took 1031 ms. Trace:
I20260709 13:06:26.373131 17697 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:26.439325 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 500855us
I20260709 13:06:26.372782 17840 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:26.428821 17621 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:26.436697 17483 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.481114 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.441247 17701 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.488044 17840 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:26.436062 17821 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:26.438402 17729 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:26.477223 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 211598us
I20260709 13:06:26.443742 15640 rpcz_store.cc:276] 0709 13:06:25.411689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.415568 (+  3879us) service_pool.cc:224] Handling call
0709 13:06:25.430373 (+ 14805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.468249 (+ 37876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.468291 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.479170 (+ 10879us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.938744 (+459574us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:26.442534 (+503790us) log.cc:844] Serialized 14 byte log entry
0709 13:06:26.442755 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.443022 (+   267us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.443077 (+    55us) raft_consensus.cc:1685] finished
0709 13:06:26.443088 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.443222 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105071,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":4056,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13700,"thread_start_us":844748,"threads_started":2,"wal-append.queue_time_us":588871}
I20260709 13:06:26.487336 15788 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:26.495541 17621 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.507038 17621 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.509256 17621 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.509656 17885 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.530550 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.531155 17885 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.535281 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.536247 15721 raft_consensus.cc:2410] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:26.536303 17702 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.530781 17729 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:26.539424 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 447331us
W20260709 13:06:26.540102 15715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.011s
I20260709 13:06:26.541749 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:26.541715 15715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.011s
I20260709 13:06:26.503158 17821 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:26.510845 17782 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.540014 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3997110480000856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260709 13:06:26.559128 16329 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.501327 17701 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:26.587163 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3295110480000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 13:06:26.587586 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2724093120000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:06:26.587939 15610 connection.cc:256] RPC call timeout handler was delayed by -1.1963110480000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:06:26.559172 17842 consensus_meta.cc:287] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.024s
W20260709 13:06:26.558694 17893 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:26.594887 15788 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:26.591358 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:26.539642 17483 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.592263 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:26.595362 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:26.600793 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:26.603994 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66437.5us
I20260709 13:06:26.605264 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:26.606915 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:26.608371 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:26.608863 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.610873 15720 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:26.612548 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.611056 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:26.595445 17842 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.611631 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:26.616971 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:26.617111 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:26.617184 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:26.596608 17818 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:26.618533 15641 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 2: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:26.618559 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 305908us
I20260709 13:06:26.621299 15644 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.622743 15645 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:26.624004 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:26.607599 17621 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.630317 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:26.634063 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 143373us
I20260709 13:06:26.637140 15720 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:26.638728 15789 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:26.611655 17759 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:26.643345 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 477168us
I20260709 13:06:26.643787 17739 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.644233 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1283) took 2718 ms. Trace:
I20260709 13:06:26.624008 17850 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.649963 17880 raft_consensus.cc:1064] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: attempting to promote NON_VOTER 228b1ac5589e48af9bbf6caecd6aeaea to VOTER
I20260709 13:06:26.632812 17697 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:26.663262 15643 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.664522 15790 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.619521 15787 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:26.603482 17840 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.685842 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:26.686219 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 67558us
I20260709 13:06:26.688462 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:26.693360 17900 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:26.688848 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:26.693794 16328 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:26.689456 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:26.694557 17900 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.695628 16327 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:26.689181 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:26.623637 17560 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.670784 17819 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:26.708314 15795 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.709707 17483 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:26.710315 17483 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.710821 17483 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.712332 17900 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:26.712751 15792 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
W20260709 13:06:26.714289 17903 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:26.665477 15642 rpcz_store.cc:276] 0709 13:06:23.867073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.892588 (+ 25515us) service_pool.cc:224] Handling call
0709 13:06:25.562764 (+1670176us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1eee 0000000000375939 00007fad2a3551e0 00007fad2a41e0c4 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:25.562976 (+   212us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:25.602313 (+ 39337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.604569 (+  2256us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:26.025718 (+421149us) log.cc:844] Serialized 52 byte log entry
0709 13:06:26.475547 (+449829us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:26.477498 (+  1951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.484051 (+  6553us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.539394 (+ 55343us) raft_consensus.cc:1685] finished
0709 13:06:26.539411 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.583424 (+ 44013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7804,"raft.queue_time_us":12293,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":14944,"spinlock_wait_cycles":13329664,"thread_start_us":412981,"threads_started":1,"wal-append.queue_time_us":506479}
I20260709 13:06:26.623070 17821 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.716923 17821 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.717836 17873 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.718331 17873 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.677466 17739 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.641355 17621 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.666174 17849 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:26.750972 15713 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:26.752573 17745 consensus_meta.cc:287] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.638s	user 0.001s	sys 0.009s
I20260709 13:06:26.754202 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.728843 17900 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.754508 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:26.755452 17906 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:26.757825 15718 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:26.757521 17899 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:26.758087 17810 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:26.758790 17739 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:26.761112 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.770756 15717 raft_consensus.cc:2410] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:26.665844 17759 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.714334 17483 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.779595 17880 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.725790 17819 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:26.726794 17814 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:26.796288 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 126012us
I20260709 13:06:26.784547 17702 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:26.830089 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.856127 17575 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:26.876974 17575 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } attrs { replace: true } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.784951 17900 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.877907 17697 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.879583 17900 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.880053 17575 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.781445 17745 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:26.883056 17745 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.885821 17560 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:26.887517 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.888191 15796 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:26.888662 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.892096 17739 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:26.892529 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.893062 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.895768 15759 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:26.899025 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.900202 15713 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:26.831463 17701 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:26.830526 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.857007 16329 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.857430 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.923240 15718 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:26.706972 17842 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:06:26.782366 17840 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.829020 15714 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:26.869596 16332 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:26.870515 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:26.932880 15722 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.866182 17819 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.926841 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:26.917352 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:26.933449 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 297924us
W20260709 13:06:26.934114 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 151084us
I20260709 13:06:26.892773 17739 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:26.905627 17851 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:06:26.916843 15644 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
W20260709 13:06:26.949487 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.953249 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 245416us
I20260709 13:06:26.856568 17810 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:26.958914 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.934056 17900 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.980361 15795 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:26.925074 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:26.939818 17818 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:26.935985 17575 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:27.012761 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.945429 17741 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:26.893913 17814 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.032362 17575 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:27.042932 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:26.943601 17851 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:26.995138 17850 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.993160 17923 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.047199 15796 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.932358 17802 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:06:27.052737 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.058879 15795 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.050340 17741 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.073382 15794 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:27.067082 17923 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.076508 17681 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:27.077037 15790 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:27.078691 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 93638.9us
I20260709 13:06:27.053269 17575 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.081298 17908 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:27.001649 17900 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.091666 15643 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:27.068820 17921 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:27.084829 17741 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.076529 17739 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.074075 17760 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.085005 17802 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:27.129787 17921 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.101210 17621 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.136850 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.127949 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:27.085647 17899 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:06:27.099961 17530 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.134231 17818 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.085181 17850 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.129801 17759 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:27.162174 17918 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
W20260709 13:06:27.180023 17924 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 13:06:27.191466 17810 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.091430 17681 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.126415 17908 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:27.204486 17916 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:06:27.156759 17927 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:27.272578 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.162379 17739 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.205621 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 172940us
I20260709 13:06:27.277861 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.295734 15643 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.275813 15796 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.298312 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.160607 17760 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.301860 15791 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:27.238556 17937 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.277701 17852 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.873s	user 0.013s	sys 0.006s
W20260709 13:06:27.278016 17821 consensus_meta.cc:287] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.008s
I20260709 13:06:27.307685 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.310913 15792 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.275813 17745 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.312453 15644 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:27.293253 17729 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:27.322141 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 329701us
I20260709 13:06:27.162467 17802 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.315321 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.273130 17885 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:27.318244 17925 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:06:27.318503 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.318979 17852 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.275904 17621 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.326370 15647 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:27.327668 15645 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.327962 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.332748 15644 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:06:27.328675 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 406061us
I20260709 13:06:27.330651 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:27.333520 16300 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.799s (SENT) [suppressed 41 similar messages]
I20260709 13:06:27.333938 15639 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:27.334817 17621 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.318316 17923 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.337764 15641 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.312954 17927 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
I20260709 13:06:27.340107 17927 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.320182 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.342206 15642 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.342545 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2138) took 2041 ms. Trace:
I20260709 13:06:27.342957 15715 rpcz_store.cc:276] 0709 13:06:25.300791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.617851 (+317060us) service_pool.cc:224] Handling call
0709 13:06:25.892907 (+275056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:26.542806 (+649899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:26.542836 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:26.559273 (+ 16437us) log.cc:844] Serialized 26 byte log entry
0709 13:06:26.724258 (+164985us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:26.724294 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.724405 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:27.342321 (+617916us) raft_consensus.cc:1685] finished
0709 13:06:27.342344 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:27.342476 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36563,"raft.queue_time_us":79068,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":719378,"threads_started":2,"wal-append.queue_time_us":223471}
I20260709 13:06:27.346874 17850 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:27.348088 17873 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.009s
I20260709 13:06:27.348505 17873 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.348858 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.349232 17921 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.349978 15790 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:27.353315 16334 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:27.354877 15643 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:27.355504 17828 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:27.355935 17828 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.356859 17828 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.358140 17810 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:27.359573 17760 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.328658 17885 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:27.361160 17908 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.301860 17739 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.382587 17885 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.383605 17739 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.384073 17885 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:27.361991 17930 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.143s	user 0.003s	sys 0.003s
I20260709 13:06:27.362558 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.364228 17936 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:27.313195 17851 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.365505 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.337110 17621 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:27.387717 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58735.8us
W20260709 13:06:27.402143 17929 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:06:27.403366 17933 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:06:27.404644 17828 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.315630 17937 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.398135 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:27.406133 15794 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:27.407017 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.407868 15642 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.399649 15792 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:27.418606 17843 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.117s	user 0.017s	sys 0.014s
I20260709 13:06:27.420853 17802 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:27.421192 17873 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.421442 17819 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.390560 17850 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.423925 17850 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.424150 17575 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.325191 17745 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:27.427919 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.428623 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.428544 17745 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.428637 17681 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.430079 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:27.431128 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 513822us
I20260709 13:06:27.432086 17779 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:27.432569 17779 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.432935 17681 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:27.434095 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.434175 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.434791 15720 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:27.435643 17928 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.436269 17928 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:27.436717 15791 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:27.437683 17900 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:27.439534 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.418872 17814 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.439863 17697 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:27.440248 15788 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.440336 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.440548 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.441053 15794 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.441356 17915 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.441715 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:27.441915 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.442042 17915 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:27.442123 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.442461 15794 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.443392 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.388623 17781 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.510710 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.515038 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.515678 15639 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.515991 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:27.450474 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.441462 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:27.518744 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 416057us
I20260709 13:06:27.467698 15645 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.514549 15641 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.519627 15788 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.520394 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.520996 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.438795 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.516533 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:27.528421 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 96633.1us
I20260709 13:06:27.526762 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.526455 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.543052 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:27.543648 15720 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
W20260709 13:06:27.459223 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.517370 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.443094 17915 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.550015 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.545660 15790 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.553174 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.552671 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.552767 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.557283 15643 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:27.443663 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.479169 17907 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:06:27.419163 17852 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.552578 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.558527 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.432929 17701 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.395581 17936 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.494565 17849 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:27.560042 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:27.576344 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.583676 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.437251 17928 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:27.574882 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 251818us
I20260709 13:06:27.575353 15717 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:27.579285 15639 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:27.433544 17681 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.580415 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.494629 17802 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:27.584640 15788 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:27.591954 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.585175 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:27.561389 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:27.598788 15789 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 2.
I20260709 13:06:27.583357 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:27.584364 15790 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.613371 15715 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:27.615137 15794 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:27.433497 17779 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.549455 17781 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.598785 16331 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:27.591918 17915 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.610986 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.631376 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:27.551693 17843 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.591572 17850 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.615861 17786 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.637831 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.615093 17575 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:27.639768 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.645589 15788 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.638616 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.591702 17701 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.604563 17910 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:27.648456 15793 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.494184 17741 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.616029 17936 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.654244 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:27.656323 16334 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.612311 17802 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.654145 17786 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.630834 17818 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:27.676807 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:27.676910 17818 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.678196 17786 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.679291 17818 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.662285 17943 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.672500 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.680603 17741 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.681212 17741 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:27.654879 17760 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:27.681762 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.671021 17936 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.669549 17849 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.687345 16332 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:27.672480 17781 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.686635 15642 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
W20260709 13:06:27.691354 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 137457us
I20260709 13:06:27.644767 17560 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:27.662163 17843 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:27.700227 17900 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:27.701097 17942 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:27.702453 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:27.705788 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.703244 17927 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.694741 17943 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:27.703907 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.707990 17843 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.708711 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:27.706593 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:27.709440 17927 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:27.709544 17920 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.665s	user 0.005s	sys 0.000s
I20260709 13:06:27.711057 17701 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.710901 17810 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:27.711740 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.668056 17814 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:27.713307 17681 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:27.719194 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:27.721060 16330 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
W20260709 13:06:27.722514 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.727031 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1191) took 1104 ms. Trace:
I20260709 13:06:27.719780 17885 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:27.742070 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:27.744570 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:27.730418 15721 rpcz_store.cc:276] 0709 13:06:26.622511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.622637 (+   126us) service_pool.cc:224] Handling call
0709 13:06:26.638885 (+ 16248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:26.643489 (+  4604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:26.643529 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:26.644031 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:06:26.819895 (+175864us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:26.819953 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.820052 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:27.708857 (+888805us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:27.721095 (+ 12238us) raft_consensus.cc:1685] finished
0709 13:06:27.721124 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:27.726921 (+  5797us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1557,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":33337600,"thread_start_us":148457,"threads_started":1,"wal-append.queue_time_us":290180}
I20260709 13:06:27.749871 17781 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.750420 17781 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:27.750830 17781 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.750901 16328 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:06:27.751363 16328 pending_rounds.cc:85] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 4
I20260709 13:06:27.751629 16328 pending_rounds.cc:107] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:27.751951 16328 raft_consensus.cc:2889] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.752310 16328 pending_rounds.cc:107] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:27.752568 16328 raft_consensus.cc:2889] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.754333 17936 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.754812 17936 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:27.755224 17936 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.732061 17927 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.735002 17850 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.763252 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:27.768374 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 59744us
I20260709 13:06:27.774751 16326 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.776968 17782 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.777793 17782 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.768347 17885 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.780417 17885 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:27.780756 17782 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:27.781378 17885 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.788017 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:27.789884 17802 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:27.791623 17849 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:27.794149 17760 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:27.800544 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 109400us
I20260709 13:06:27.801649 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:27.806270 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.822371 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:27.794826 17729 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.833807 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.822082 17850 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.836083 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54410.4us
I20260709 13:06:27.800902 17849 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:27.806248 17741 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:27.838968 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:27.838987 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118201us
I20260709 13:06:27.839329 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.840626 16333 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:27.826967 17729 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.828182 17956 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.851598 17885 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:27.855062 15610 connection.cc:256] RPC call timeout handler was delayed by -1.6037806109999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2509s for a response
I20260709 13:06:27.852216 17895 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.842329 17850 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.858282 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.875681 17828 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.876190 17828 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.859210 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:27.860100 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.877529 15639 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:27.877992 17960 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.860179 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.878448 17960 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:27.878839 17960 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.858978 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.860615 17937 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.860852 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.880894 15643 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:27.861191 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:27.857249 17907 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.882400 17907 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.882827 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.883977 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.884455 17907 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.884697 17741 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.885224 17741 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:27.885264 17921 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:27.885809 17741 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.858184 17927 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.862586 17895 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.886607 17900 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.887051 17900 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.886881 17927 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.887950 17900 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.888381 17895 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.888916 17927 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.889184 17900 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.858283 17739 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.858805 15796 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:27.852351 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.890196 17782 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.891110 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:27.901154 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:27.891685 17560 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.885042 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.855808 17956 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:27.905458 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:27.873001 17923 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:27.894105 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.873476 17936 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.877152 17828 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.857945 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:27.896492 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.911017 15794 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:27.850715 17814 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.942713 17814 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.943135 17814 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.944119 17483 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:27.944645 17483 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:27.885044 17907 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.850278 17729 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.903441 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.945705 17483 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:27.946832 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43508us
I20260709 13:06:27.947626 17802 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.948009 17802 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.903833 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.950101 15795 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:27.904407 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.894220 17940 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.951154 17940 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:27.903978 15788 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.857230 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:27.952008 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.951947 17940 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.912170 17899 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.912848 17681 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.953027 17940 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.953132 17681 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.912689 15787 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:27.913908 17963 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.954488 17963 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:27.954177 17681 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.902616 17560 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.954932 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.955312 17560 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.955395 17681 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.955721 15644 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.949043 17802 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.957242 17802 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.914580 16328 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:27.913482 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.914901 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.958448 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.958958 15794 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:27.959138 15646 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:27.960386 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.961133 15639 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.918663 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.868777 17850 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.920557 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.962373 15714 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:27.962297 15718 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:27.916023 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.921121 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:27.922122 17942 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.963846 17942 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:27.919358 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.923036 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:27.946851 17483 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.964877 15721 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:27.920967 16327 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.955104 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.922319 16326 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEARNER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:27.966329 15640 raft_consensus.cc:1813] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Handling vote request from an unknown peer c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.966842 15640 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:27.925390 17819 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:27.926532 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 518) took 1237 ms. Trace:
I20260709 13:06:27.970476 15644 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.970252 16331 rpcz_store.cc:276] 0709 13:06:26.688793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.688921 (+   128us) service_pool.cc:224] Handling call
0709 13:06:27.926296 (+1237375us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b5400505d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:27.926447 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676709760}
I20260709 13:06:27.910295 17923 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:27.972496 17923 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:27.973204 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.973862 17923 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.975373 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.936837 17779 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.977694 15640 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:27.954887 17963 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.979952 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.980257 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:27.980823 15640 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:27.982093 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:27.982784 15644 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.927984 17936 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:27.938822 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:27.939553 17921 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.940018 17895 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:27.940220 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:27.947554 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:27.948066 17907 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:27.952529 16325 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:27.912899 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:27.902626 17739 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.963871 15717 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.964867 17942 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.910190 17956 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.909773 17782 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:27.987728 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 129746us
I20260709 13:06:28.040252 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:28.040603 15640 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:28.041213 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:27.938431 17958 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
W20260709 13:06:27.988410 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 80817us
I20260709 13:06:28.042629 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:27.989327 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.908629 15759 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:28.043895 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 135368us
W20260709 13:06:27.997386 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.047570 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:28.049170 17621 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.049722 17621 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:28.050102 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:28.050958 15791 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:28.050714 17621 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.052754 17843 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.053503 17843 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:28.054652 17843 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:27.853528 17885 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.057617 17575 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:28.058079 17895 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.059180 15759 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:28.062271 17942 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.063872 15789 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
W20260709 13:06:28.068732 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.044873 17850 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.042121 15646 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:28.082258 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 142076us
W20260709 13:06:28.099026 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.910418 17927 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.063372 17745 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:28.116115 17852 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.116689 17745 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:27.933254 17960 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.025163 17810 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.037168 17943 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.125772 15791 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:28.127327 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.132134 17943 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.134071 17943 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.112805 17697 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:28.025676 17957 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.110869 17760 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:28.111500 17955 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.111344 17961 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.183038 17961 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:28.183483 17961 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.174502 17955 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:28.177840 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.185104 17955 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.126364 17810 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:28.185876 17810 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.064417 17921 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.182235 17960 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.184597 17915 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:28.178319 17745 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:28.206679 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 259202us
I20260709 13:06:28.213500 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.142879 17957 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:28.210171 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 142383us
W20260709 13:06:28.208163 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 167968us
I20260709 13:06:28.225729 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:28.226660 15639 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:28.227747 15647 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:28.230868 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:28.235512 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.236302 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.236796 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.237205 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.211236 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 272452us
I20260709 13:06:28.221015 15644 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:28.222683 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:28.240780 15640 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:28.240864 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:28.241645 15646 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:28.243935 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.265532 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:28.265659 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:28.267412 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.267596 15789 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:28.222708 17840 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.258312 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:28.237938 17957 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.223428 17760 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:28.297848 15541 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 246) took 11844 ms (client timeout 15000 ms). Trace:
I20260709 13:06:28.305158 17739 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.305822 15542 catalog_manager.cc:5697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:28.307857 15542 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 5, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:28.308881 17921 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.269956 17934 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:28.291795 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.295620 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:28.318396 15791 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.249568 17927 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:28.254406 17850 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:28.268656 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.309454 15542 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.223181 17915 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.254956 17899 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:06:28.323659 17782 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:28.323971 17850 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:28.325207 17781 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.574s	user 0.015s	sys 0.009s
W20260709 13:06:28.321527 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52940.1us
I20260709 13:06:28.292790 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:28.327195 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:28.341933 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 232335us
I20260709 13:06:28.331766 15542 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.304324 17760 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:28.353348 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 61600.1us
I20260709 13:06:28.303202 17959 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:28.351377 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56306.8us
I20260709 13:06:28.290243 17937 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:28.303367 17907 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:28.343688 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.365305 15542 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.367156 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:28.325723 17781 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.341888 16331 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:28.330094 17921 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.361692 17828 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.314814 17849 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:28.338129 17936 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:28.343411 17934 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.378713 16325 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:28.302852 17840 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:28.304349 15541 rpcz_store.cc:269] 0709 13:06:16.448686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.459550 (+ 10864us) service_pool.cc:224] Handling call
0709 13:06:28.293392 (+11833842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:26.755779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:26.756478 (+   699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:26.756606 (+   128us) write_op.cc:435] Acquired schema lock
0709 13:06:26.756643 (+    37us) tablet.cc:662] Decoding operations
0709 13:06:26.757382 (+   739us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:26.757470 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:26.757497 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:26.758183 (+   686us) tablet.cc:701] Row locks acquired
0709 13:06:26.758230 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:06:26.758389 (+   159us) write_op.cc:270] Start()
0709 13:06:26.758545 (+   156us) write_op.cc:276] Timestamp: P: 1783602386758328 usec, L: 0
0709 13:06:26.758604 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 13:06:26.873342 (+114738us) log.cc:844] Serialized 2049 byte log entry
0709 13:06:27.648302 (+774960us) op_driver.cc:464] REPLICATION: finished
0709 13:06:27.774396 (+126094us) write_op.cc:301] APPLY: starting
0709 13:06:27.774510 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:27.774713 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:27.774862 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:27.775848 (+   986us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:27.776138 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:27.776187 (+    49us) write_op.cc:312] APPLY: finished
0709 13:06:27.776539 (+   352us) log.cc:844] Serialized 47 byte log entry
0709 13:06:27.776742 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:27.776826 (+    84us) write_op.cc:454] Released schema lock
0709 13:06:27.776871 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:27.777308 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:27.777340 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115184,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":125751,"apply.run_cpu_time_us":2888,"apply.run_wall_time_us":2890,"num_ops":5,"prepare.queue_time_us":146402,"prepare.run_cpu_time_us":47790,"prepare.run_wall_time_us":684267,"raft.queue_time_us":312800,"raft.run_cpu_time_us":16390,"raft.run_wall_time_us":81528,"replication_time_us":889508,"thread_start_us":777969,"threads_started":4,"wal-append.queue_time_us":396657}]]}
I20260709 13:06:28.353420 17899 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:28.410753 17899 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:28.412197 17840 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.411715 17899 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.367857 15542 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.360621 17760 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.355401 17483 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:28.388078 17895 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:28.351876 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 219971us
I20260709 13:06:28.386185 17921 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.419648 17483 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.358054 17560 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.421865 15542 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.399261 17934 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.423509 16297 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:28.413415 17899 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.374095 17927 raft_consensus.cc:2764] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:28.344300 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.423482 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:28.437605 15542 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:06:28.427416 17900 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.005s
I20260709 13:06:28.399827 17885 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:28.377987 17530 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:06:28.446498 15796 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:28.447947 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 208452us
I20260709 13:06:28.390626 17963 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.454416 15542 catalog_manager.cc:5697] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.450388 15794 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:28.451960 17912 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.436790 17483 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.433400 17921 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.445050 17934 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:28.457784 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.457474 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:28.458958 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83169.7us
I20260709 13:06:28.460748 15542 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.467566 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:28.463213 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118979us
I20260709 13:06:28.473512 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.458339 17937 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:28.483471 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.455935 17681 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:28.473502 15542 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: config changed from index 4 to 5, term changed from 2 to 3, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2), VOTER c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) evicted. New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.452683 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:28.467051 17912 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.517963 16325 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:28.517982 17912 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:28.522363 17966 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:06:28.523927 17977 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:28.516166 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.526691 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.530085 15717 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:28.526479 15542 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:28.453097 17910 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:06:28.536278 15542 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:06:28.543746 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 83925.5us
W20260709 13:06:28.544456 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 175668us
I20260709 13:06:28.509102 17937 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.548508 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.550951 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:28.557281 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:28.558445 17959 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.559159 17959 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:28.563297 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.564157 17959 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.564657 17959 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:28.565582 17959 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.567122 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.515089 17802 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:28.476174 17975 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:28.515725 17900 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.535853 17960 raft_consensus.cc:2764] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:28.579267 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:06:28.581811 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 133171us
I20260709 13:06:28.541316 15542 catalog_manager.cc:5697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.534751 17575 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:28.583675 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.583781 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.533797 17681 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.571094 17937 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.584714 15542 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.682063 15791 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:28.587935 17810 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.639315 17972 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:28.578055 17975 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:28.598435 17923 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.644980 15542 catalog_manager.cc:5697] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:06:28.639699 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.695019 17971 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:06:28.673517 17741 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.787s	user 0.004s	sys 0.004s
I20260709 13:06:28.676357 17955 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.691679 17760 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.587392 17981 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.703847 17975 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.686421 17972 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:28.670308 17575 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:28.585115 17802 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:28.671029 17976 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:06:28.746205 17910 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:28.747197 17802 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:28.640501 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61344.6us
I20260709 13:06:28.726547 17741 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.748344 15762 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:28.749215 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.749567 17741 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:28.709889 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 183262us
I20260709 13:06:28.757848 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.715354 15542 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 3 to 4, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 4 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.662533 17974 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:28.670092 17852 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:28.714197 17923 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:28.733420 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.765729 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.761968 15542 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:28.741458 17575 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:28.713037 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.746222 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.749486 15643 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:28.752383 17969 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.753247 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.768119 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:28.751338 17937 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.711030 17781 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:28.660794 17978 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:06:28.598392 17915 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:28.760669 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 212266us
W20260709 13:06:28.741611 17967 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:06:28.762194 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 193964us
W20260709 13:06:28.734426 17961 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.550s	user 0.016s	sys 0.000s
I20260709 13:06:28.727236 17981 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:28.739090 17943 consensus_meta.cc:287] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.604s	user 0.003s	sys 0.010s
I20260709 13:06:28.772980 17923 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.775444 17760 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.775936 17849 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:28.788414 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 146806us
I20260709 13:06:28.791432 15721 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.791457 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.792623 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:28.776669 17956 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.004s
I20260709 13:06:28.761090 17895 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.830034 17741 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.830456 17895 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:28.830686 17741 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.831427 17895 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.832741 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.833917 17974 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.834300 17988 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.834673 17974 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:28.816617 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:28.835561 15718 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:28.839334 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.824435 17970 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:06:28.819692 17972 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.816040 17781 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:28.825615 16325 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:28.848249 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 80226.9us
I20260709 13:06:28.784142 17912 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.772117 17852 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.774947 15714 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.845306 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:28.818800 17843 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.829123 17560 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:28.845836 17942 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.783s	user 0.016s	sys 0.001s
I20260709 13:06:28.830098 17956 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.803718 17981 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.850236 15644 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.867571 17956 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.860455 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:28.863844 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 110650us
W20260709 13:06:28.847735 17779 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.869s	user 0.012s	sys 0.005s
I20260709 13:06:28.870587 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:28.871251 15714 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.872114 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.872970 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:28.873101 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:28.873829 15647 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 2: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:28.874032 16334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 405) took 1020 ms. Trace:
I20260709 13:06:28.878348 15644 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:28.873798 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.848927 17781 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.803062 17961 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.874511 16334 rpcz_store.cc:276] 0709 13:06:27.853605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.853720 (+   115us) service_pool.cc:224] Handling call
0709 13:06:27.929305 (+ 75585us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:27.929516 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.929874 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.929901 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.930337 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.318151 (+387814us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:28.646181 (+328030us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.646500 (+   319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.646604 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.865209 (+218605us) raft_consensus.cc:1685] finished
0709 13:06:28.873839 (+  8630us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.873973 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123164,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":21174,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":7668,"spinlock_wait_cycles":2778880,"thread_start_us":700289,"threads_started":2,"wal-append.queue_time_us":514866}
I20260709 13:06:28.885692 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:28.887741 15639 raft_consensus.cc:2376] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5. Re-sending same reply.
I20260709 13:06:28.890337 17912 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.891122 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:28.841724 17985 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.892730 16327 raft_consensus.cc:2368] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
W20260709 13:06:28.894265 17729 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.948s	user 0.024s	sys 0.002s
I20260709 13:06:28.895020 15719 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.895509 17961 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:28.894688 17729 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.896067 17781 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.896397 15792 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:28.896124 15718 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.897876 17779 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:28.898408 17779 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:28.904423 15611 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.888841 17895 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.914768 15719 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.914873 17530 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:28.920116 17530 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.920571 17530 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.915169 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:28.821455 17943 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.850543 17973 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:28.910589 15718 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:28.860272 17843 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.946241 15644 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:28.947330 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:28.948338 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:28.949147 15789 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.899398 17779 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:28.907410 17981 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.934474 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:28.914722 15714 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:28.870713 17849 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:28.943969 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 70260.4us
I20260709 13:06:28.930648 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:28.918507 17895 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.962481 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:28.979976 15722 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:28.982336 15762 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:28.979722 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:28.997448 15718 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.997813 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:28.998883 15713 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:28.957023 17843 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.004379 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.009717 15644 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.886874 17850 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:06:28.923830 17956 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:06:29.013024 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.006596 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:28.936882 17739 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:06:29.062925 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.064303 15719 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.064779 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.068601 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.068884 15639 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:29.016455 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:28.993561 17895 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.073402 15642 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:28.960440 17997 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:28.996040 17967 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:29.074119 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.095391 15638 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:29.096431 15645 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:06:29.096853 15645 pending_rounds.cc:85] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 4
I20260709 13:06:29.076107 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.073627 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.097548 15639 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:29.074712 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.000372 17995 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:29.077482 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.089227 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:28.881734 17975 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:28.980616 17988 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:06:29.108855 17988 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.109369 17988 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:29.109699 17975 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:29.110437 17988 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:29.111871 17934 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.002s
I20260709 13:06:29.112061 17988 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.112337 17934 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.097628 15641 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:29.065936 15647 raft_consensus.cc:2376] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4. Re-sending same reply.
I20260709 13:06:29.102149 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.097146 15645 pending_rounds.cc:107] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:29.119685 15645 raft_consensus.cc:2889] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.120065 15645 pending_rounds.cc:107] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:29.120296 15645 raft_consensus.cc:2889] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:29.090521 17957 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.773s	user 0.009s	sys 0.002s
W20260709 13:06:29.092196 17991 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:29.127028 15715 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:29.008637 17907 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:06:29.134479 17907 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:29.134934 17907 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:29.135831 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.136601 15646 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6. Re-sending same reply.
W20260709 13:06:29.139812 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.101222 17814 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.158s	user 0.002s	sys 0.015s
I20260709 13:06:29.092481 17955 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.146401 17915 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:29.147367 17915 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.147706 17915 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:29.148561 17915 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.149996 17915 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.954347 17987 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.147s
I20260709 13:06:29.114943 17995 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.113886 17937 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.116719 17970 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.159339 15722 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:06:29.211982 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1221339960000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:06:29.213208 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58985.2us
I20260709 13:06:29.213588 15715 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.214257 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:29.216015 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.220207 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.220887 15715 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.222745 15713 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:29.222997 15644 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:29.225185 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.231000 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.241798 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.244581 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.245428 15716 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.211217 17970 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.205058 17995 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.250752 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:29.261063 17899 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.808s	user 0.005s	sys 0.005s
I20260709 13:06:29.232761 17974 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.238559 17955 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.151410 17814 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.292752 15721 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:29.282616 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:29.225378 17840 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:29.218902 17781 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.258571 17970 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.281143 15715 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:29.136237 17957 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.151113 17849 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:29.298228 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 86503.5us
I20260709 13:06:29.255043 17852 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.313700 15720 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:29.304240 17921 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.000s
I20260709 13:06:29.296792 17981 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.232754 17907 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.281816 17974 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.251427 17912 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:06:29.326673 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44148.6us
I20260709 13:06:29.303494 17910 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.312680 17899 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.325340 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.353142 15715 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:29.339864 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.354210 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:29.286779 15713 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:29.344038 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:29.345547 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:29.348351 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:29.354354 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:29.317179 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 102995us
I20260709 13:06:29.373719 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:29.293850 17955 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.378046 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:29.377673 15790 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:29.372480 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:29.375207 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.375804 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:29.324658 17840 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:29.372246 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.377424 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:29.380262 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.383117 18005 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:29.379848 15795 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:29.350205 17987 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:29.392594 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.392590 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.394867 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:29.397331 15713 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.400622 17781 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.400799 17912 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.401206 17912 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:29.402318 17912 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.403823 17912 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.406746 18009 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.297513 18006 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:06:29.422910 15715 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
W20260709 13:06:29.425046 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 442770us
I20260709 13:06:29.409657 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:29.416610 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 62336.8us
I20260709 13:06:29.425915 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:29.426350 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:29.426813 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:29.427035 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2173) took 1507 ms. Trace:
I20260709 13:06:29.339762 17921 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.385602 17907 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.434933 15713 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:06:29.428808 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51461us
I20260709 13:06:29.427470 15720 rpcz_store.cc:276] 0709 13:06:27.919624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.919729 (+   105us) service_pool.cc:224] Handling call
0709 13:06:27.920018 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.320682 (+1400664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.426798 (+106116us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400096854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:29.426973 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3204694912}
I20260709 13:06:29.439258 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.394857 17927 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:29.389314 17840 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:29.432303 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.375497 17899 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.440711 15789 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:29.451737 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.576890 15717 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.462301 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.443364 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:29.517614 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.578285 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 135000us
I20260709 13:06:29.578497 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:29.578872 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.579152 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:29.507052 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.520697 15719 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:29.580725 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.558043 17987 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:29.581585 15713 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:29.582741 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.397498 17975 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 13:06:29.400645 17814 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:29.432910 17923 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:06:29.581815 15715 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.580744 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.584555 15716 raft_consensus.cc:2368] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:29.585196 15713 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.586651 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.587744 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.588845 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:29.589849 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 163560us
I20260709 13:06:29.590030 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.590689 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:29.407316 18009 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.599323 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:29.596943 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 214320us
W20260709 13:06:29.443796 18002 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:06:29.600251 15720 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:29.433784 17934 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:29.589359 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.540552 17943 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.460479 17729 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:29.562252 17915 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:29.609596 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.511219 17940 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.453508 17810 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.451967 17963 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.622244 15720 raft_consensus.cc:2376] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3. Re-sending same reply.
I20260709 13:06:29.627590 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.426636 17781 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:06:29.593938 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.604734 17981 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.455689 17973 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:29.460069 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 539) took 1033 ms. Trace:
I20260709 13:06:29.510478 17937 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:29.642511 17937 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.644901 17937 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.560101 17739 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:29.654026 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.654874 15720 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.654326 17739 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.655835 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.656409 15720 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:29.656519 17970 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.656982 17739 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.603828 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.657246 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.657896 15716 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.658701 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.450765 17697 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
I20260709 13:06:29.441694 18005 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.194s
I20260709 13:06:29.536615 17575 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:06:29.458856 17741 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.581597 17987 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:29.635565 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.602752 17923 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.641314 17681 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.641526 16327 rpcz_store.cc:276] 0709 13:06:28.426208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.429400 (+  3192us) service_pool.cc:224] Handling call
0709 13:06:29.459868 (+1030468us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54002b8ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:29.460009 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917283584}
I20260709 13:06:29.446249 17974 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.646282 18007 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:29.648241 18008 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:06:29.629027 17840 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:29.649003 18001 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.371s	user 0.000s	sys 0.002s
I20260709 13:06:29.665939 15713 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.619122 18006 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:29.630203 17530 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.002s
I20260709 13:06:29.671810 15719 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:29.628831 17915 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:06:29.721596 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 128381us
I20260709 13:06:29.682621 15717 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:29.722779 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.641390 17973 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.728413 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.728950 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.729461 15719 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:29.699290 17760 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:29.686046 18003 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:06:29.686393 17955 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.746464 16297 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:29.747547 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:29.698712 17843 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.005s
I20260709 13:06:29.714896 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.626784 17852 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:29.688694 17957 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:29.761128 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.684435 15715 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:29.763031 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.764278 15715 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:29.730737 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.753063 15713 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:29.731945 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.732227 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:29.732697 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 306840us
I20260709 13:06:29.766047 15713 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:06:29.766409 15713 pending_rounds.cc:85] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:06:29.766619 15713 pending_rounds.cc:107] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:29.766896 15713 raft_consensus.cc:2889] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.733184 18017 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.734823 15641 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:29.736290 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:29.736552 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.737998 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:29.742240 15718 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 13:06:29.774142 15718 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:29.743000 15716 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:29.713814 17969 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.000s
I20260709 13:06:29.711268 18007 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.748819 15639 raft_consensus.cc:2376] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
W20260709 13:06:29.750042 15643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1339) took 1769 ms (client timeout 1891 ms). Trace:
I20260709 13:06:29.750211 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.716632 17840 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.750558 15647 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.774741 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:29.731422 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 294217us
I20260709 13:06:29.731875 18026 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.807622 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:29.741374 17923 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.809101 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.781095 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.810503 18011 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:29.805644 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:29.812045 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.812311 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.807039 15718 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.735803 17760 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:29.812676 15638 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.748091 17975 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.815145 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:29.810571 15717 raft_consensus.cc:2376] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3. Re-sending same reply.
I20260709 13:06:29.804730 15642 raft_consensus.cc:2368] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:29.816031 15639 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:29.805723 15643 rpcz_store.cc:269] 0709 13:06:27.974914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.975057 (+   143us) service_pool.cc:224] Handling call
0709 13:06:29.744481 (+1769424us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54000a9e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:29.744646 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778146048}
I20260709 13:06:29.818405 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:29.819060 15647 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:29.727658 17530 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.808106 15716 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:29.820886 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:29.761891 17843 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:29.767622 17921 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:29.821812 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.011978 15715 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.027626 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 203) took 1099 ms. Trace:
I20260709 13:06:29.822613 15718 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:30.964190 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 312) took 1985 ms (client timeout 1957 ms). Trace:
I20260709 13:06:31.014865 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2196) took 1687 ms. Trace:
I20260709 13:06:29.811743 18017 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.015265 15716 rpcz_store.cc:276] 0709 13:06:29.327931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.807656 (+479725us) service_pool.cc:224] Handling call
0709 13:06:29.807927 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.014578 (+1206651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.014805 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.814888 17975 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:31.016111 15722 rpcz_store.cc:269] 0709 13:06:28.978866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.982665 (+  3799us) service_pool.cc:224] Handling call
0709 13:06:30.963836 (+1981171us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54001a7cd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:30.964081 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219292416}
I20260709 13:06:29.809445 18007 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.830075 15720 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:29.942152 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 290) took 1007 ms. Trace:
I20260709 13:06:31.018420 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1692) took 1282 ms. Trace:
I20260709 13:06:30.098701 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:31.016377 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 1.21069e+06us
I20260709 13:06:31.020304 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 320) took 1417 ms. Trace:
I20260709 13:06:29.824524 15638 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
W20260709 13:06:30.382998 15794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.004s
I20260709 13:06:31.019104 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1244) took 1411 ms. Trace:
I20260709 13:06:31.021441 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1353) took 1252 ms. Trace:
I20260709 13:06:31.020522 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:29.843997 15719 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:29.992619 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.022929 15719 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:29.864697 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.024976 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1693) took 1288 ms. Trace:
I20260709 13:06:30.819633 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.025439 15642 rpcz_store.cc:276] 0709 13:06:29.736301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.816756 (+ 80455us) service_pool.cc:224] Handling call
0709 13:06:31.024883 (+1208127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.025969 15639 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:31.011705 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 1.27532e+06us
I20260709 13:06:31.028103 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:31.021684 15794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.012s	sys 0.015s
I20260709 13:06:31.021956 15717 rpcz_store.cc:276] 0709 13:06:29.607393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.762369 (+154976us) service_pool.cc:224] Handling call
0709 13:06:31.019033 (+1256664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.022297 15638 rpcz_store.cc:276] 0709 13:06:29.768909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.811813 (+ 42904us) service_pool.cc:224] Handling call
0709 13:06:31.021380 (+1209567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.019783 15793 rpcz_store.cc:276] 0709 13:06:28.934971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.935234 (+   263us) service_pool.cc:224] Handling call
0709 13:06:28.935576 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.943311 (+  7735us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:28.963105 (+ 19794us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.963314 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.963361 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:28.963438 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.454303 (+490865us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b1800371920. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:06:29.941724 (+487421us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b54004218d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:29.941825 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.942061 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35273,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":368,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":199,"spinlock_wait_cycles":54708864}
I20260709 13:06:31.018859 15646 rpcz_store.cc:276] 0709 13:06:29.735980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.821483 (+ 85503us) service_pool.cc:224] Handling call
0709 13:06:31.018353 (+1196870us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:30.255255 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.809064 17969 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:31.021036 15718 rpcz_store.cc:276] 0709 13:06:29.602623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.817773 (+215150us) service_pool.cc:224] Handling call
0709 13:06:29.822355 (+  4582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.020068 (+1197713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.020251 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.039204 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.039335 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.039980 15646 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.040098 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1695) took 1303 ms. Trace:
I20260709 13:06:31.040490 15638 rpcz_store.cc:276] 0709 13:06:29.736841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.038928 (+1302087us) service_pool.cc:224] Handling call
0709 13:06:31.040030 (+  1102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.041608 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.041886 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:31.043056 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1696) took 1305 ms. Trace:
I20260709 13:06:31.043746 15638 rpcz_store.cc:276] 0709 13:06:29.737162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.041316 (+1304154us) service_pool.cc:224] Handling call
0709 13:06:31.042979 (+  1663us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:30.954650 17997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.797s	user 0.008s	sys 0.007s
I20260709 13:06:31.044852 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.052361 15638 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.018873 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1240) took 1645 ms. Trace:
I20260709 13:06:31.017316 18017 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:30.097505 17729 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.034319 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 648048us
I20260709 13:06:31.066498 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.035609 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2027) took 1675 ms. Trace:
I20260709 13:06:31.017490 17975 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:31.051916 17997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.913s	user 0.008s	sys 0.008s
W20260709 13:06:31.036689 15795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.008s	sys 0.021s
W20260709 13:06:31.081478 15795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.008s	sys 0.021s
W20260709 13:06:30.331892 16297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.004s	sys 0.000s
W20260709 13:06:30.039697 17483 consensus_meta.cc:287] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.564s	user 0.010s	sys 0.004s
W20260709 13:06:30.252120 17910 consensus_meta.cc:287] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.897s	user 0.009s	sys 0.000s
W20260709 13:06:31.031734 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.275040 17988 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.162s	user 0.009s	sys 0.006s
I20260709 13:06:31.154613 17483 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:31.155369 17999 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 2.018s	user 0.007s	sys 0.000s
I20260709 13:06:31.158370 15644 raft_consensus.cc:2368] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:06:31.158618 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.159416 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1350) took 1391 ms. Trace:
I20260709 13:06:31.159722 15647 rpcz_store.cc:276] 0709 13:06:29.767973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.158332 (+1390359us) service_pool.cc:224] Handling call
0709 13:06:31.159359 (+  1027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:30.195947 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2186) took 1320 ms. Trace:
I20260709 13:06:31.056339 15788 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:31.055482 15720 rpcz_store.cc:276] 0709 13:06:29.373685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.810263 (+436578us) service_pool.cc:224] Handling call
0709 13:06:29.829557 (+ 19294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.018607 (+1189050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.018813 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:30.195098 15792 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2014) took 2298 ms (client timeout 2983 ms). Trace:
I20260709 13:06:31.160391 15721 rpcz_store.cc:276] 0709 13:06:28.875356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.875523 (+   167us) service_pool.cc:224] Handling call
0709 13:06:30.195729 (+1320206us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540003dc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:30.195871 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850951552}
I20260709 13:06:31.055510 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.161947 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1706) took 1067 ms. Trace:
I20260709 13:06:31.162266 15642 rpcz_store.cc:276] 0709 13:06:30.094815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.036602 (+941787us) service_pool.cc:224] Handling call
0709 13:06:31.161892 (+125290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.163095 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.057303 15714 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.039023 17970 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:30.965401 17987 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.164023 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2200) took 1539 ms. Trace:
I20260709 13:06:31.164178 17987 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.164436 15714 rpcz_store.cc:276] 0709 13:06:29.624868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.034385 (+1409517us) service_pool.cc:224] Handling call
0709 13:06:31.057080 (+ 22695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.163771 (+106691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.163965 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.164779 17987 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:31.161158 15792 rpcz_store.cc:269] 0709 13:06:27.896860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.919128 (+ 22268us) service_pool.cc:224] Handling call
0709 13:06:30.194768 (+2275640us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b540047d1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:30.195012 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142665600}
W20260709 13:06:31.165802 15644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1685) took 1435 ms (client timeout 1601 ms). Trace:
I20260709 13:06:30.136264 18021 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.160580 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.167274 18021 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:30.197757 18009 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.170217 18009 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:31.170473 18027 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.030s	user 0.001s	sys 0.000s
I20260709 13:06:31.170758 18009 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:31.172206 17995 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.876s	user 0.013s	sys 0.000s
W20260709 13:06:31.172619 18012 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.829s	user 0.003s	sys 0.000s
I20260709 13:06:31.172992 18009 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:31.172736 17995 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:30.050618 17781 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.174037 17781 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.174868 15787 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:31.176563 17781 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:30.573848 17885 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.176972 15787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2021) took 1836 ms (client timeout 2168 ms). Trace:
W20260709 13:06:31.063604 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.901005 17923 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.873227 17899 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.067826 15638 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:30.000628 17852 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:31.179997 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1362) took 1407 ms. Trace:
I20260709 13:06:31.180577 17985 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.181082 17985 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:31.181986 17899 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:31.182166 17985 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.182721 17899 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.183537 17985 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.186574 17852 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.180374 15638 rpcz_store.cc:276] 0709 13:06:29.772204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.044615 (+1272411us) service_pool.cc:224] Handling call
0709 13:06:31.179922 (+135307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.188090 17923 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:31.189239 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.190945 17923 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.177582 17885 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.194761 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:31.196650 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:31.197031 15788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2022) took 1852 ms (client timeout 1651 ms). Trace:
I20260709 13:06:31.068498 15789 rpcz_store.cc:276] 0709 13:06:29.345989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.576915 (+230926us) service_pool.cc:224] Handling call
0709 13:06:29.577253 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.577808 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.577839 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.601084 (+ 23245us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.758427 (+157343us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:29.758469 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.758542 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.020857 (+1262315us) raft_consensus.cc:1685] finished
0709 13:06:31.020880 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.021034 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28255,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5437,"thread_start_us":111084,"threads_started":1,"wal-append.queue_time_us":132113}
I20260709 13:06:31.173556 18009 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:31.197975 15642 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.198792 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.209868 15641 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.078256 17729 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.216499 17782 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.217290 17782 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.200640 18014 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:31.218240 18014 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:31.219507 17782 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:31.219156 18014 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.220536 18014 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:31.197561 15788 rpcz_store.cc:269] 0709 13:06:29.344491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.355131 (+ 10640us) service_pool.cc:224] Handling call
0709 13:06:31.196804 (+1841673us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540021b6d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.196949 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3856736512}
I20260709 13:06:31.223313 15643 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:31.223901 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.224206 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1697) took 1484 ms. Trace:
I20260709 13:06:31.224725 15643 rpcz_store.cc:276] 0709 13:06:29.739388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.222636 (+1483248us) service_pool.cc:224] Handling call
0709 13:06:31.223085 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.223885 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.224135 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.201450 17980 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.227298 17980 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.234355 17980 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.239588 15719 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.241080 15719 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:31.194841 17978 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:31.242755 17978 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } }
W20260709 13:06:31.177642 15787 rpcz_store.cc:269] 0709 13:06:29.340741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.345252 (+  4511us) service_pool.cc:224] Handling call
0709 13:06:31.176701 (+1831449us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400136fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.176891 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4142954752}
I20260709 13:06:31.247141 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:31.166388 15644 rpcz_store.cc:269] 0709 13:06:29.730399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.730517 (+   118us) service_pool.cc:224] Handling call
0709 13:06:31.165546 (+1435029us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400344c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.165708 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3203642112}
I20260709 13:06:31.225353 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.258314 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1791) took 1165 ms. Trace:
I20260709 13:06:31.012833 15640 rpcz_store.cc:276] 0709 13:06:28.843950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.844202 (+   252us) service_pool.cc:224] Handling call
0709 13:06:28.860156 (+ 15954us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.882445 (+ 22289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.882474 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.882948 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.138252 (+255304us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:29.138297 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.138368 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.942562 (+804194us) raft_consensus.cc:1685] finished
0709 13:06:29.942594 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.942777 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22607,"raft.queue_time_us":24884,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":23369,"thread_start_us":170661,"threads_started":1,"wal-append.queue_time_us":304665}
I20260709 13:06:31.078456 15715 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:31.259449 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2203) took 1559 ms. Trace:
I20260709 13:06:31.040225 17921 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:31.044906 16299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.011s	sys 0.010s
I20260709 13:06:31.084373 15646 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.044484 18020 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:31.044557 18004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.008s
I20260709 13:06:31.056900 17621 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.828357 18026 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.079285 18017 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:31.103193 15716 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:31.083487 17969 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:31.106997 18022 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:06:30.003685 17760 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.114846 17530 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:31.118513 17895 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 2.022s	user 0.013s	sys 0.000s
I20260709 13:06:29.871245 17915 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:31.131294 17907 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.694s	user 0.005s	sys 0.006s
I20260709 13:06:31.102821 17975 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.262888 17978 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:31.137188 16297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.007s	sys 0.007s
W20260709 13:06:31.345284 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.59874e+06us
I20260709 13:06:31.138619 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.348327 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1790) took 1256 ms. Trace:
I20260709 13:06:31.348796 15793 rpcz_store.cc:276] 0709 13:06:30.092297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.104246 (+1011949us) service_pool.cc:224] Handling call
0709 13:06:31.348270 (+244024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.350033 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.351472 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.352114 15793 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.355219 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:31.356168 16327 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:31.154484 17910 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:31.166620 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.358246 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1789) took 1266 ms. Trace:
I20260709 13:06:31.358747 15792 rpcz_store.cc:276] 0709 13:06:30.091973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.166344 (+1074371us) service_pool.cc:224] Handling call
0709 13:06:31.358174 (+191830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.359912 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.360627 15792 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.167744 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1351) took 1399 ms. Trace:
I20260709 13:06:31.064399 15713 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:31.035681 15685 connection.cc:256] RPC call timeout handler was delayed by -1.0874457529999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:06:31.214694 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.188156 15638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
W20260709 13:06:31.216399 17973 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.471s	user 0.011s	sys 0.000s
I20260709 13:06:31.258358 15642 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.075243 15639 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:31.203896 17987 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:31.260118 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1698) took 1520 ms (client timeout 1700 ms). Trace:
I20260709 13:06:31.278292 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1691) took 1542 ms. Trace:
I20260709 13:06:31.259616 15788 rpcz_store.cc:276] 0709 13:06:30.092651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.225088 (+1132437us) service_pool.cc:224] Handling call
0709 13:06:31.258233 (+ 33145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.259949 15715 rpcz_store.cc:276] 0709 13:06:29.699628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.772858 (+ 73230us) service_pool.cc:224] Handling call
0709 13:06:31.259389 (+1486531us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.286378 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.304239 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1349) took 1536 ms. Trace:
W20260709 13:06:31.280133 16299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.011s	sys 0.014s
I20260709 13:06:31.204963 17885 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.205530 17899 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.252235 17843 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:31.157721 17483 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.203495 18021 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.259663 17923 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.197716 17985 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.344527 17895 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.315199 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1248) took 1675 ms. Trace:
W20260709 13:06:31.310607 18004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.000s	sys 0.009s
I20260709 13:06:31.279902 17782 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:31.281468 17988 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.249683 17995 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:31.084687 17997 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:31.365711 15639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1359) took 1594 ms (client timeout 1954 ms). Trace:
I20260709 13:06:31.366199 15646 rpcz_store.cc:276] 0709 13:06:29.735704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.039128 (+1303424us) service_pool.cc:224] Handling call
0709 13:06:31.278226 (+239098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.397621 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:31.366859 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.367175 15643 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:31.367702 15640 rpcz_store.cc:276] 0709 13:06:29.767612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.259511 (+1491899us) service_pool.cc:224] Handling call
0709 13:06:31.303544 (+ 44033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.303791 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.303827 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.303882 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.303945 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.304017 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.304163 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.366031 15641 rpcz_store.cc:269] 0709 13:06:29.739658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.774480 (+ 34822us) service_pool.cc:224] Handling call
0709 13:06:31.259941 (+1485461us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540019c154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.260056 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3106545920}
I20260709 13:06:31.344048 15645 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:31.361905 15647 rpcz_store.cc:276] 0709 13:06:29.768278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.160340 (+1392062us) service_pool.cc:224] Handling call
0709 13:06:31.167684 (+  7344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.362402 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1247) took 1754 ms. Trace:
I20260709 13:06:31.508415 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:31.362601 15685 connection.cc:256] RPC call timeout handler was delayed by -1.0739457530000891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 13:06:31.364152 15638 raft_consensus.cc:606] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:31.510170 15638 raft_consensus.cc:614] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:31.368149 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.305261 17921 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:31.479352 15719 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:31.532984 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1230) took 2302 ms. Trace:
I20260709 13:06:31.486021 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1700) took 1745 ms. Trace:
I20260709 13:06:31.534178 15643 rpcz_store.cc:276] 0709 13:06:29.740148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.253344 (+1513196us) service_pool.cc:224] Handling call
0709 13:06:31.366868 (+113524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.403262 (+ 36394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.485704 (+ 82442us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b5400346050. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.485936 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193640320}
W20260709 13:06:31.395725 15639 rpcz_store.cc:269] 0709 13:06:29.771416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.060544 (+289128us) service_pool.cc:224] Handling call
0709 13:06:31.365656 (+1305112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.392642 17910 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.361728 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.547345 15792 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:31.505036 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.382742 17729 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:31.511871 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.365458 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1703) took 1550 ms. Trace:
I20260709 13:06:31.553936 15642 rpcz_store.cc:276] 0709 13:06:29.815513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.162859 (+1347346us) service_pool.cc:224] Handling call
0709 13:06:31.365253 (+202394us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54000e8dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.365379 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78882688}
I20260709 13:06:31.508677 15713 rpcz_store.cc:276] 0709 13:06:29.608115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.034788 (+1426673us) service_pool.cc:224] Handling call
0709 13:06:31.064094 (+ 29306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.362055 (+297961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.362332 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.315681 18020 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.514798 15646 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:31.558642 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.389369 15716 rpcz_store.cc:276] 0709 13:06:29.640271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.102482 (+1462211us) service_pool.cc:224] Handling call
0709 13:06:31.102935 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.314818 (+211883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.315118 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.561512 15642 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:31.562448 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1352) took 1793 ms. Trace:
I20260709 13:06:31.562839 15642 rpcz_store.cc:276] 0709 13:06:29.768605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.560783 (+1792178us) service_pool.cc:224] Handling call
0709 13:06:31.561206 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.562098 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.562363 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.565774 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:31.480626 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 1.38186e+06us
I20260709 13:06:31.535995 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.387281 15790 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:31.536777 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.577598 15640 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.533399 15719 rpcz_store.cc:276] 0709 13:06:29.230405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.773527 (+543122us) service_pool.cc:224] Handling call
0709 13:06:29.843837 (+ 70310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.239063 (+1395226us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b4c00481080. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad236d2a20 00007fad236e3a29 00007fad236a9644 00007fad236d0f2d 00007fad236d0b93 00007fad2540118b 00007fad25401cb5 00007fad253fcf30 00007fad253fe7de 00007fad25408b49 00007fad25409416
0709 13:06:31.532706 (+293643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.532927 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45141248}
I20260709 13:06:31.538861 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:31.539978 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.579063 15643 raft_consensus.cc:2376] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:31.540267 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.580228 15638 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:31.540966 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:31.582118 15647 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:31.583881 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1704) took 1718 ms. Trace:
I20260709 13:06:31.584335 15647 rpcz_store.cc:276] 0709 13:06:29.865204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.582895 (+1717691us) service_pool.cc:224] Handling call
0709 13:06:31.583255 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.583492 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.583528 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.583582 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.583629 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.583698 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.583819 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.406773 18011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.462s	user 0.018s	sys 0.057s
I20260709 13:06:31.545126 17921 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:31.607352 18011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.667s	user 0.018s	sys 0.058s
I20260709 13:06:31.607764 18011 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:31.609926 17530 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.366456 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:31.369366 18017 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.610649 17530 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.611436 18017 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.368386 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.614243 15787 raft_consensus.cc:2368] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:31.615249 16330 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:31.343550 17760 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.615693 18020 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.386721 17895 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:31.383551 18026 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.586476 15646 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:31.597425 15642 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:06:31.618752 15645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1687) took 1886 ms (client timeout 1512 ms). Trace:
I20260709 13:06:31.629217 16333 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:31.623184 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2026) took 2277 ms. Trace:
I20260709 13:06:31.630210 15647 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.629303 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1355) took 1859 ms. Trace:
I20260709 13:06:31.630904 15642 rpcz_store.cc:276] 0709 13:06:29.770237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.563761 (+1793524us) service_pool.cc:224] Handling call
0709 13:06:31.597000 (+ 33239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.629033 (+ 32033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.629248 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.629688 18017 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.632287 15642 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:31.632861 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1707) took 1474 ms. Trace:
I20260709 13:06:31.633145 15642 rpcz_store.cc:276] 0709 13:06:30.158446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.631836 (+1473390us) service_pool.cc:224] Handling call
0709 13:06:31.632134 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.632648 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.632810 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.624132 17985 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.634420 17985 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.629914 15796 rpcz_store.cc:276] 0709 13:06:29.345695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.437211 (+ 91516us) service_pool.cc:224] Handling call
0709 13:06:29.558604 (+121393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.558970 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.558998 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.584110 (+ 25112us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.714155 (+130045us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:29.714213 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.714319 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.622964 (+1908645us) raft_consensus.cc:1685] finished
0709 13:06:31.622984 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.623122 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5474,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6519,"thread_start_us":90158,"threads_started":1,"wal-append.queue_time_us":300838}
I20260709 13:06:31.635756 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.636721 17985 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:31.629532 15645 rpcz_store.cc:269] 0709 13:06:29.731833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.731956 (+   123us) service_pool.cc:224] Handling call
0709 13:06:31.618518 (+1886562us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000aa354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.618668 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3628666240}
I20260709 13:06:31.369628 17923 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.480599 17988 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.642880 15639 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:31.648916 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1356) took 1878 ms. Trace:
I20260709 13:06:31.649379 15639 rpcz_store.cc:276] 0709 13:06:29.770472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.576919 (+1806447us) service_pool.cc:224] Handling call
0709 13:06:31.642437 (+ 65518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.648571 (+  6134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.648844 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.480302 17782 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.626041 15638 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.654033 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1363) took 1881 ms. Trace:
I20260709 13:06:31.654493 15638 rpcz_store.cc:276] 0709 13:06:29.772434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.581012 (+1808578us) service_pool.cc:224] Handling call
0709 13:06:31.581396 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.653645 (+ 72249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.653962 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.658463 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.659540 15792 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:31.660032 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1801) took 1029 ms. Trace:
I20260709 13:06:31.660413 15792 rpcz_store.cc:276] 0709 13:06:30.630456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.625362 (+994906us) service_pool.cc:224] Handling call
0709 13:06:31.659957 (+ 34595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.608973 18011 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.669485 15641 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:31.676813 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.556591 17910 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.550683 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:31.663463 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:31.364492 17973 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:31.677956 15788 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:31.687395 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:31.688156 15788 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:31.672578 17840 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.862s	user 0.013s	sys 0.000s
I20260709 13:06:31.613454 17530 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:31.671705 18034 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.328s	user 0.002s	sys 0.000s
I20260709 13:06:31.700371 16326 raft_consensus.cc:2410] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:31.692710 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:31.646616 15646 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:31.709710 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1354) took 1939 ms. Trace:
W20260709 13:06:31.623521 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.710383 15646 rpcz_store.cc:276] 0709 13:06:29.769971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.578557 (+1808586us) service_pool.cc:224] Handling call
0709 13:06:31.586335 (+  7778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.709366 (+123031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.709636 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.711611 15611 connection.cc:256] RPC call timeout handler was delayed by -1.112783090999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:06:31.715117 17530 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.715970 17530 consensus_queue.cc:1243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:31.716612 17985 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.717000 17985 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:31.717860 17985 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.694568 16328 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.698138 18009 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.666772 17997 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.724166 15793 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
W20260709 13:06:31.708282 18007 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.003s
I20260709 13:06:31.726812 18007 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:31.729319 16300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.014s	sys 0.033s
W20260709 13:06:31.729950 16300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.033s
W20260709 13:06:31.731142 15760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.007s	sys 0.040s
W20260709 13:06:31.731746 15760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.040s
W20260709 13:06:31.732698 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 690821us
I20260709 13:06:31.732873 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1798) took 1259 ms. Trace:
I20260709 13:06:31.733812 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:31.733927 15793 rpcz_store.cc:276] 0709 13:06:30.473398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.351161 (+877763us) service_pool.cc:224] Handling call
0709 13:06:31.732813 (+381652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.732728 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:31.729841 18007 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:31.737710 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:31.739679 15794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.021s	sys 0.038s
W20260709 13:06:31.732021 15686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.028s	sys 0.056s
W20260709 13:06:31.739636 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.745036 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:31.746336 15790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2034) took 2398 ms (client timeout 2476 ms). Trace:
I20260709 13:06:31.739058 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:31.750099 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.751652 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 731126us
W20260709 13:06:31.752611 15612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.001s	sys 0.031s
W20260709 13:06:31.752786 15686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.028s	sys 0.056s
W20260709 13:06:31.753145 15612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.001s	sys 0.031s
W20260709 13:06:31.753387 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.753847 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.754545 15795 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.008s	sys 0.024s
W20260709 13:06:31.755196 15795 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.008s	sys 0.024s
W20260709 13:06:31.746832 15790 rpcz_store.cc:269] 0709 13:06:29.347939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.386325 (+ 38386us) service_pool.cc:224] Handling call
0709 13:06:31.746167 (+2359842us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b540047c2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:31.746286 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4574666112}
I20260709 13:06:31.741676 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 291) took 1994 ms. Trace:
I20260709 13:06:31.757400 15793 rpcz_store.cc:276] 0709 13:06:29.746889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.740598 (+1993709us) service_pool.cc:224] Handling call
0709 13:06:31.741057 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.741276 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.741310 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.741364 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.741407 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.741473 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.741607 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.740180 15794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.021s	sys 0.038s
W20260709 13:06:31.760979 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.759423 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2033) took 2411 ms. Trace:
I20260709 13:06:31.761773 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:31.762648 16334 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:31.761014 15613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.030s	sys 0.039s
W20260709 13:06:31.763468 15613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.030s	sys 0.039s
I20260709 13:06:31.765408 15793 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:31.765981 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:31.766356 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1793) took 1673 ms. Trace:
I20260709 13:06:31.767656 15793 rpcz_store.cc:276] 0709 13:06:30.093204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.764509 (+1671305us) service_pool.cc:224] Handling call
0709 13:06:31.764911 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.766131 (+  1220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.766306 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.739090 17895 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:31.769364 15790 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.772171 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2030) took 2425 ms. Trace:
I20260709 13:06:31.772605 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1788) took 1681 ms. Trace:
I20260709 13:06:31.773051 15790 rpcz_store.cc:276] 0709 13:06:30.091614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.765197 (+1673583us) service_pool.cc:224] Handling call
0709 13:06:31.769125 (+  3928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.772378 (+  3253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.772557 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.774698 15791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.032s	sys 0.034s
I20260709 13:06:31.747012 17483 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:31.769562 15793 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.741956 18021 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:31.775302 15791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.033s	sys 0.035s
I20260709 13:06:31.781834 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1795) took 1688 ms. Trace:
I20260709 13:06:31.750911 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:31.784235 15793 rpcz_store.cc:276] 0709 13:06:30.095374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.769002 (+1673628us) service_pool.cc:224] Handling call
0709 13:06:31.769336 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.781365 (+ 12029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.781776 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.785578 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:31.762192 15794 rpcz_store.cc:276] 0709 13:06:29.347679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.817898 (+470219us) service_pool.cc:224] Handling call
0709 13:06:29.818161 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.818344 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:29.867472 (+ 49128us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.758965 (+1891493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.759043 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:31.759115 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.759205 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.759363 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12503,"prepare.queue_time_us":49450,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":4169,"raft.queue_time_us":50281,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":14915,"thread_start_us":1878465,"threads_started":2,"wal-append.queue_time_us":1635865}
I20260709 13:06:31.785781 15793 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.787390 15793 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:31.782048 15687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.007s	sys 0.025s
W20260709 13:06:31.789549 15687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.008s	sys 0.025s
I20260709 13:06:31.760352 17899 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.760150 17978 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.853946 15790 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:31.853899 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 480982us
W20260709 13:06:31.854525 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65459.6us
I20260709 13:06:31.759822 18020 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:31.856204 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.854596 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69095.9us
I20260709 13:06:31.732836 18009 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:31.860477 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 84031.5us
I20260709 13:06:31.861286 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:06:31.861856 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 109338us
I20260709 13:06:31.863375 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:31.784343 17852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.001s	sys 0.014s
I20260709 13:06:31.772560 15795 rpcz_store.cc:276] 0709 13:06:29.346842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.659208 (+312366us) service_pool.cc:224] Handling call
0709 13:06:29.659491 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.738806 (+ 79315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.738837 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.762480 (+ 23643us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.088551 (+1326071us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:31.771239 (+682688us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.771814 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.771890 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.771974 (+    84us) raft_consensus.cc:1685] finished
0709 13:06:31.771990 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.772117 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251946,"raft.queue_time_us":85173,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":14625,"thread_start_us":1918369,"threads_started":2,"wal-append.queue_time_us":1758972}
I20260709 13:06:31.782723 17483 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:31.885076 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:31.878648 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:31.865398 17729 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.890676 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:31.880756 16334 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:31.865669 18033 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:31.865553 17927 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.864931 17907 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.871773 17852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.001s	sys 0.015s
I20260709 13:06:31.867522 18035 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.894614 18020 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.865583 18017 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:06:31.873102 17988 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.893864 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:31.908540 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:31.883848 17923 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.890630 17483 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:31.897970 17895 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.917922 17782 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.918165 18039 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:31.898197 18007 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:06:31.918504 17910 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.918968 18020 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:31.920804 18035 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.921651 17973 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.924779 18017 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:31.925241 18033 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:31.913578 17987 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:31.867292 17899 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.926599 18044 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.000082 18044 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.003005 18044 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.005788 17899 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.006489 17899 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.997620 17987 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.006940 18033 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.009495 17987 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:31.926842 17969 consensus_meta.cc:287] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.000s
I20260709 13:06:32.010447 17969 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:31.987555 18039 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:32.011552 15796 raft_consensus.cc:2410] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:31.870025 17978 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.012374 18035 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.012310 18039 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.991384 18017 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:32.013720 17978 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:31.889680 18038 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.003613 18044 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:32.015513 18044 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.018602 18044 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.900236 17840 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:32.019194 17840 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:32.019585 17840 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:32.020795 15790 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:31.925534 17980 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.001s
I20260709 13:06:32.022040 17980 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.024652 17980 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:31.905640 18036 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.929683 18014 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.709s	user 0.004s	sys 0.003s
I20260709 13:06:31.948280 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:31.954191 15688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.029s	sys 0.039s
W20260709 13:06:32.034826 15688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.029s	sys 0.039s
W20260709 13:06:32.035845 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.935094 17621 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.611s	user 0.004s	sys 0.004s
W20260709 13:06:31.976068 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.942236 18026 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.942584 18037 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:31.990329 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 125025us
I20260709 13:06:31.980216 17985 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.912122 17907 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.014907 18017 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.017797 18020 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:31.912276 17927 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:31.940397 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.941286 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 47656.6us
I20260709 13:06:32.108214 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:32.108985 15795 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:31.945169 17852 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:06:32.107604 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:32.112906 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:32.062017 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:32.114084 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52197.3us
I20260709 13:06:32.115115 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:32.025511 18036 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.100397 15788 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:32.101605 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1702) took 2336 ms. Trace:
I20260709 13:06:32.075626 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2032) took 2728 ms. Trace:
I20260709 13:06:32.109932 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.116039 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1802) took 1485 ms. Trace:
I20260709 13:06:32.116674 15788 rpcz_store.cc:276] 0709 13:06:30.630787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.687113 (+1056326us) service_pool.cc:224] Handling call
0709 13:06:32.115980 (+428867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.117808 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:32.102135 17915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.012s	sys 0.020s
I20260709 13:06:32.111497 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.122212 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.122555 15790 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:32.118645 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.123376 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:32.123782 15793 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:32.061003 17621 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:32.058648 18026 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:32.123441 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:32.116032 15791 rpcz_store.cc:276] 0709 13:06:29.347419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.814991 (+467572us) service_pool.cc:224] Handling call
0709 13:06:29.866260 (+ 51269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.100782 (+234522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.100827 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.026956 (+926129us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.783350 (+756394us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:32.046419 (+263069us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.075154 (+ 28735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.075269 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.075331 (+    62us) raft_consensus.cc:1685] finished
0709 13:06:32.075348 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.075542 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233934,"prepare.queue_time_us":213621,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":11270,"raft.queue_time_us":278144,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":44074,"spinlock_wait_cycles":14131456,"thread_start_us":857836,"threads_started":2,"wal-append.queue_time_us":933549}
I20260709 13:06:32.126660 15790 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.006964 17899 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.129686 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:32.122130 17915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.012s	sys 0.021s
I20260709 13:06:32.131086 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:32.089987 18025 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:32.102988 17980 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.132957 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.045235 18038 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:06:32.134840 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:32.189499 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.150141 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:32.184450 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.190167 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.188045 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:32.191382 15791 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:32.118059 17975 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:32.186403 15643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.006s
I20260709 13:06:32.190137 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 292) took 2443 ms. Trace:
I20260709 13:06:32.196472 15792 rpcz_store.cc:276] 0709 13:06:29.747165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.746020 (+1998855us) service_pool.cc:224] Handling call
0709 13:06:31.746336 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.867602 (+121266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.867646 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.867705 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.867749 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.189918 (+322169us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54004227d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:32.189960 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.190088 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278312832}
I20260709 13:06:32.197718 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:32.198254 15643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.007s	sys 0.007s
I20260709 13:06:32.130650 18026 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.201280 15789 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
W20260709 13:06:32.202242 15685 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.017s	sys 0.044s
I20260709 13:06:32.202718 15646 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:32.198387 15719 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.204056 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.207273 15716 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:32.207993 15685 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.019s	sys 0.044s
W20260709 13:06:32.208359 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 654886us
I20260709 13:06:32.133903 17910 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:32.215895 15646 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.131172 18017 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.210222 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:32.210418 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.211236 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1794) took 2117 ms. Trace:
I20260709 13:06:32.205319 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.131771 18011 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:32.213531 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:32.216569 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.186005 18057 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.133354 17697 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
W20260709 13:06:32.194446 18047 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:32.497927 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.519954 15720 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:32.521884 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.498725 15715 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:32.499112 15641 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:32.499624 15760 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.226s (SENT)
I20260709 13:06:32.231765 15716 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
W20260709 13:06:32.474804 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.246908 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.525898 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.496542 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.527240 15722 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:32.131990 18060 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:32.218026 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.286646 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.531610 15714 raft_consensus.cc:2410] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:32.231683 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.501698 15718 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:32.499511 15796 rpcz_store.cc:276] 0709 13:06:30.093495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.635505 (+1542010us) service_pool.cc:224] Handling call
0709 13:06:32.206534 (+571029us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400152a54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:32.211176 (+  4642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862372608}
I20260709 13:06:32.535154 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:32.195444 17980 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.542608 17980 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.392923 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:32.293020 15717 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:32.287853 18042 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.509665 15638 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.274662 15795 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:32.293548 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.511211 15719 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:32.132205 17987 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:32.201864 18044 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.517100 15793 raft_consensus.cc:2410] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:32.528889 15641 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:32.501320 18011 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.392781 18037 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.231016 18045 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.535215 18057 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.231238 17921 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.193939 18021 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:32.624761 17985 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:06:32.625162 18021 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.625978 18071 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:32.564807 17852 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:32.626536 18071 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.564306 17969 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:32.629262 15790 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:32.210794 17923 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.553203 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 429878us
I20260709 13:06:32.632920 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:32.503041 15688 connection.cc:256] RPC call timeout handler was delayed by -1.9324936879999086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 13:06:32.214251 18031 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:32.564580 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:32.633832 15688 connection.cc:256] RPC call timeout handler was delayed by -1.9261936879998984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:06:32.634195 15688 connection.cc:256] RPC call timeout handler was delayed by -1.90639368799998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:06:32.394694 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:32.601858 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:32.605473 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:32.610342 18046 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.418s	user 0.000s	sys 0.000s
I20260709 13:06:32.610146 17621 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:32.603729 18011 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.611259 18064 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:06:32.619500 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.622267 15721 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:32.623446 18057 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.623900 17921 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.559203 18060 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:32.634371 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.634526 15688 connection.cc:256] RPC call timeout handler was delayed by -1.9045936879999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 13:06:32.639657 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:32.610992 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 505) took 1263 ms. Trace:
W20260709 13:06:32.625670 16325 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.725s	user 0.006s	sys 0.002s
W20260709 13:06:32.650681 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 101562us
I20260709 13:06:32.607453 18069 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.608387 18044 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.608641 17987 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:32.658937 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.663059 15638 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:32.662444 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:32.667836 15688 connection.cc:256] RPC call timeout handler was delayed by -1.8523936879998928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:06:32.675961 15688 connection.cc:256] RPC call timeout handler was delayed by -1.7632936879999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 13:06:32.676365 15688 connection.cc:256] RPC call timeout handler was delayed by -1.7281936879999193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:06:32.676815 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6615936879999254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:06:32.677428 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6408936879998919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:06:32.647331 17907 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.667299 17910 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:32.659721 18072 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:32.677927 15688 connection.cc:256] RPC call timeout handler was delayed by -1.5769936879999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 13:06:32.673623 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:32.674953 16333 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
W20260709 13:06:32.689132 15688 connection.cc:256] RPC call timeout handler was delayed by -1.4617936879999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:06:32.689559 15688 connection.cc:256] RPC call timeout handler was delayed by -1.4005936879999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:06:32.669335 17895 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.000s
I20260709 13:06:32.689749 15642 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:32.628571 18045 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.659890 18068 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.657848 18031 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:32.673535 16327 raft_consensus.cc:1217] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-5.6]   Dedup: 3.5->[5.6-5.6]
I20260709 13:06:32.672271 16325 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:32.709985 16327 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:06:32.682765 18069 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.711410 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.712788 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.713042 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1361) took 2941 ms. Trace:
I20260709 13:06:32.683476 17621 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:32.671511 18071 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.671686 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 509) took 1164 ms. Trace:
I20260709 13:06:32.628808 18037 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:32.694646 18065 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:06:32.693907 17910 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.685978 17927 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.695353 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.695993 17895 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:32.647336 18042 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.668327 18057 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:32.689965 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3797992840000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:06:32.640100 17923 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.713689 16327 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:32.737131 17923 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.637704 15641 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:32.705765 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:32.737560 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.705468 18072 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:06:32.734992 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3780936879999217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 13:06:32.738353 15642 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:32.695500 18066 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:06:32.720337 18068 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.748179 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.749271 16327 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:32.739148 18037 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.714767 18026 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.715480 18044 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.715823 17921 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.664464 16326 rpcz_store.cc:276] 0709 13:06:31.347725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.366065 (+ 18340us) service_pool.cc:224] Handling call
0709 13:06:32.610689 (+1244624us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54007904d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:32.610918 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200034688}
I20260709 13:06:32.771965 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.773217 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:32.720671 15713 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:32.718550 16331 rpcz_store.cc:276] 0709 13:06:31.507073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.510408 (+  3335us) service_pool.cc:224] Handling call
0709 13:06:32.286854 (+776446us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:32.668517 (+381663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16245632}
I20260709 13:06:32.774926 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.776142 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:32.728025 17729 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.824s	user 0.003s	sys 0.009s
I20260709 13:06:32.721491 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:32.778064 15638 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:32.724773 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1358) took 2953 ms. Trace:
I20260709 13:06:32.718245 18060 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.778887 15640 rpcz_store.cc:276] 0709 13:06:29.770982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.578496 (+1807514us) service_pool.cc:224] Handling call
0709 13:06:31.605559 (+ 27063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.606038 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:31.942526 (+336488us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.189761 (+247235us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.198768 (+  9007us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.209020 (+ 10252us) log.cc:844] Serialized 548 byte log entry
0709 13:06:32.214602 (+  5582us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:32.214949 (+   347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.316875 (+101926us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.724548 (+407673us) raft_consensus.cc:1685] finished
0709 13:06:32.724569 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.724713 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":420639,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5864,"raft.queue_time_us":11008,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7148,"spinlock_wait_cycles":24945920,"thread_start_us":579433,"threads_started":2,"wal-append.queue_time_us":521261}
I20260709 13:06:32.725697 16333 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:32.782125 18067 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:06:32.782648 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:32.727959 18042 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:32.743851 17483 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.001s
I20260709 13:06:32.728217 18057 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.742390 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:32.732066 17840 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:06:32.713634 15643 rpcz_store.cc:276] 0709 13:06:29.771968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.579856 (+1807888us) service_pool.cc:224] Handling call
0709 13:06:31.644725 (+ 64869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.645158 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.645198 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.656260 (+ 11062us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.201028 (+544768us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:32.201096 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.201197 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.712748 (+511551us) raft_consensus.cc:1685] finished
0709 13:06:32.712781 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.712960 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1779,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":11672,"thread_start_us":520665,"threads_started":1,"wal-append.queue_time_us":1040514}
I20260709 13:06:32.718567 18071 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:32.784145 17840 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.784638 18071 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.783910 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.786643 17840 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:32.786732 18071 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.722661 17899 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.722353 18031 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.784125 17483 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.788717 15646 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:32.789016 17729 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.777350 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:32.725319 18036 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.753335 18011 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.790771 17483 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.791009 16331 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.791529 16329 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:32.746459 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3654936879999013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 13:06:32.746634 18072 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.755720 18068 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.736472 18045 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.714365 18069 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.734647 17987 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.768898 18075 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.806988 17483 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:32.807022 18075 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.807771 17483 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.767772 17927 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.810436 15722 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:06:32.810550 17927 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.811882 15722 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.812777 17927 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.768028 18017 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:32.770184 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.813659 18017 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.783691 18057 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.794608 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.815523 15719 raft_consensus.cc:2368] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:32.795804 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.816267 16327 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:32.816555 15715 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:32.798983 15720 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:32.817699 18017 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.800675 15716 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.804926 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.819110 15718 raft_consensus.cc:2376] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3. Re-sending same reply.
I20260709 13:06:32.819238 16327 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:32.820053 18075 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:32.823985 16298 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.573s (SENT) [suppressed 50 similar messages]
I20260709 13:06:32.830122 15718 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:32.832513 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.832559 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.788980 16326 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:32.797061 18036 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:32.846025 16330 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:32.854764 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.856693 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.859905 15716 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
W20260709 13:06:32.845299 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 631767us
I20260709 13:06:32.846179 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.861462 15717 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:32.854496 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.862810 15719 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:32.855391 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.855957 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.865547 15722 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:32.866604 15720 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:32.807029 18011 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.866688 16328 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.872684 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.859508 17483 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:32.854736 18036 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:32.877038 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:32.896581 15685 connection.cc:256] RPC call timeout handler was delayed by -1.2988781060000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3368s for a response
W20260709 13:06:32.901261 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.904217 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.897177 15685 connection.cc:256] RPC call timeout handler was delayed by -1.2888143930000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:06:32.910876 15685 connection.cc:256] RPC call timeout handler was delayed by -1.2537143929999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 13:06:32.115984 15644 rpcz_store.cc:276] 0709 13:06:29.765278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.256007 (+1490729us) service_pool.cc:224] Handling call
0709 13:06:31.256489 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.256965 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.257009 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.262318 (+  5309us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.733139 (+470821us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:32.095840 (+362701us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.101101 (+  5261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.101224 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.101285 (+    61us) raft_consensus.cc:1685] finished
0709 13:06:32.101304 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.101501 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291784,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":39,"raft.queue_time_us":2802,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":30374,"thread_start_us":797153,"threads_started":2,"wal-append.queue_time_us":621240}
I20260709 13:06:32.916880 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:32.918110 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.930244 18078 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.931111 18078 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.947875 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.954070 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.955188 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:32.920282 18060 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.948029 18036 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:32.959014 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.960041 18036 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.960565 18036 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.961676 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.962124 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.962889 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.964113 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.964239 18036 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.962906 15713 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:32.964756 15715 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:32.965806 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.966039 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.966251 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.966828 15714 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:32.966866 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.967348 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:32.951304 18081 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:32.967943 15716 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:32.968088 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:32.967615 15713 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:32.968287 15685 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:32.966269 18026 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:32.972363 18036 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:32.972417 18057 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:32.973080 18036 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:32.972191 15714 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:32.973536 18036 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.974654 18057 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.975395 15718 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:32.970291 18060 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:32.981447 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 157478us
I20260709 13:06:32.982897 18060 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.957998 18078 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:32.946353 18009 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:32.987700 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:32.988459 15641 raft_consensus.cc:2376] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4. Re-sending same reply.
I20260709 13:06:32.989475 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:32.991248 15762 connection.cc:256] RPC call timeout handler was delayed by -1.2999056689999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:06:32.991617 15762 connection.cc:256] RPC call timeout handler was delayed by -1.2954056689999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:06:32.991568 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.992569 15718 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:32.992600 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.993340 15714 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:32.993848 15640 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.981765 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:32.994472 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.994521 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:32.995214 15714 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:32.993850 15641 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:32.996753 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:32.997430 15643 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:32.990159 18045 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:06:32.999807 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:33.000708 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.001319 15713 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:32.998428 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.003571 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:33.004685 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.005481 15716 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:33.006006 15644 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:33.015501 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1705) took 3012 ms. Trace:
I20260709 13:06:33.016755 15647 rpcz_store.cc:276] 0709 13:06:30.003107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.626967 (+1623860us) service_pool.cc:224] Handling call
0709 13:06:31.630044 (+  3077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.630821 (+   777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.015291 (+1384470us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b54003eb7d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:33.015443 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6143232}
I20260709 13:06:33.006146 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.018898 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.012677 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:33.006268 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:33.020036 15762 connection.cc:256] RPC call timeout handler was delayed by -1.199105669000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 13:06:33.020721 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:33.012145 15640 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:33.021657 15762 connection.cc:256] RPC call timeout handler was delayed by -1.0218277460000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
I20260709 13:06:33.021857 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:33.009591 18069 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:33.025902 17760 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.026525 17760 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.026672 18057 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.027118 17760 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:33.029160 15821 heartbeater.cc:646] Failed to heartbeat to 127.14.45.62:37417 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.45.62:37417 timed out after 15.000s (SENT)
I20260709 13:06:33.005072 18078 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:33.032968 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.033104 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.030783 18060 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:33.033779 15795 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:33.035468 18060 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:33.026301 18069 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.036374 18060 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.037164 18069 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.038426 18069 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.040869 15688 leader_election.cc:400] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:33.041797 15790 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.042122 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:33.043797 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.044023 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.044135 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:33.042867 15789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1799) took 2569 ms (client timeout 1700 ms). Trace:
I20260709 13:06:33.045323 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:33.045598 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:33.045871 15789 rpcz_store.cc:269] 0709 13:06:30.473728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.198438 (+724710us) service_pool.cc:224] Handling call
0709 13:06:33.042720 (+1844282us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540047bdd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:33.042807 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238198528}
I20260709 13:06:33.047034 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.047338 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:33.048309 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.049015 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.031822 18078 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:33.049938 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.050163 16327 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:33.050591 15787 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:33.050679 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.051323 15788 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:33.051676 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.052207 17969 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:33.052531 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.052783 17969 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:33.053170 15792 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:33.053213 16325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 507) took 1657 ms (client timeout 1543 ms). Trace:
I20260709 13:06:33.052254 18045 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.054126 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.052265 15795 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:33.057420 15793 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:33.045044 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.059036 15611 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.059792 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.049315 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.062107 18068 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:33.063066 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.030833 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:33.048658 15720 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:33.055394 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:33.066198 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:33.055862 15688 leader_election.cc:400] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:06:33.066466 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:33.054879 16325 rpcz_store.cc:269] 0709 13:06:31.395676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.406302 (+ 10626us) service_pool.cc:224] Handling call
0709 13:06:33.053042 (+1646740us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54004e2354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:33.053144 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470585600}
I20260709 13:06:33.067174 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.053781 17969 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.068610 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:33.082584 15796 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:33.082834 17969 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.082768 15790 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.083009 18044 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:33.083494 17899 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:33.084544 18071 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:33.083153 17978 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:33.068835 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.088486 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:33.090981 15790 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:33.040380 18079 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:33.069099 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.049983 18078 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.070731 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.075476 15688 leader_election.cc:403] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:33.064774 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.076303 18014 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.077873 17697 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:33.064759 17927 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:33.069967 18020 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.065068 17483 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.071658 18035 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:33.079664 18045 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.064927 18021 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:33.070253 18068 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:33.095608 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.119344 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48688.5us
I20260709 13:06:33.134338 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.119994 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:33.135887 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.136296 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.136747 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.139879 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:33.117780 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:33.126003 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.130775 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74990.9us
I20260709 13:06:33.141054 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.141237 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.133170 17978 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.158773 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.121706 17697 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:33.168234 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.169145 15789 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:33.117153 18025 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:33.161819 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.118415 18079 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.132185 17483 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.156503 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.159374 15790 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:33.132889 18020 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.167085 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.132477 18035 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.129614 17987 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:33.201969 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.222573 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:33.201156 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.219934 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:33.220907 15610 connection.cc:256] RPC call timeout handler was delayed by -1.282665436000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:06:33.220314 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.202329 15796 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:33.264729 15789 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
W20260709 13:06:33.206948 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49188.1us
I20260709 13:06:33.141294 18042 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.221663 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.203624 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:33.264731 15610 connection.cc:256] RPC call timeout handler was delayed by -1.282665436000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:06:33.156023 17923 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:33.179353 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:33.288372 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 130305us
I20260709 13:06:33.177567 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:33.142210 17927 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:33.289279 15795 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:33.265661 15792 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:33.178776 16298 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.957s (SENT)
W20260709 13:06:33.287549 15610 connection.cc:256] RPC call timeout handler was delayed by -1.1557654360000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:06:33.221222 18096 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:33.143006 18101 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:06:33.221966 18068 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.143246 18014 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.147073 17899 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.235158 18039 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:06:33.300053 18100 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:33.262931 17921 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.263334 17483 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.246404 17978 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:33.336242 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 261056us
I20260709 13:06:33.338102 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:33.259707 17987 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.297276 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 118539us
I20260709 13:06:33.261710 18035 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.234419 18025 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:33.262177 17907 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.164915 17975 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:06:33.243928 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:33.261437 18020 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.266605 18042 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.324226 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.353861 15790 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:33.290143 17923 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.327963 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.355675 15795 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 2.
I20260709 13:06:33.290838 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:33.335994 18100 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:33.165179 17729 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:06:33.301851 18021 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.348417 17987 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.317261 18045 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.292730 18037 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:33.357836 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:33.361667 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 90254.3us
W20260709 13:06:33.375481 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 219010us
I20260709 13:06:33.419251 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.412596 15790 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:33.351925 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 210947us
I20260709 13:06:33.420984 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:33.421543 18098 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:06:33.357640 18042 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.350869 17978 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.443039 17978 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.334538 17997 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:33.447937 16327 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:33.449940 17927 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.450767 18103 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:33.451619 18103 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.411301 18021 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.452956 18021 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.454351 18101 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:33.452877 18103 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.460964 15787 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:33.357028 17907 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.350150 18014 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:06:33.466571 18044 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:33.467204 18044 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.359122 18100 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.476760 18100 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.336452 17921 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.358237 18043 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.483978 18025 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.358963 17923 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.490681 18045 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.412890 18036 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:33.533226 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 83144.4us
I20260709 13:06:33.534799 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:06:33.535359 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.468711 18044 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:33.545076 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.541208 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:33.557317 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.535977 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 116821us
I20260709 13:06:33.558972 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.562201 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:33.564994 18068 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.570303 18036 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:33.578724 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 227306us
I20260709 13:06:33.537312 18100 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.587760 15759 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:33.599440 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:33.560681 18104 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:33.606508 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.542783 17997 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.498800 18043 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.579450 17921 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:33.578570 18014 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:33.594825 18107 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.612378 18037 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:33.615947 18036 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.613714 17907 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:33.612902 18106 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.619542 18104 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:33.643596 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 224780us
I20260709 13:06:33.645730 15762 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.629993 17921 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.643149 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.646937 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:33.653606 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 65933.9us
W20260709 13:06:33.659174 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 100025us
I20260709 13:06:33.665670 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.666947 15789 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:33.667584 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.622972 17729 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:33.617796 18109 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:06:33.638410 18037 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:33.663697 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:33.664036 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.639827 18036 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:33.668864 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.634346 18101 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:06:33.648200 17907 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.625929 18014 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.686782 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:33.657471 18057 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.654223 18079 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:33.710098 15719 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:33.636855 18107 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.643729 18106 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:33.689576 15791 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.703280 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:33.686299 17975 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:33.669690 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.690709 18036 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.721378 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:33.694331 17907 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.688863 15722 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:33.694936 18110 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:33.711877 18057 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.758500 18057 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.763384 18107 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:33.766047 18118 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.766593 18118 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.766978 18118 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.734431 17907 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:33.732589 17760 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.004s
I20260709 13:06:33.748003 15791 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:33.659277 17921 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.729041 18106 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.770416 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:33.690462 18112 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:06:33.728875 15720 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:33.779601 15794 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:33.728035 18108 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:33.735476 18113 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:33.752169 18110 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.728454 17915 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:06:33.801047 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 137125us
W20260709 13:06:33.801385 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.780536 18060 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.810458 18111 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.811085 18111 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:33.807682 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 79403.7us
I20260709 13:06:33.788833 18079 raft_consensus.cc:2764] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:33.789105 17760 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:33.801134 18108 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.825233 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:33.806418 18110 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.862703 18071 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:33.873615 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67885.4us
I20260709 13:06:33.816468 18113 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:33.771674 18037 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.872822 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:33.872933 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 47832.6us
I20260709 13:06:33.878989 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:33.879796 15718 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:33.880115 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:33.881526 15718 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:33.881652 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.881821 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.882478 15640 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:33.883095 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:33.883489 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.884093 15644 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:33.884640 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.885394 15714 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:33.886385 15644 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:33.888084 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.888677 15644 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:33.882710 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:33.844534 18120 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:33.891328 15644 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:33.893784 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.774915 18104 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:33.874096 18071 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:33.901692 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.902132 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:33.903937 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.927443 15715 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
W20260709 13:06:33.905408 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.906700 15762 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:33.910174 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:33.931382 15644 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.911350 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:33.932566 15639 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.900604 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.933959 15717 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:33.875646 18043 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:33.937242 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:33.939395 18112 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:33.942437 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.943125 15647 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:33.943971 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.944972 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.945113 17997 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.946163 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:33.940012 18069 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.901s	user 0.016s	sys 0.030s
I20260709 13:06:33.946893 15643 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:33.947373 15718 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:06:33.947613 18116 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:06:33.947944 15641 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:33.948060 17997 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.948494 17997 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:33.948920 17997 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.949960 17729 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:33.896944 18117 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:33.949481 18122 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:33.934909 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.953685 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:33.961663 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.903759 18109 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:33.996662 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 59527.1us
I20260709 13:06:33.926076 17927 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.997537 16298 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:33.926355 18037 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.005273 15639 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:34.014513 15639 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:34.042979 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:33.951066 17729 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.075564 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:33.970252 18014 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.085191 15642 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:33.971807 18126 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.086809 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:34.089605 15645 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:33.929517 18025 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:06:34.075583 15639 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:34.021447 18123 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.018739 17975 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:34.106833 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.922048 18120 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.090061 18033 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.133679 15644 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:34.088536 17729 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.134140 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:34.156527 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.167313 17483 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.004s
I20260709 13:06:34.167856 17483 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.170106 17975 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:34.176551 18042 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.002s
I20260709 13:06:34.177001 18042 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.178586 18108 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.180157 18036 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.180714 18108 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.088317 18071 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.182477 18071 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.160029 17915 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:34.186471 17915 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.187425 18057 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.191406 17729 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.133980 18123 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.197042 18123 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.197855 18111 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.202157 15713 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:34.097496 18014 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:34.204698 15647 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:34.158533 18119 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:06:34.165513 18089 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:34.214861 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.156114 17921 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.181365 18108 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.207691 18014 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:34.216110 18020 consensus_meta.cc:287] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.006s
I20260709 13:06:34.202826 16325 raft_consensus.cc:2376] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:34.231108 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:34.235706 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:34.237285 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:34.237917 15792 raft_consensus.cc:2376] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:34.234573 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:34.080885 18113 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.241258 15796 raft_consensus.cc:2368] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:34.244432 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:34.243522 18014 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.247689 18014 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:34.248054 18078 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.118s	user 0.010s	sys 0.005s
I20260709 13:06:34.248238 15793 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:34.231755 18068 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:34.250531 18068 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.243059 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:34.253955 15791 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:34.254336 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:34.262213 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 310169us
I20260709 13:06:34.262948 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:34.264184 15760 leader_election.cc:400] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4.
I20260709 13:06:34.241006 18101 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.288704 15796 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:06:34.296198 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 298742us
I20260709 13:06:34.245119 18057 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.240692 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 521) took 1101 ms. Trace:
I20260709 13:06:34.226727 18110 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.255180 18045 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:06:34.248626 18078 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.330596 16330 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:34.331037 16330 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:34.238848 18020 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:34.346421 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 184600us
W20260709 13:06:34.347702 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.297384 18123 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:34.264109 18124 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:06:34.308145 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:34.303933 17483 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.352466 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:34.299783 18101 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.346764 16330 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.301447 17729 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:06:34.372195 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 284601us
I20260709 13:06:34.370823 16331 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:34.373922 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:34.331214 18135 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.366778 15760 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:34.367856 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:34.369963 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:34.376729 18045 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:34.365239 16330 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:34.356171 17923 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.868s	user 0.005s	sys 0.010s
I20260709 13:06:34.378952 16334 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:34.379153 15719 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:34.348781 18141 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:34.357704 18026 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.356489 18057 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.351552 18109 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:34.360615 18101 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.357224 17915 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:34.380777 17987 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.846s	user 0.000s	sys 0.022s
W20260709 13:06:34.380172 18021 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.926s	user 0.008s	sys 0.006s
I20260709 13:06:34.383145 18045 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:34.424067 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:34.401093 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:34.401481 18133 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:06:34.401974 18042 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.387989 18026 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.355899 18123 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:34.402691 18137 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:34.389528 17997 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.408218 18078 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.409495 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:34.345258 17697 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.311406 16325 rpcz_store.cc:276] 0709 13:06:33.139292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.141228 (+  1936us) service_pool.cc:224] Handling call
0709 13:06:34.133952 (+992724us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:34.237247 (+103295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45360384}
I20260709 13:06:34.410283 15792 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:34.380556 18036 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.424990 15643 raft_consensus.cc:2376] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6. Re-sending same reply.
I20260709 13:06:34.426916 15642 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:34.448601 18099 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:34.426846 18120 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:34.427997 18140 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:06:34.477592 17697 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.481503 15722 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:34.481977 18145 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.482501 18145 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:34.483759 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 105327us
I20260709 13:06:34.485329 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:34.485951 16325 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.428718 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:34.429702 18147 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:34.444231 16330 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 13:06:34.448529 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 60194.3us
I20260709 13:06:34.488973 16330 pending_rounds.cc:85] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 6
I20260709 13:06:34.489253 16330 pending_rounds.cc:107] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:34.489354 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:34.449628 18042 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:34.451959 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 85247.9us
W20260709 13:06:34.457269 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.424763 17915 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:34.475257 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.387246 17923 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.486097 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:34.428653 18020 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:34.486739 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 232444us
W20260709 13:06:34.472122 18100 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.881s	user 0.017s	sys 0.005s
I20260709 13:06:34.489542 16330 raft_consensus.cc:2889] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:34.450294 18026 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.389880 18139 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:06:34.492192 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:34.493350 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:34.424292 17987 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.430598 18021 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.473752 18115 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:34.389858 18141 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.498250 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:34.501646 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:34.487463 18099 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:34.514556 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:34.492153 18108 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.514925 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:34.518258 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:34.492467 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 417) took 1335 ms. Trace:
I20260709 13:06:34.529352 15644 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:34.521304 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:34.534528 18154 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.535324 18154 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:34.535908 18154 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.534833 16326 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:34.500062 18152 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.529505 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:34.516412 18042 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.544338 18057 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.546496 18057 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.521900 18078 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:34.494321 18045 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.556409 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 419) took 1381 ms. Trace:
W20260709 13:06:34.571669 18035 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.217s	user 0.013s	sys 0.003s
I20260709 13:06:34.528609 18100 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.528048 18143 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.525112 18014 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:34.531111 18144 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.545353 18152 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:34.590366 18148 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:06:34.546887 18057 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.588541 17915 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.548035 18042 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.544306 18068 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.573052 18099 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.597954 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:34.569787 18110 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:34.612902 18156 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:34.527253 16328 rpcz_store.cc:276] 0709 13:06:33.157407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.161574 (+  4167us) service_pool.cc:224] Handling call
0709 13:06:34.409313 (+1247739us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:34.490347 (+ 81034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44779264}
I20260709 13:06:34.575325 16326 rpcz_store.cc:276] 0709 13:06:33.167659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.168492 (+   833us) service_pool.cc:224] Handling call
0709 13:06:34.512619 (+1344127us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1eee 0000000000375939 00007fad2a3551e0 00007fad2a41e0c4 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:06:34.549341 (+ 36722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20189952}
I20260709 13:06:34.556959 18109 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.618125 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:34.818150 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 307) took 1124 ms. Trace:
I20260709 13:06:34.821013 18145 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.830436 15794 rpcz_store.cc:276] 0709 13:06:33.693503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.693838 (+   335us) service_pool.cc:224] Handling call
0709 13:06:33.694097 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.796468 (+102371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.817782 (+1021314us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b540047aed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:34.818066 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196127104}
I20260709 13:06:34.831185 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:34.832096 15643 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:34.817008 17760 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.618413 18136 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:34.643224 18118 consensus_meta.cc:287] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.876s	user 0.012s	sys 0.000s
I20260709 13:06:34.835139 17923 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.593523 18100 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.836305 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:34.838281 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 485869us
I20260709 13:06:34.619212 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:34.702052 15641 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:34.850739 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:34.851769 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:34.829923 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.846370 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 248503us
I20260709 13:06:34.849404 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:34.833228 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:34.871728 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.873293 15639 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:34.819803 18127 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.882s	user 0.000s	sys 0.005s
W20260709 13:06:34.829099 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 314214us
I20260709 13:06:34.849586 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:34.876467 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:34.727200 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.646601 18026 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.672581 17969 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:34.872186 18100 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:34.647871 18106 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260709 13:06:34.880151 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:34.880970 15643 raft_consensus.cc:2393] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:34.836087 18042 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.892864 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:34.893478 15717 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:34.881584 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:34.754492 18078 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.884102 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.594314 18035 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.904464 15645 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:34.879837 18099 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.714146 17997 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.885346 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:34.775715 18125 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.695s	user 0.004s	sys 0.001s
I20260709 13:06:34.835229 18118 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:34.858332 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 331714us
I20260709 13:06:34.605706 18152 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.634941 18144 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:34.870855 18045 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.875499 18079 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.893641 18112 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.890667 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:34.896066 18115 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:34.917665 18144 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.888922 17969 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:34.899555 18126 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.000s
I20260709 13:06:34.900326 16325 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:34.887971 18136 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:34.901290 18141 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.930725 18119 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:34.931066 15787 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:06:34.895025 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.926093 18072 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.931957 17969 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.933019 18111 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:34.933391 18111 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:34.921200 18079 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:34.934141 18079 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.889732 18161 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.934233 18111 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.935083 18161 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.935335 18111 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.935488 18161 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.908190 16329 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:34.936800 18101 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.000s
I20260709 13:06:34.618301 17915 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.906823 18020 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:34.938303 18020 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:34.938629 18020 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:34.938861 18126 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.916447 18035 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.939553 17915 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.909894 15720 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:34.941179 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:34.908989 18021 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.941526 17987 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.941814 15720 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.943761 18042 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.888230 17760 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:34.946175 17760 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.948385 17760 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.909556 18009 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:34.949148 18009 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.937247 18101 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.918494 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:34.882411 18160 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:34.901959 18123 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:34.892693 18106 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.963562 18106 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.915115 18026 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.925063 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:34.924321 18115 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:34.964062 18161 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.930310 18057 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:34.914376 18118 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:34.958269 18071 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.003s
I20260709 13:06:34.972483 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 562) took 1217 ms. Trace:
I20260709 13:06:34.965348 18115 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.977079 18057 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:34.907856 18078 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.018810 18161 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:35.020046 18042 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:34.939517 18020 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:34.881630 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:35.144116 18020 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:35.144425 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 262898us
I20260709 13:06:34.884788 15639 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:35.147827 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:35.149099 15639 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 3: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:34.887743 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:34.888442 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.147876 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:35.150894 18118 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.151373 16329 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.891119 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.152904 15643 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:35.153101 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:35.153548 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.154343 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.154636 15646 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:35.154754 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.155695 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:35.081103 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2231) took 1413 ms. Trace:
I20260709 13:06:35.156723 15646 raft_consensus.cc:606] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:35.081954 15720 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:35.082410 15722 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:35.084745 15793 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:35.028245 17907 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.259s	user 0.015s	sys 0.014s
I20260709 13:06:34.973311 16333 rpcz_store.cc:276] 0709 13:06:33.755606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.756123 (+   517us) service_pool.cc:224] Handling call
0709 13:06:33.906839 (+150716us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:33.907074 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.907538 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.907580 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.908169 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.909212 (+1001043us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18002e6ae0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:06:34.924850 (+ 15638us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:34.924889 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.925042 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.971555 (+ 46513us) raft_consensus.cc:1685] finished
0709 13:06:34.971592 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.972399 (+   807us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7760,"spinlock_wait_cycles":62550272,"thread_start_us":15453,"threads_started":1,"wal-append.queue_time_us":1035401}
W20260709 13:06:35.091218 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 165987us
I20260709 13:06:35.098443 18109 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.033120 18144 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.099102 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 337) took 1207 ms. Trace:
I20260709 13:06:35.032696 18078 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:35.100411 17729 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:35.038998 18101 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.022348 18154 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.032860 18079 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.040997 18152 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.156411 15643 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:35.202185 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.167568 16329 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:35.102653 18114 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.134858 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.135622 18161 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.136229 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.100449 18009 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:35.150556 16325 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:35.183545 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 306) took 1518 ms. Trace:
I20260709 13:06:35.079218 15719 raft_consensus.cc:2368] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6.
I20260709 13:06:35.190043 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1385) took 1178 ms. Trace:
I20260709 13:06:35.231294 15787 rpcz_store.cc:276] 0709 13:06:33.665234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.687134 (+ 21900us) service_pool.cc:224] Handling call
0709 13:06:33.775229 (+ 88095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.931484 (+1156255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.182771 (+251287us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400152f54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.183252 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2657408256}
I20260709 13:06:35.181447 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:35.232154 15645 rpcz_store.cc:276] 0709 13:06:34.011734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.128685 (+116951us) service_pool.cc:224] Handling call
0709 13:06:34.157271 (+ 28586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.904962 (+747691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.189406 (+284444us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54000e79d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.189840 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717795584}
I20260709 13:06:35.233144 15716 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:35.179998 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1275) took 1301 ms. Trace:
I20260709 13:06:35.157317 15646 raft_consensus.cc:614] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:35.235137 15645 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:35.175268 18099 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.235265 15643 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.241580 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:35.242254 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:35.246048 15715 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.246217 17697 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.231326 18161 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:35.182408 18121 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.245s	user 0.005s	sys 0.000s
I20260709 13:06:35.223747 15718 rpcz_store.cc:276] 0709 13:06:33.891949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.892103 (+   154us) service_pool.cc:224] Handling call
0709 13:06:33.892359 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.947733 (+ 55374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.098440 (+1150707us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54003bc754. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.098903 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125763328}
I20260709 13:06:35.236027 15713 rpcz_store.cc:276] 0709 13:06:33.878828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.878984 (+   156us) service_pool.cc:224] Handling call
0709 13:06:33.922881 (+ 43897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.206183 (+283302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.179362 (+973179us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003bd154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.179772 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641522048}
I20260709 13:06:35.253346 18009 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:35.253391 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:35.256019 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1717) took 1314 ms. Trace:
I20260709 13:06:35.256551 15647 rpcz_store.cc:276] 0709 13:06:33.941085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.961249 (+ 20164us) service_pool.cc:224] Handling call
0709 13:06:35.255541 (+1294292us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400346554. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:35.255811 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487291776}
I20260709 13:06:35.257843 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:35.258659 18044 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.260239 16298 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:35.260267 17697 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.261360 17697 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.261729 17697 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.260613 15642 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:35.262627 18161 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.262105 18009 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:35.266731 18009 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:35.266638 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:35.158179 18071 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.270618 18071 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.274082 15719 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:35.274170 18072 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:35.275071 18072 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.275724 18143 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.278856 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.279875 15796 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.280037 15794 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.156936 15721 rpcz_store.cc:276] 0709 13:06:33.667247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.689543 (+ 22296us) service_pool.cc:224] Handling call
0709 13:06:33.689926 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.693993 (+  4067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.694021 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.705206 (+ 11185us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.798426 (+ 93220us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:33.798466 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.798533 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.666668 (+868135us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:35.080134 (+413466us) raft_consensus.cc:1685] finished
0709 13:06:35.080215 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.080749 (+   534us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3625,"raft.queue_time_us":4018,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":10799,"spinlock_wait_cycles":8169984,"thread_start_us":92854,"threads_started":1,"wal-append.queue_time_us":251633}
W20260709 13:06:35.282044 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 136266us
I20260709 13:06:35.282366 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:35.283586 15795 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:35.284143 15639 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:35.285480 18109 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.286316 18099 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.267453 18009 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.292428 18154 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.294327 15787 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:35.296173 17729 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.283207 18152 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.132078 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:35.304514 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 393956us
I20260709 13:06:35.182471 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:35.261641 16298 leader_election.cc:400] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6.
I20260709 13:06:35.320960 16298 leader_election.cc:403] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.326766 18109 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:35.329810 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 68461.1us
I20260709 13:06:35.332057 17915 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.332799 17729 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:35.333472 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:35.334561 17969 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.335772 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:35.336790 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:35.337261 15715 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:35.337802 17899 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:35.338148 18078 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.338581 18078 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.339125 18078 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.339354 18105 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:35.338546 17899 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:35.341264 17899 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.347102 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.347342 17907 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.349048 15638 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:35.347154 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.349869 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 167797us
I20260709 13:06:35.351215 17907 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:35.353246 15796 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:35.354080 17729 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.357328 17729 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.357829 17729 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.358875 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:35.354622 18109 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.360816 18109 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.354387 18143 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.355275 18161 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:35.360924 18026 consensus_queue.cc:1059] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:35.355221 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:35.320262 18154 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:35.386998 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 120576us
I20260709 13:06:35.385619 18161 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:35.390785 18071 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.391017 18161 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:35.392450 18161 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.385408 18154 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:35.394006 18154 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.289608 15545 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:06:35.408109 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71440.4us
I20260709 13:06:35.389446 18099 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:35.419534 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.420491 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.421330 15646 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:35.421363 15715 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:35.441359 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.439590 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 84551.7us
W20260709 13:06:35.439459 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.446151 18111 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.446815 15721 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:35.446905 18111 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.448169 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.449658 15647 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:35.450416 18079 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:35.450820 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.451292 16297 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:35.454689 15647 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:35.456643 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:35.431519 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:35.459721 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:35.441697 18114 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.451865 18079 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:35.472937 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:35.481767 18039 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:06:35.483111 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.483942 15721 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.485993 18144 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:35.490082 17997 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:35.491478 18111 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:35.493691 18141 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.512533 18141 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:35.513522 18141 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.513947 18079 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.515158 18141 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.516206 18079 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:35.494091 18100 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.009s
I20260709 13:06:35.518429 18100 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.519672 15713 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.519604 18152 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:35.520870 18100 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.494473 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1835) took 1245 ms. Trace:
I20260709 13:06:35.502198 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:35.503772 18128 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.503108 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2235) took 1426 ms. Trace:
I20260709 13:06:35.512043 18071 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:35.524495 18071 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:35.522159 15793 rpcz_store.cc:276] 0709 13:06:34.249520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.250335 (+   815us) service_pool.cc:224] Handling call
0709 13:06:34.250625 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.321483 (+1070858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.494187 (+172704us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002eb3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.494411 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915863808}
I20260709 13:06:35.502565 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 235) took 1562 ms. Trace:
I20260709 13:06:35.523725 15647 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:35.510427 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71570.8us
I20260709 13:06:35.527761 18071 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.528461 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1386) took 1437 ms. Trace:
I20260709 13:06:35.528842 15644 rpcz_store.cc:276] 0709 13:06:34.022567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.160557 (+137990us) service_pool.cc:224] Handling call
0709 13:06:34.160969 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.533423 (+372454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.420767 (+887344us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540019ad54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.460062 (+ 39295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846600576}
I20260709 13:06:35.526443 15638 rpcz_store.cc:276] 0709 13:06:33.939860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.948967 (+  9107us) service_pool.cc:224] Handling call
0709 13:06:33.949300 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.349705 (+1400405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.502242 (+152537us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001bdfd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.502470 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3217987840}
W20260709 13:06:35.530542 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 158978us
I20260709 13:06:35.523469 18128 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:35.531556 18039 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.532052 18039 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:35.532446 18128 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.534081 15646 raft_consensus.cc:2368] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5.
I20260709 13:06:35.511771 18078 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.504376 15545 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 1 to 2, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 2 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:35.536041 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.536222 18078 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:35.536532 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.496052 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.538861 15716 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.541926 15720 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:35.504032 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:35.465169 18161 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.543128 15714 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:06:35.530704 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 105204us
I20260709 13:06:35.517513 15641 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:35.542891 15715 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:35.522666 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.543095 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.536839 15545 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: NON_VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: true } } }
I20260709 13:06:35.553807 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.554581 15714 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.554631 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.555367 15713 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.517966 17915 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6.
I20260709 13:06:35.558799 18119 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:35.510102 17697 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.560519 17915 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:35.561051 17915 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:35.533316 18039 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.564567 18039 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.523897 15722 rpcz_store.cc:276] 0709 13:06:34.076807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.482483 (+405676us) service_pool.cc:224] Handling call
0709 13:06:34.482890 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.252410 (+769520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.502804 (+250394us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400438d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:35.503028 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377221888}
I20260709 13:06:35.566967 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.567709 15722 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.476491 18143 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:06:35.569393 18128 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.570561 15720 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.472231 18109 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:35.571599 18045 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.015s
I20260709 13:06:35.573063 17915 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.576052 15717 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:35.551517 15685 leader_election.cc:400] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:35.581529 15685 leader_election.cc:403] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.582734 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:35.562600 15545 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 3 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.581177 18114 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:35.585155 18114 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.548369 15721 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:35.592195 17697 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.591982 15545 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 5 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.594960 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:35.601215 18072 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.628515 17907 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.629016 17975 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:35.629575 17975 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:35.664302 15714 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:35.623749 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:35.614601 18045 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4.
I20260709 13:06:35.590884 18111 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
W20260709 13:06:35.677052 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 64858.1us
W20260709 13:06:35.691942 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.630470 15785 tablet_service.cc:1558] Processing DeleteTablet for tablet 17db433a32844f26aa2fe7c2d4e4bf66 with delete_type TABLET_DATA_TOMBSTONED (TS c1927141dc2540dab644a00fd6843fc6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56118
I20260709 13:06:35.701916 15762 leader_election.cc:400] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5.
I20260709 13:06:35.702448 15762 leader_election.cc:403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.614100 18119 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:06:35.706485 15719 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:35.710563 15542 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 276) took 8575 ms. Trace:
I20260709 13:06:35.711305 18107 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:35.711599 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 153456us
I20260709 13:06:35.713907 18104 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.714499 18104 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.714996 18045 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.713972 18176 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:06:35.715714 18045 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:35.718068 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 188401us
I20260709 13:06:35.622139 17697 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:06:35.725843 18009 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.726838 15713 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:35.728895 18009 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:35.739512 18072 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.732900 18020 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.740912 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 227) took 1848 ms. Trace:
I20260709 13:06:35.742159 18044 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.741351 15640 rpcz_store.cc:276] 0709 13:06:33.892094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.892210 (+   116us) service_pool.cc:224] Handling call
0709 13:06:33.892449 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.893096 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.893124 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.893550 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.249718 (+1356168us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b1800313e40. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:06:35.471306 (+221588us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:35.621196 (+149890us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.676695 (+ 55499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.700830 (+ 24135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.740477 (+ 39647us) raft_consensus.cc:1685] finished
0709 13:06:35.740602 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.740748 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44371,"prepare.queue_time_us":28440,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":87494,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":34121,"spinlock_wait_cycles":33128192,"thread_start_us":160147,"threads_started":1,"wal-append.queue_time_us":1768633}
W20260709 13:06:35.743593 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 141356us
I20260709 13:06:35.748809 15716 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:35.751751 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.731878 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 270822us
I20260709 13:06:35.708271 18109 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:06:35.751574 17729 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:35.803912 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:35.732869 18154 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.784652 18104 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:35.823041 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 286429us
I20260709 13:06:35.822508 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.782848 18112 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:35.732477 17975 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:35.818710 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.828413 15722 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
W20260709 13:06:35.828927 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 276202us
I20260709 13:06:35.814371 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:35.828671 15643 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.015s
W20260709 13:06:35.836584 15643 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.011s	sys 0.015s
W20260709 13:06:35.841701 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 390620us
W20260709 13:06:35.843750 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.796393 18107 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:35.852246 15796 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:35.852396 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.830940 18045 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:35.854480 15793 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:35.835981 17697 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:35.860845 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:35.864496 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.865639 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:35.865860 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:35.866724 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71914.8us
I20260709 13:06:35.869482 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.870301 18144 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.870790 18144 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:35.870851 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:35.871763 16333 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:35.873044 17969 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.873454 17969 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:35.874508 17969 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:35.875941 17969 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.885874 18143 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:35.894814 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1391) took 1870 ms. Trace:
I20260709 13:06:35.895195 15642 rpcz_store.cc:276] 0709 13:06:34.024269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.485476 (+461207us) service_pool.cc:224] Handling call
0709 13:06:35.259731 (+774255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.260263 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:35.408472 (+148209us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.796499 (+388027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.796553 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:35.796599 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.796662 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.894552 (+ 97890us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400346550. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:35.894747 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7079,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5164,"spinlock_wait_cycles":1779759360,"thread_start_us":362956,"threads_started":1}
I20260709 13:06:35.897351 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.898031 15793 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.901105 18020 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5.
I20260709 13:06:35.905874 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:35.909262 15795 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:35.710995 15542 rpcz_store.cc:276] 0709 13:06:27.186634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.314039 (+127405us) service_pool.cc:224] Handling call
0709 13:06:27.683199 (+369160us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2540ef3a 00007fad2b1c51cc 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:06:35.710298 (+8027099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:29.324547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:29.627184 (+302637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:29.629921 (+  2737us) write_op.cc:435] Acquired schema lock
0709 13:06:29.632380 (+  2459us) tablet.cc:662] Decoding operations
0709 13:06:30.264788 (+632408us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.264878 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.264950 (+    72us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:06:30.267162 (+  2212us) tablet.cc:701] Row locks acquired
0709 13:06:30.267188 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:06:30.267437 (+   249us) write_op.cc:270] Start()
0709 13:06:30.421552 (+154115us) write_op.cc:276] Timestamp: P: 1783602390267365 usec, L: 0
0709 13:06:30.421584 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.443470 (+ 21886us) log.cc:844] Serialized 7010 byte log entry
0709 13:06:31.744551 (+1301081us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25401e28 00007fad28e3c581 00007fad28e3bd58 00007fad28e409f1 00007fad28e409a9 00007fad28e40939 00007fad28e40901 00007fad28e3fb2d 000000000038f354 000000000038f199
0709 13:06:32.365785 (+621234us) op_driver.cc:464] REPLICATION: finished
0709 13:06:32.917844 (+552059us) write_op.cc:301] APPLY: starting
0709 13:06:32.919867 (+  2023us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.966721 (+ 46854us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.966744 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.997254 (+ 30510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.997537 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:06:32.997585 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:32.997960 (+   375us) log.cc:844] Serialized 125 byte log entry
0709 13:06:33.008152 (+ 10192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.033448 (+ 25296us) write_op.cc:454] Released schema lock
0709 13:06:33.037757 (+  4309us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:33.070456 (+ 32699us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.071304 (+   848us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1521,"reported_tablets":30,"spinlock_wait_cycles":81775872,"child_traces":[["op",{"apply.queue_time_us":479887,"apply.run_cpu_time_us":5187,"apply.run_wall_time_us":144948,"num_ops":18,"prepare.queue_time_us":294290,"prepare.run_cpu_time_us":23029,"prepare.run_wall_time_us":2436794,"raft.queue_time_us":394116,"raft.run_cpu_time_us":43846,"raft.run_wall_time_us":668184,"replication_time_us":1788975,"spinlock_wait_cycles":47820544,"thread_start_us":1720609,"threads_started":4,"wal-append.queue_time_us":859080,"wal-append.run_cpu_time_us":45397,"wal-append.run_wall_time_us":2690748}]]}
I20260709 13:06:35.955622 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:35.956591 16326 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.957685 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:06:35.959450 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 94828.6us
I20260709 13:06:35.950208 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:35.966935 15793 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
W20260709 13:06:35.961120 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 128307us
I20260709 13:06:35.970691 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:35.970911 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:35.971504 15796 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:35.971676 15790 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:35.971916 15685 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:35.972476 18099 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:35.949241 18071 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.975078 18111 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.979357 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.980352 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:35.958339 18161 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:35.981083 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.982110 18128 raft_consensus.cc:2764] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:35.982797 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:35.988987 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:35.992466 16328 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:35.994663 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:35.994972 16326 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:35.995823 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:36.024324 15789 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.999132 16332 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:36.001176 16300 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.175s (SENT)
I20260709 13:06:35.924856 17697 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:36.009176 15794 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:35.980465 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:36.015756 18111 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.019440 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:36.033710 15788 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.016361 17899 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:36.031657 16331 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:35.958945 17975 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.036087 15792 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.036469 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:36.037891 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76361.4us
I20260709 13:06:36.038975 15794 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:36.040130 15795 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.040568 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.041152 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:36.024842 18099 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:36.067175 18099 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.041873 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:36.070720 15790 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:36.030490 18143 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.073860 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:36.076747 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:36.078059 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:36.077868 18117 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.080511 18117 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:36.045015 18078 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:06:36.076709 16334 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:36.083914 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1401) took 1002 ms. Trace:
I20260709 13:06:36.042181 18154 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:36.031756 18045 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:36.100203 16333 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:36.085651 15788 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:36.086491 15789 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:36.063831 17899 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:36.087441 18117 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.041843 18107 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:06:36.089131 18100 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.043148 18044 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:06:36.040166 18161 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.109712 15795 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:36.088027 15643 rpcz_store.cc:276] 0709 13:06:35.081861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.304430 (+222569us) service_pool.cc:224] Handling call
0709 13:06:35.304863 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.305308 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:35.836943 (+531635us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.064598 (+227655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:36.064670 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:36.064732 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.064820 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.083846 (+ 19026us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142711,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":1714,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":740319,"threads_started":2}
I20260709 13:06:36.034446 18071 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.098951 17907 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.101167 18026 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.123550 15791 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.123426 18043 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.130385 18020 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.144555 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 143417us
I20260709 13:06:36.115564 18154 raft_consensus.cc:2764] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:36.153556 15759 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.119633 18100 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.177987 15759 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.159260 18039 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:36.184553 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.182204 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 141681us
W20260709 13:06:36.191699 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 111051us
W20260709 13:06:36.196429 16300 leader_election.cc:336] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.525s (SENT)
I20260709 13:06:36.195194 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.197360 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:36.201969 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.213171 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:36.214097 15795 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.160976 18128 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:36.135238 18111 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.200479 18039 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.226866 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:36.162604 18020 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.210057 18119 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.234165 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:36.243575 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 71554us
I20260709 13:06:36.219404 18154 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.162508 17697 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.231549 18039 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.271260 15795 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:36.252204 18154 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:36.275502 18201 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.276439 18165 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:06:36.255561 18119 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:36.256736 18109 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:36.278667 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 174910us
W20260709 13:06:36.285589 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63827.4us
W20260709 13:06:36.291018 18199 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:06:36.275580 18197 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:06:36.286715 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.302884 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:36.284256 18154 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.312016 18109 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:36.313839 18100 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:36.314097 16325 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:36.232749 17899 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:36.315580 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.263744 18152 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:36.330421 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:36.291436 18161 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:36.314164 18192 tablet_replica.cc:333] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:06:36.313113 18109 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:36.346460 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 57922.2us
I20260709 13:06:36.336707 18100 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.352906 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:36.354020 18111 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.354106 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:36.462198 16334 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:36.366789 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.478430 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:36.457347 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:36.512704 15646 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.372936 15792 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:36.420473 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76261.2us
I20260709 13:06:36.343873 17969 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.347676 18043 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.550457 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 196507us
I20260709 13:06:36.551227 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:36.404237 18193 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:06:36.567147 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 357740us
I20260709 13:06:36.568202 15795 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:36.479270 18194 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:06:36.407193 16325 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:36.354812 18192 raft_consensus.cc:2243] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.408072 18211 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:36.571687 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49987.2us
I20260709 13:06:36.425909 18100 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:36.358369 18114 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.434350 18099 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.435199 18044 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:36.438119 18126 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.461771 17907 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:36.406584 18204 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:36.571482 18043 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.577069 18215 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.580322 16329 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
W20260709 13:06:36.582268 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 96427.4us
I20260709 13:06:36.577517 18192 raft_consensus.cc:2272] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.583035 17697 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:36.584101 18104 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:36.584497 18205 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:06:36.612437 18143 raft_consensus.cc:670] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping [suppressed 3 similar messages]
I20260709 13:06:36.613320 18152 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.607707 18204 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.614005 18152 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.614955 18112 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.615357 18112 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:36.616006 18204 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.616101 18152 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.431237 18020 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.560170 17969 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.590096 18220 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:36.616264 18112 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.616600 18154 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.586258 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:36.399423 18209 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 13:06:36.618220 16334 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:36.578152 18100 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.618878 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2264) took 1009 ms. Trace:
I20260709 13:06:36.434834 18144 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.619782 18144 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.619335 15717 rpcz_store.cc:276] 0709 13:06:35.609236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.609432 (+   196us) service_pool.cc:224] Handling call
0709 13:06:35.614016 (+  4584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.614454 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.614494 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.692923 (+ 78429us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.033120 (+340197us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:36.033176 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.033411 (+   235us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.618621 (+585210us) raft_consensus.cc:1685] finished
0709 13:06:36.618658 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.618789 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5413,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":5736,"thread_start_us":306484,"threads_started":1,"wal-append.queue_time_us":462241}
I20260709 13:06:36.560017 18111 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.594066 15787 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:36.592782 18071 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.625639 15795 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.625257 18111 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.586294 18039 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.626235 18117 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.627693 18039 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.610348 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:36.611212 18215 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.628394 18117 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.628566 16333 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:36.629120 18215 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:36.630316 18196 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.407s	user 0.003s	sys 0.000s
I20260709 13:06:36.617552 18112 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.602983 18126 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.611424 18043 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.612032 18044 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.634629 18126 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.635931 18126 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.607561 18099 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.602034 17907 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.606503 18114 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.641263 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1411) took 1047 ms. Trace:
I20260709 13:06:36.618692 18154 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:36.618773 18209 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.648686 18209 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.648334 15641 rpcz_store.cc:276] 0709 13:06:35.594080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.594215 (+   135us) service_pool.cc:224] Handling call
0709 13:06:35.594574 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.594983 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.595031 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.621927 (+ 26896us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.032838 (+410911us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:36.032897 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.032992 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.640958 (+607966us) raft_consensus.cc:1685] finished
0709 13:06:36.640996 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.641166 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":523,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":13686,"thread_start_us":327307,"threads_started":1,"wal-append.queue_time_us":473927}
I20260709 13:06:36.479660 18119 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.612099 18104 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:36.649996 18209 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.687695 18209 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.687507 18104 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.645953 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:36.651882 18078 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.651966 17969 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:36.655547 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:36.605675 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.687991 17729 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.652894 18107 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.693147 16329 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.725394 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:36.749609 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:36.774744 15646 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:36.775377 15789 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
W20260709 13:06:36.703883 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 96361.3us
W20260709 13:06:36.766094 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.764945 16329 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:36.774715 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 195831us
I20260709 13:06:36.749321 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:36.779372 15796 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:36.778601 15788 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:36.703495 18107 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.590130 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:36.798146 16334 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:36.798614 16334 pending_rounds.cc:85] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 6
I20260709 13:06:36.800412 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:36.746698 18218 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.410s	user 0.010s	sys 0.042s
I20260709 13:06:36.801267 15795 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:36.799238 15759 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.691926 18078 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:36.725576 17969 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.804549 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.810681 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.747219 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:36.747557 18044 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:36.805012 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:36.798851 16334 pending_rounds.cc:107] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:36.823318 16334 raft_consensus.cc:2889] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:36.824198 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:36.800228 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:36.831910 18206 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.832260 15787 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:36.838395 18206 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.703786 18154 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:06:36.821112 17969 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.810372 18020 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.803268 16327 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:36.842136 18107 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.851559 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:36.864131 18221 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
I20260709 13:06:36.866400 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:36.868037 18152 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.868597 18152 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:36.869588 18152 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.873306 17969 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:36.876822 16332 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:36.897212 16325 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 3: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:36.922928 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:36.923322 15722 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.924121 15713 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:36.852062 18114 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:36.926635 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:36.934093 15718 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:36.841394 18206 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:36.961580 18078 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:36.963037 18078 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.965920 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:36.966696 18222 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.329s	user 0.002s	sys 0.001s
I20260709 13:06:36.966899 18071 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:36.967511 18071 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:36.977047 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 135281us
I20260709 13:06:36.983355 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.989616 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.992223 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:36.969388 18107 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.994139 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:36.968456 18020 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:36.995913 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:36.998847 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:37.000627 15643 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:36.999078 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:37.001714 15715 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.986931 18154 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:37.067194 15641 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.993592 18204 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:37.079980 15713 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.080025 15722 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:37.073710 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.099714 18078 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:37.100538 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.107075 15788 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.101181 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:36.995580 18220 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.131637 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:37.067195 18208 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:37.142001 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.145676 16332 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:37.146890 15722 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:37.082384 18192 ts_tablet_manager.cc:1916] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:06:37.121040 18212 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.657s	user 0.011s	sys 0.006s
I20260709 13:06:37.148275 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:37.149189 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:37.152417 15642 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:37.102960 18128 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.154820 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.155511 15793 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:37.157333 15643 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.164541 15641 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:37.167101 15639 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
W20260709 13:06:37.167753 18223 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:06:37.102640 18143 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:06:37.145970 18214 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.138000 18204 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:37.181787 15788 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:37.184651 15715 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
W20260709 13:06:37.197319 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.175585 18181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.000s
W20260709 13:06:37.244866 18100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.015s	sys 0.019s
W20260709 13:06:37.245486 18100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.015s	sys 0.019s
I20260709 13:06:37.246946 15640 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:37.152002 18220 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:37.193849 18112 consensus_meta.cc:287] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.558s	user 0.015s	sys 0.008s
I20260709 13:06:37.202483 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.162045 18128 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.148770 18071 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.263789 15790 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:37.263619 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 196104us
W20260709 13:06:37.207078 18181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.009s	sys 0.000s
W20260709 13:06:37.267180 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.269133 18195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.015s	sys 0.045s
W20260709 13:06:37.278366 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 282524us
W20260709 13:06:37.264617 18141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.011s	sys 0.021s
I20260709 13:06:37.280153 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:37.267524 16325 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:37.285115 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.279536 18195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.015s	sys 0.045s
I20260709 13:06:37.190402 18214 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.293160 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:37.294450 16329 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:37.283332 18141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.011s	sys 0.022s
I20260709 13:06:37.288395 18154 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:37.202215 18020 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:37.283093 17899 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:06:37.332922 17907 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.011s
I20260709 13:06:37.348194 17907 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.350145 15685 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:37.362305 15788 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:37.363502 18228 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.356s	user 0.001s	sys 0.001s
I20260709 13:06:37.366914 18231 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:06:37.309685 18204 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.368633 18241 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:37.368780 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.369294 18241 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:37.370226 18241 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.370795 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:37.371289 18216 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.719s	user 0.005s	sys 0.000s
W20260709 13:06:37.372255 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.372735 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.374846 18100 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:37.311110 18154 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:37.373672 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:37.375341 18100 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.330965 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:37.387768 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.390399 15791 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:37.385022 17899 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:37.391835 16326 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:37.392611 18245 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.393844 18220 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:37.393523 18245 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.397511 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:37.386607 18144 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.008s
I20260709 13:06:37.367000 17907 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:37.433429 15611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.013s
I20260709 13:06:37.430181 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 576) took 1300 ms. Trace:
W20260709 13:06:37.434090 15611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.005s	sys 0.013s
I20260709 13:06:37.383778 18128 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:37.388674 18100 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.437568 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.442310 15791 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:37.437089 18126 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.801s	user 0.014s	sys 0.005s
I20260709 13:06:37.448410 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.448863 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:37.449090 15795 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:37.449419 15714 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.404760 18245 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:37.434526 16330 rpcz_store.cc:276] 0709 13:06:35.986986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.989571 (+  2585us) service_pool.cc:224] Handling call
0709 13:06:35.990000 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.097414 (+107414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.097458 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.186543 (+ 89085us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.306022 (+119479us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:36.306089 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.306220 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.309375 (+  3155us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4800043758. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:06:37.068950 (+759575us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:37.287682 (+218732us) raft_consensus.cc:1685] finished
0709 13:06:37.287704 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.287844 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4789,"raft.run_cpu_time_us":4052,"raft.run_wall_time_us":314279,"spinlock_wait_cycles":312018048,"thread_start_us":189300,"threads_started":2,"wal-append.queue_time_us":130790}
I20260709 13:06:37.456965 17907 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:37.461701 18104 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:37.464510 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:37.534651 18252 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:37.441521 17899 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:37.455488 18206 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:37.540774 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.462803 15718 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:37.561640 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.570500 15714 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:37.520800 15791 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:06:37.455054 18109 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.519486 18245 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:37.536511 18154 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:37.578004 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 114378us
W20260709 13:06:37.578994 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 193135us
I20260709 13:06:37.581851 15795 raft_consensus.cc:2410] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:37.585716 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:37.581094 15718 pending_rounds.cc:85] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 1
I20260709 13:06:37.592680 15718 pending_rounds.cc:107] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:37.593070 15718 raft_consensus.cc:2889] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:37.589811 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.595522 15790 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.579149 18231 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:37.598976 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.591229 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:37.606241 18260 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:37.606731 18260 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.607052 18260 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:37.611584 18233 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.359s	user 0.000s	sys 0.002s
I20260709 13:06:37.614140 18231 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:37.616662 18231 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:37.618328 15790 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:37.599531 18206 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:37.604847 18107 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.006s
W20260709 13:06:37.616650 18229 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:06:37.634060 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.635103 18115 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:37.636938 18262 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.638577 18236 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 13:06:37.625325 18220 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:06:37.644902 18099 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:37.618371 18258 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:37.591171 18109 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:37.651678 18253 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.293s	user 0.003s	sys 0.000s
I20260709 13:06:37.654209 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.655026 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.663055 15796 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:37.721437 15795 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:37.631518 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:37.722251 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 90859.3us
W20260709 13:06:37.674296 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.723892 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.727478 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.669154 18206 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:37.740823 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:06:37.741525 15790 raft_consensus.cc:606] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:37.741874 15790 raft_consensus.cc:614] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:37.724277 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1418837229999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25910000000000005s for a response
I20260709 13:06:37.745669 15794 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.747001 15715 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:37.743026 18263 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:06:37.761162 18154 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:37.762017 18265 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.761845 18154 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.762559 18265 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.763320 18044 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.763784 18044 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.762876 18210 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:37.672356 18262 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.675093 17899 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:37.814599 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:38.101647 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 333833us
I20260709 13:06:38.101907 15792 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:37.829077 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:37.973874 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.102864 15790 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.814393 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.815070 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:38.105003 15795 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:06:38.105438 15795 pending_rounds.cc:85] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 2
I20260709 13:06:38.105671 15795 pending_rounds.cc:107] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:06:38.106099 15795 raft_consensus.cc:2889] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:37.796439 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:37.815706 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:38.107582 15796 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:38.108259 15610 connection.cc:256] RPC call timeout handler was delayed by -1.9259738179999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:06:38.108705 15610 connection.cc:256] RPC call timeout handler was delayed by -1.5830738180000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:06:37.815274 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:37.980195 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 252744us
I20260709 13:06:38.110060 15791 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:38.118038 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.755807 18255 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:06:38.124020 18119 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.949071 18240 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.693s	user 0.000s	sys 0.002s
I20260709 13:06:38.126149 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:37.960959 18251 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.593s	user 0.000s	sys 0.002s
I20260709 13:06:37.889006 18219 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.085160 18143 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.764691 18265 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:37.834510 18225 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.078172 17907 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:38.155036 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.764782 18154 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:37.783352 18109 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.149940 15790 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:38.125340 18115 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.124516 18112 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.158813 15639 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.004961 18192 ts_tablet_manager.cc:1929] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:38.124320 18220 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:38.160890 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:38.158116 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:38.162322 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:38.157809 18126 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.165454 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:38.136809 18111 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.161595 18225 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.136746 18104 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.132449 18258 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.170679 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:38.170928 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:37.779572 18100 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:37.789206 18260 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.203879 15789 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:38.203992 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:38.205920 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:38.206178 15788 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:38.155354 17907 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:38.134290 18119 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.205140 18044 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:38.221096 15642 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:38.223825 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:37.781008 18206 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.224479 15789 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:38.161108 18214 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.133306 18210 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.212009 15716 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:38.140771 18219 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.215764 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 355) took 1225 ms. Trace:
I20260709 13:06:38.230476 15720 rpcz_store.cc:276] 0709 13:06:36.990627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.990780 (+   153us) service_pool.cc:224] Handling call
0709 13:06:37.071085 (+ 80305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.313819 (+242734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.313871 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.314629 (+   758us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.356978 (+ 42349us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:37.357033 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.357127 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.460737 (+103610us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:06:38.211227 (+750490us) raft_consensus.cc:1685] finished
0709 13:06:38.211249 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.215712 (+  4463us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26054,"raft.run_cpu_time_us":2658,"raft.run_wall_time_us":283774,"spinlock_wait_cycles":7678208,"thread_start_us":199203,"threads_started":2,"wal-append.queue_time_us":111327}
I20260709 13:06:38.231652 15789 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:38.215749 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:38.212167 15641 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:38.211463 18192 log.cc:1199] T 17db433a32844f26aa2fe7c2d4e4bf66 P c1927141dc2540dab644a00fd6843fc6: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/wals/17db433a32844f26aa2fe7c2d4e4bf66
I20260709 13:06:38.217008 15643 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:38.228693 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:38.228863 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:38.230213 15639 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:38.233048 15789 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:38.233640 15788 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:38.166239 18112 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.238500 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:38.163545 18115 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.276355 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:38.221179 18232 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.925s	user 0.001s	sys 0.002s
I20260709 13:06:38.278774 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:38.281338 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2265) took 1405 ms. Trace:
I20260709 13:06:38.294457 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.295866 15720 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:38.290375 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.296921 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.207657 18220 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.298489 15645 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:38.290866 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.232054 18044 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:06:38.294396 15717 rpcz_store.cc:276] 0709 13:06:36.875957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.876106 (+   149us) service_pool.cc:224] Handling call
0709 13:06:36.918851 (+ 42745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.921364 (+  2513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.921414 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.922081 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.316380 (+394299us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:37.316469 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.316581 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.958309 (+641728us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:38.228063 (+269754us) raft_consensus.cc:1685] finished
0709 13:06:38.228086 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.281226 (+ 53140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12756,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":24329,"spinlock_wait_cycles":15395200,"thread_start_us":392746,"threads_started":1,"wal-append.queue_time_us":392517}
I20260709 13:06:38.210363 18111 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.273286 18107 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.330224 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.343192 15720 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:38.241714 18214 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:38.214267 18258 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.272751 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1858) took 1188 ms. Trace:
I20260709 13:06:38.326843 17975 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.337597 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:38.338498 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.338752 18285 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.308662 18283 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.340193 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 178880us
I20260709 13:06:38.227114 18126 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.354759 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.359830 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.362419 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:38.370194 18285 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.370724 18294 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.373910 15721 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:38.348851 18280 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.380621 15720 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:38.381814 15721 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:38.376291 18241 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.306224 17907 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.364485 18265 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.371536 18294 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.349557 18214 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.380874 18285 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:38.479223 15644 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:38.355553 17975 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.342202 18286 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:06:38.379822 18271 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:38.423170 18241 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.358892 18283 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.509953 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:38.483525 18265 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.490810 17907 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.530752 15789 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:38.547376 18112 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.548255 18112 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.548836 18112 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:38.550422 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 323990us
I20260709 13:06:38.552660 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.538255 15721 raft_consensus.cc:2955] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:38.633245 15717 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:38.511492 18241 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:38.639508 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67496.8us
I20260709 13:06:38.640551 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:38.385913 18280 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.531371 18265 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.656955 18301 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.657575 18301 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.658025 18301 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.547348 18297 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.667673 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 297136us
I20260709 13:06:38.669818 16334 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:38.674587 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:38.665413 18272 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:06:38.675354 16334 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:38.678465 16332 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:06:38.681094 18276 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:06:38.348596 15787 rpcz_store.cc:276] 0709 13:06:37.084241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.584008 (+499767us) service_pool.cc:224] Handling call
0709 13:06:37.584359 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.584740 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.584773 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.585261 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.061400 (+476139us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.076133 (+ 14733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.084468 (+  8335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.223819 (+139351us) raft_consensus.cc:1685] finished
0709 13:06:38.225985 (+  2166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.235011 (+  9026us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2404,"spinlock_wait_cycles":4152576,"thread_start_us":391703,"threads_started":1,"wal-append.queue_time_us":551007}
I20260709 13:06:38.676054 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:38.669011 18192 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56118 (request call id 74) took 3039 ms. Trace:
I20260709 13:06:38.511873 18271 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.714119 18280 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.736214 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:38.696240 18297 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.888391 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.760995 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.823408 15719 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:38.897410 15722 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:38.737892 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:38.900744 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 260251us
I20260709 13:06:38.741847 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1418) took 1752 ms. Trace:
I20260709 13:06:38.905321 15640 rpcz_store.cc:276] 0709 13:06:36.989216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.989414 (+   198us) service_pool.cc:224] Handling call
0709 13:06:36.992054 (+  2640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.247481 (+255427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.741499 (+1494018us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001be4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:38.741763 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585439616}
I20260709 13:06:38.906538 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2279) took 1312 ms. Trace:
I20260709 13:06:38.908587 17899 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:38.908849 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 174087us
W20260709 13:06:38.893635 18234 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.602s	user 0.004s	sys 0.001s
W20260709 13:06:38.878181 18287 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:06:38.891742 18219 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:38.909528 15647 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.008s
I20260709 13:06:38.910032 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:38.927078 15647 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.009s
I20260709 13:06:38.710700 18111 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:38.911774 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:38.736856 18274 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 13:06:38.918352 15714 rpcz_store.cc:276] 0709 13:06:37.594404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.594547 (+   143us) service_pool.cc:224] Handling call
0709 13:06:37.595118 (+   571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.605330 (+ 10212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.605351 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.612907 (+  7556us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.549495 (+936588us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b180046b100. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:06:38.695875 (+146380us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:38.695917 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.695991 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.906083 (+210092us) raft_consensus.cc:1685] finished
0709 13:06:38.906121 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.906456 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":984,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2651,"spinlock_wait_cycles":12239232,"thread_start_us":146173,"threads_started":1,"wal-append.queue_time_us":1291365}
I20260709 13:06:38.737608 18302 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.798395 18235 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 1.440s	user 0.000s	sys 0.006s
W20260709 13:06:38.912070 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.790783 18281 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:06:38.734198 18071 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.717001 18210 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:38.716208 18115 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.935155 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:38.935573 15717 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:38.799188 17975 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.927963 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:38.930500 18078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.779s	user 0.000s	sys 0.012s
W20260709 13:06:38.928205 18208 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.742s	user 0.010s	sys 0.007s
W20260709 13:06:38.939008 18249 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.681s	user 0.011s	sys 0.029s
I20260709 13:06:38.768699 18258 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:38.782330 18100 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:38.945832 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.955250 15688 connection.cc:256] RPC call timeout handler was delayed by -1.7749361319998798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:06:38.967794 15688 connection.cc:256] RPC call timeout handler was delayed by -1.7335146469999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:06:38.968159 15688 connection.cc:256] RPC call timeout handler was delayed by -1.7254146469999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:06:38.926614 17899 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:06:38.946601 18044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.005s	sys 0.014s
W20260709 13:06:38.957134 15760 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.525s (SENT) [suppressed 45 similar messages]
W20260709 13:06:38.956089 18078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.808s	user 0.000s	sys 0.013s
I20260709 13:06:38.949822 18225 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:38.958020 18112 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:38.947365 18302 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.966843 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:38.964936 18208 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.785s	user 0.010s	sys 0.007s
W20260709 13:06:38.970155 18044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.015s
I20260709 13:06:38.956009 18210 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.944515 18265 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:38.974583 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:38.992167 15688 leader_election.cc:336] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.785s (SENT)
I20260709 13:06:38.954563 18071 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:38.972788 18214 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:38.972537 18078 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:38.989233 18208 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:39.007860 15714 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:39.012943 18078 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.015187 15717 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:39.002915 18294 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:39.021981 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 96409.8us
W20260709 13:06:39.023332 15688 leader_election.cc:336] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.992s (SENT)
I20260709 13:06:39.023965 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:39.000783 18283 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:38.715837 18192 rpcz_store.cc:276] 0709 13:06:35.626584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.630152 (+  3568us) service_pool.cc:224] Handling call
0709 13:06:36.243359 (+613207us) ts_tablet_manager.cc:1151] Deleting tablet 17db433a32844f26aa2fe7c2d4e4bf66
0709 13:06:36.259747 (+ 16388us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:37.792191 (+1532444us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:38.004796 (+212605us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:38.652050 (+647254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1278,"tablet-delete.queue_time_us":523576,"thread_start_us":316214,"threads_started":1}
W20260709 13:06:39.044636 17907 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.003s
I20260709 13:06:38.998736 18241 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:39.045377 18246 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.796s	user 0.000s	sys 0.003s
I20260709 13:06:39.047446 18241 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.040311 17899 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:39.006810 18309 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.048861 18265 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.050030 15717 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:39.056876 18297 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:39.058669 18208 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.061285 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:39.038754 18294 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:39.067634 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60052.3us
W20260709 13:06:39.074527 15688 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.025s (SENT)
W20260709 13:06:39.075413 15688 connection.cc:256] RPC call timeout handler was delayed by -1.5760146469999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23700000000000002s for a response
W20260709 13:06:39.076166 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.077600 15718 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:39.061049 18104 consensus_meta.cc:287] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.004s
I20260709 13:06:39.083853 15717 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:39.059402 18302 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:39.084581 18204 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.105921 18126 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.107743 18308 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:39.108532 18308 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.110564 18071 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:39.084710 18104 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.111964 18308 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.117166 18320 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:39.118007 18320 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.121973 18316 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.123054 18316 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.123485 18316 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:39.124437 18316 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:39.126003 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 778218us
I20260709 13:06:39.130508 18320 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.134641 18316 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:39.136729 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.105715 18301 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.083496 18294 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.052495 18309 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.106081 18204 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:39.142269 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 779847us
I20260709 13:06:39.219491 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:39.220880 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:39.222292 18126 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:39.223673 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 85982us
W20260709 13:06:39.143389 15688 connection.cc:256] RPC call timeout handler was delayed by -1.4131127129999186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:06:39.228231 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1791336750000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2723s for a response
W20260709 13:06:39.168112 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.236066 18111 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.236792 18111 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.238076 17899 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:39.238878 17899 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.247371 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.247840 18126 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:39.248128 15640 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:39.248320 18126 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.248718 18126 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:39.249428 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.250411 15646 raft_consensus.cc:2410] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:39.254565 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.257145 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.257892 15645 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.263020 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.245474 15688 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.777s (SENT)
W20260709 13:06:39.268151 16298 connection.cc:256] RPC call timeout handler was delayed by -1.1585348709999153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:06:39.268693 16298 connection.cc:256] RPC call timeout handler was delayed by -1.1423348709998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:06:39.270534 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 313425us
I20260709 13:06:39.270638 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:39.275219 15716 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:39.278746 15722 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:39.390793 15688 leader_election.cc:336] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.831s (SENT)
W20260709 13:06:39.388899 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 118311us
I20260709 13:06:39.280786 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:39.389976 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.393987 15641 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:39.390769 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.359649 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.343953 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.263238 18204 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.402997 15640 raft_consensus.cc:2410] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:39.403430 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:39.404888 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1297) took 1039 ms. Trace:
I20260709 13:06:39.405520 15717 rpcz_store.cc:276] 0709 13:06:38.365442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.090637 (+725195us) service_pool.cc:224] Handling call
0709 13:06:39.115593 (+ 24956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.115932 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:39.116492 (+   560us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.404424 (+287932us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.404501 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:39.404563 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.404654 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.404816 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":154,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":213032,"threads_started":1}
I20260709 13:06:39.269141 18320 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.409698 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.266279 17899 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.409634 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.414816 15642 raft_consensus.cc:2376] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7. Re-sending same reply.
I20260709 13:06:39.416638 15713 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:39.325245 18262 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:39.389354 18315 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.410669 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:39.423610 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.429234 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:39.432520 15642 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
W20260709 13:06:39.434559 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 43790.4us
W20260709 13:06:39.435593 15688 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.862s (SENT)
I20260709 13:06:39.436604 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:39.438380 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.455042 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.414636 18111 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:39.456900 15642 raft_consensus.cc:2376] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4. Re-sending same reply.
I20260709 13:06:39.456959 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:39.416106 18104 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.460762 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:39.467554 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.468713 15641 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:39.416677 18320 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.456714 18295 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:06:39.494426 18104 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:39.498562 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.491156 15721 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:39.503760 18237 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 2.257s	user 0.004s	sys 0.003s
I20260709 13:06:39.506096 18294 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:39.516830 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 124850us
I20260709 13:06:39.517513 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:39.511113 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 75519.6us
I20260709 13:06:39.516393 18104 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.526388 18301 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:39.507575 18325 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:06:39.507758 18324 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:06:39.531400 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.532218 15642 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:39.520023 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.530205 15721 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:39.538731 15688 leader_election.cc:336] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.887s (SENT)
I20260709 13:06:39.539287 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:39.552023 15645 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
W20260709 13:06:39.566594 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.592262 18044 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:39.561467 18323 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:39.550799 18315 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:39.609508 15642 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:06:39.624042 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 85336.5us
I20260709 13:06:39.625361 15645 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:39.625703 15688 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.017s (SENT)
I20260709 13:06:39.626267 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:39.627406 15688 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.195s (SENT)
I20260709 13:06:39.629928 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1441) took 1411 ms. Trace:
I20260709 13:06:39.632997 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.634347 15645 raft_consensus.cc:2376] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4. Re-sending same reply.
W20260709 13:06:39.627127 18230 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 2.367s	user 0.007s	sys 0.003s
W20260709 13:06:39.639272 15688 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.204s (SENT)
W20260709 13:06:39.639798 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.622999 18315 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:39.643044 15688 leader_election.cc:336] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.370s (SENT)
I20260709 13:06:39.633293 15647 rpcz_store.cc:276] 0709 13:06:38.218576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.221515 (+  2939us) service_pool.cc:224] Handling call
0709 13:06:38.222010 (+   495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:38.285560 (+ 63550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.285619 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:38.288115 (+  2496us) log.cc:844] Serialized 52 byte log entry
0709 13:06:38.361333 (+ 73218us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:38.927564 (+566231us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.622017 (+694453us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.629570 (+  7553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.629680 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.629719 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:39.629730 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.629872 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1056393,"prepare.queue_time_us":701168,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4922,"raft.queue_time_us":364285,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":6569,"thread_start_us":1136881,"threads_started":4,"wal-append.queue_time_us":227807}
I20260709 13:06:39.630455 18206 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.631022 18078 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.647716 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:39.662380 18327 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:06:39.667763 15647 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:39.668473 18320 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:39.669148 18320 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.669775 18320 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.649432 18314 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.689026 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 589) took 3041 ms. Trace:
I20260709 13:06:39.689817 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.689630 16333 rpcz_store.cc:276] 0709 13:06:36.644266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.644925 (+   659us) service_pool.cc:224] Handling call
0709 13:06:36.657951 (+ 13026us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:06:36.658147 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.658555 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.658604 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.659835 (+  1231us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.978530 (+318695us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:36.978593 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.978754 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.471219 (+2492465us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:39.685411 (+214192us) raft_consensus.cc:1685] finished
0709 13:06:39.685433 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.685578 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28125,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"spinlock_wait_cycles":222541952,"thread_start_us":318247,"threads_started":1,"wal-append.queue_time_us":491853}
I20260709 13:06:39.690884 15642 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:39.682977 18286 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.695233 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:39.699604 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 56646.6us
I20260709 13:06:39.700416 15647 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:39.704425 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2281) took 1931 ms. Trace:
I20260709 13:06:39.704905 15713 rpcz_store.cc:276] 0709 13:06:37.773618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.773789 (+   171us) service_pool.cc:224] Handling call
0709 13:06:37.774134 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.417154 (+1643020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.704142 (+286988us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001e7b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:39.704352 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3775974272}
I20260709 13:06:39.707758 17907 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:39.708549 17907 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:39.709283 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:39.710570 17729 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.710678 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:39.711103 17729 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.711524 17729 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.711638 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:39.712739 18245 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:39.713645 18301 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:39.714145 18301 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.714255 18245 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:39.714581 18301 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.714704 18245 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:39.715186 18245 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:39.709131 18258 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.724472 18258 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:39.724836 18244 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 2.479s	user 0.007s	sys 0.000s
I20260709 13:06:39.718281 18286 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.725430 18258 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:39.709367 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.727532 18286 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:39.728016 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.734431 18126 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.726790 18258 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.737164 18126 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:39.739784 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:39.740547 18342 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:06:39.741662 18336 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:39.697446 18104 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.743942 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:39.751742 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:39.751775 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:39.754033 18316 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.619s	user 0.001s	sys 0.011s
I20260709 13:06:39.697321 18314 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:39.755125 18314 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:39.757807 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:39.759914 18271 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:39.802752 18314 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:39.813584 18320 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:39.952052 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1440) took 1733 ms. Trace:
I20260709 13:06:39.952545 15638 rpcz_store.cc:276] 0709 13:06:38.218245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.219538 (+  1293us) service_pool.cc:224] Handling call
0709 13:06:38.219883 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:38.220277 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.220305 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:38.220904 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:06:38.912578 (+691674us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800364ea0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:06:39.114253 (+201675us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800364ea0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad292da58f 00007fad22319571 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd
0709 13:06:39.950884 (+836631us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b1800364ea0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1
0709 13:06:39.951094 (+   210us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:39.951475 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.951687 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.951774 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.951817 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:39.951831 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.951982 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10976,"prepare.queue_time_us":234,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":120,"raft.queue_time_us":12548,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":37841,"spinlock_wait_cycles":53269120,"thread_start_us":69570,"threads_started":1,"wal-append.queue_time_us":65158}
I20260709 13:06:39.957767 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.958505 15638 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
W20260709 13:06:39.960199 15760 connection.cc:256] RPC call timeout handler was delayed by -1.214446394000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2937s for a response
I20260709 13:06:39.962016 18350 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.962649 18350 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.965723 18350 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:39.966604 18350 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.967140 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.970541 15638 raft_consensus.cc:2410] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:39.970121 18350 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.971508 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:39.972249 15638 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:39.972751 18350 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:39.973176 15638 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:39.979480 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.982342 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.984308 18350 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:39.984603 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:39.985085 18350 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.985971 18351 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.987888 18352 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.988435 18350 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:39.990983 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:39.993033 18350 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.994724 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:39.995728 18350 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.996170 18350 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.996544 18350 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.998521 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.003806 18352 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.005775 18351 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:40.006927 18350 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.007777 18352 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.008309 18352 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:40.009694 18350 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.009469 18352 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.016172 18353 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:40.019636 18350 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:40.077150 18245 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.079737 18245 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.110888 15642 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
W20260709 13:06:40.408898 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.010s	sys 0.030s
W20260709 13:06:40.409382 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.030s
W20260709 13:06:40.409686 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 696448us
W20260709 13:06:40.410455 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.411214 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.411774 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.412748 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.429600 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.430243 15688 leader_election.cc:336] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.040s (SENT)
I20260709 13:06:40.430680 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.431401 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1864) took 3338 ms. Trace:
I20260709 13:06:40.431445 18154 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:40.431767 15688 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.042s (SENT)
I20260709 13:06:40.432320 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:06:40.433091 16298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.017s	sys 0.013s
I20260709 13:06:40.433148 18154 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:40.433405 15688 leader_election.cc:336] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.068s (SENT)
I20260709 13:06:40.431850 15794 rpcz_store.cc:276] 0709 13:06:37.092605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.093000 (+   395us) service_pool.cc:224] Handling call
0709 13:06:37.093475 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.746203 (+652728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.431131 (+2684928us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b540047a9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:40.431296 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499339136}
W20260709 13:06:40.433540 16298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.017s	sys 0.013s
W20260709 13:06:40.449002 17729 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.004s
I20260709 13:06:40.450213 17729 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.453583 17729 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.465363 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2272) took 3025 ms. Trace:
I20260709 13:06:40.465823 15715 rpcz_store.cc:276] 0709 13:06:37.440411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.440628 (+   217us) service_pool.cc:224] Handling call
0709 13:06:37.441044 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.747433 (+306389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.465078 (+2717645us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540026c0d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:40.465274 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703126400}
I20260709 13:06:40.467113 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.479707 15641 raft_consensus.cc:2368] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6.
I20260709 13:06:40.481011 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 251) took 1006 ms. Trace:
I20260709 13:06:40.481280 15641 rpcz_store.cc:276] 0709 13:06:39.474349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.509962 (+ 35613us) service_pool.cc:224] Handling call
0709 13:06:40.480810 (+970848us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b540028a354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:40.480929 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164945664}
W20260709 13:06:40.494524 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 732215us
W20260709 13:06:40.495699 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.496455 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:40.496765 18328 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.497321 18328 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.498682 18315 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.499370 18328 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:40.499249 18340 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.502969 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:40.503684 15720 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.009s	sys 0.019s
W20260709 13:06:40.505102 15720 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.009s	sys 0.019s
I20260709 13:06:40.506193 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2290) took 1235 ms. Trace:
I20260709 13:06:40.506496 15720 rpcz_store.cc:276] 0709 13:06:39.270864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.671324 (+400460us) service_pool.cc:224] Handling call
0709 13:06:39.671677 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.671881 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:40.505523 (+833642us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.505765 (+   242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.505824 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:40.505890 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.505981 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.506115 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243277,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"thread_start_us":821682,"threads_started":1}
I20260709 13:06:40.507650 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.503638 15794 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:40.508690 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.512231 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.513052 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.513846 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.514586 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.515020 15720 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:40.515297 18119 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.515622 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.516785 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.517975 18320 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:40.518560 18320 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.519678 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:40.520925 18320 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:40.522157 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.524101 15792 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:40.517760 15720 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.527238 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:40.531598 16298 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:40.533856 15720 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:40.534243 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:40.539621 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.540258 18320 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:40.540853 18320 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.541386 18320 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:40.543610 16300 connection.cc:256] RPC call timeout handler was delayed by -2.8894857010000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 13:06:40.543728 18119 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:40.546558 16300 connection.cc:256] RPC call timeout handler was delayed by -2.8885857010000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:06:40.547646 16300 connection.cc:256] RPC call timeout handler was delayed by -2.8849857010000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:06:40.547894 18328 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:40.548446 16300 connection.cc:256] RPC call timeout handler was delayed by -2.8408857009999338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:06:40.549492 16300 connection.cc:256] RPC call timeout handler was delayed by -2.7301857009999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:06:40.550627 16300 connection.cc:256] RPC call timeout handler was delayed by -2.696885701000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:06:40.551285 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:40.551648 16300 connection.cc:256] RPC call timeout handler was delayed by -2.554608112999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:06:40.551987 16300 connection.cc:256] RPC call timeout handler was delayed by -2.5060081130000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:06:40.552261 16300 connection.cc:256] RPC call timeout handler was delayed by -2.4786958690000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:06:40.552482 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.535152 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:40.552551 16300 connection.cc:256] RPC call timeout handler was delayed by -2.4745857010000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 13:06:40.573441 16300 connection.cc:256] RPC call timeout handler was delayed by -2.3557213509999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:06:40.576450 16300 connection.cc:256] RPC call timeout handler was delayed by -2.3040958690000934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 13:06:40.553539 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.573922 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2289) took 1305 ms. Trace:
I20260709 13:06:40.580008 18308 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:40.570935 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.579213 18354 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:40.552943 15647 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:40.580564 18308 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.579241 18100 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:40.580463 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.561316 18044 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:40.571421 18119 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:40.583120 18044 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.583459 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.584185 15713 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:40.585119 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.582167 18100 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.585702 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.587003 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.588203 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.588981 15713 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:40.589087 15720 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:40.590365 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.580094 15721 rpcz_store.cc:276] 0709 13:06:39.268647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.538633 (+269986us) service_pool.cc:224] Handling call
0709 13:06:39.538930 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.556944 (+ 18014us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:39.585337 (+ 28393us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.649374 (+ 64037us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.649544 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.649587 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:39.649628 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.559568 (+909940us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b180046ac20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:06:40.573628 (+ 14060us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5400096854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:40.573680 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.573864 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37774,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":1036,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":1013,"spinlock_wait_cycles":59317504,"thread_start_us":63336,"threads_started":1,"wal-append.queue_time_us":111319}
I20260709 13:06:40.591459 15720 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:40.591435 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.556777 18328 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:40.592439 18260 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:40.593015 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.583710 18119 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.581045 18354 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:40.594795 15721 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:40.578812 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:40.595582 16300 connection.cc:256] RPC call timeout handler was delayed by -1.5752162210000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:06:40.596416 18354 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.597069 16333 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:40.597332 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.597932 15720 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.598469 18020 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.599570 18210 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:40.600265 18210 consensus_queue.cc:1243] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:40.597911 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.603446 15721 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:40.604276 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.605609 18044 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:40.607944 18210 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.608484 18210 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.610927 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.606799 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.618767 18114 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.619213 18114 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.619609 18114 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:40.624145 18301 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.909s	user 0.013s	sys 0.008s
W20260709 13:06:40.631067 15716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1287) took 2398 ms (client timeout 2128 ms). Trace:
I20260709 13:06:40.637851 15720 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:40.632975 18020 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.624728 18301 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.644001 18301 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.634364 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.644786 15647 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
W20260709 13:06:40.638055 15716 rpcz_store.cc:269] 0709 13:06:38.232490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.278473 (+ 45983us) service_pool.cc:224] Handling call
0709 13:06:40.630830 (+2352357us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540017c0d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:40.630959 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879799040}
I20260709 13:06:40.635155 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.635522 15717 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:40.639742 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.649444 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.639954 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.650250 15647 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:40.642002 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.650920 15641 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:06:40.651525 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.652143 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.652933 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.653398 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.647864 18114 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.655143 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.670811 15641 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:40.654968 18346 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.672022 18346 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.672736 18346 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.655555 16326 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:40.655759 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:40.674108 15647 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.674845 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:40.676909 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1308) took 1790 ms. Trace:
I20260709 13:06:40.676774 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.656378 18020 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.677964 18020 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:40.678028 16326 raft_consensus.cc:2410] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:40.677371 15714 rpcz_store.cc:276] 0709 13:06:38.886010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.934760 (+ 48750us) service_pool.cc:224] Handling call
0709 13:06:40.676689 (+1741929us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b540017acd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:40.676808 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131771648}
I20260709 13:06:40.656515 18301 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:40.679381 18301 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:40.679678 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.665856 18320 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.680306 18301 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.681219 16332 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:40.658473 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.682585 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.682894 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.658807 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.659202 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.684684 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:40.659592 18344 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:40.685254 15640 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.685541 18344 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:40.685983 18344 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:40.686473 18114 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.686885 18344 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.688205 18344 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.688794 15716 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:40.661016 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.662142 16328 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:40.662822 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.692162 15643 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:40.663515 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.666788 15638 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:40.684825 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.694358 15641 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:40.666059 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.680822 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.638821 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.696146 15720 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:40.658378 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.696973 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.698348 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.698523 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:40.699177 15791 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.699759 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.700398 18114 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.702207 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.707010 15714 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.678577 18020 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.711083 18114 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:40.715179 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2274) took 3270 ms. Trace:
I20260709 13:06:40.715616 15719 rpcz_store.cc:276] 0709 13:06:37.444385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.444601 (+   216us) service_pool.cc:224] Handling call
0709 13:06:37.458585 (+ 13984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.916852 (+1458267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.714945 (+1798093us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400384fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:40.715116 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134288256}
I20260709 13:06:40.716740 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.719097 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.720024 15638 raft_consensus.cc:2410] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:40.720590 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2280) took 2954 ms. Trace:
I20260709 13:06:40.720968 15718 rpcz_store.cc:276] 0709 13:06:37.766261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.766424 (+   163us) service_pool.cc:224] Handling call
0709 13:06:37.766775 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.078244 (+1311469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.720369 (+1642125us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003859d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:40.720536 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013921536}
I20260709 13:06:40.706393 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.724115 15716 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:40.724006 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.725412 15638 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:40.708254 18320 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:40.708971 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:40.726413 18100 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:40.702736 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.707490 15791 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:40.728713 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.729398 15638 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:40.730063 18114 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:40.730705 18286 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.708266 15640 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:40.731281 18286 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.732738 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:40.734584 18258 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:40.735327 18258 consensus_queue.cc:1243] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:40.735848 18331 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:40.736212 18331 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:40.737393 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:40.725548 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2295) took 1017 ms. Trace:
I20260709 13:06:40.741045 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:40.742383 16300 leader_election.cc:336] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.783s (SENT)
I20260709 13:06:40.743566 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:40.742465 18271 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.745200 18144 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.745607 18144 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:40.746044 18144 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:40.743871 16300 leader_election.cc:336] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.787s (SENT)
I20260709 13:06:40.749845 18286 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:40.751367 16300 leader_election.cc:336] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.810s (SENT)
I20260709 13:06:40.751425 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:40.752508 16300 leader_election.cc:336] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.836s (SENT)
I20260709 13:06:40.753202 15719 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:40.758301 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.761538 15647 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:06:40.740809 15716 rpcz_store.cc:276] 0709 13:06:39.708501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.724809 (+1016308us) service_pool.cc:224] Handling call
0709 13:06:40.725104 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.725260 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.725285 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.725323 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:40.725354 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.725403 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.725498 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:40.775377 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:40.776258 15646 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.679400 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:40.780432 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:40.783452 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 49215.5us
I20260709 13:06:40.784720 15638 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.772570 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:40.783509 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63207.7us
I20260709 13:06:40.785473 15647 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.777429 18335 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.792245 15646 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:06:40.786579 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:40.754309 18320 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.834079 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:40.835556 18286 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:40.836334 18286 consensus_queue.cc:1243] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:40.836999 18286 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:40.837375 18286 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:40.838332 15719 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.838920 15719 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:40.840020 15719 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:40.843837 15688 leader_election.cc:336] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.595s (SENT)
I20260709 13:06:40.828399 15714 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:40.854091 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 67613.1us
I20260709 13:06:40.829649 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:40.832448 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:40.855634 15639 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:40.845194 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.852753 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 100279us
W20260709 13:06:40.856734 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.958s (SENT)
I20260709 13:06:40.856869 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:40.857239 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:40.858520 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.841586 15719 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.733294 18346 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.863481 15638 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:40.865581 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:40.882099 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.980s (SENT)
I20260709 13:06:40.884099 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.864791 18320 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:40.780280 18020 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.898098 15647 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:40.900533 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2294) took 1192 ms. Trace:
I20260709 13:06:40.880949 18328 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.904838 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:40.913471 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08002c42e0 after lost signal to thread 14516
W20260709 13:06:40.917924 15576 debug-util.cc:398] Leaking SignalData structure 0x7b080039dc20 after lost signal to thread 14519
W20260709 13:06:40.916462 16300 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.982s (SENT)
I20260709 13:06:40.919041 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.913664 18294 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:40.917523 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.890515 18282 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:40.924077 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 67278.6us
I20260709 13:06:40.906333 15718 rpcz_store.cc:276] 0709 13:06:39.707830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.721885 (+1014055us) service_pool.cc:224] Handling call
0709 13:06:40.722160 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.722356 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:40.722639 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.899385 (+176746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.899590 (+   205us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:40.899748 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.899979 (+   231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.900303 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7472,"prepare.queue_time_us":19413,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":11207,"thread_start_us":164921,"threads_started":1}
I20260709 13:06:40.793469 18331 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.911660 18320 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:40.915923 18378 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:40.937588 16300 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.996s (SENT)
I20260709 13:06:40.938340 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:40.915676 18286 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:40.944221 18286 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.946959 18020 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:40.947814 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.947638 18020 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:40.954648 16300 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.036s (SENT)
I20260709 13:06:40.927661 18335 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.958343 18331 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.961928 18328 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.965051 18346 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:40.925680 18282 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.970465 18320 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:40.972725 18308 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:40.974076 15719 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:40.974404 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:40.980165 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:40.965931 18378 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:40.991250 15721 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:41.003943 16326 raft_consensus.cc:2410] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:41.005683 18144 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.007809 18144 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:41.011803 18143 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:41.012383 18143 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.015013 18378 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:41.016112 18378 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:39.745236 18204 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.037875 18204 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:41.022359 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.041051 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.043198 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1436) took 2836 ms. Trace:
I20260709 13:06:41.043691 15644 rpcz_store.cc:276] 0709 13:06:38.206945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.207103 (+   158us) service_pool.cc:224] Handling call
0709 13:06:38.213829 (+  6726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.491433 (+277604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.042882 (+2551449us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000a9454. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:41.043104 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609761024}
I20260709 13:06:41.022790 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.046197 15647 raft_consensus.cc:2376] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5. Re-sending same reply.
I20260709 13:06:41.047168 15715 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:41.047282 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.023229 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.050524 15638 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:41.051465 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.052258 15638 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:41.052994 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.053125 15713 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:41.023490 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.055615 15641 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:41.023897 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.056509 15645 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 5. Ops: []
I20260709 13:06:41.056830 15640 raft_consensus.cc:2410] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:41.024130 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.057984 15639 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.058475 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1736) took 1417 ms. Trace:
I20260709 13:06:41.025725 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.059532 15643 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:41.058941 15645 rpcz_store.cc:276] 0709 13:06:39.641231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.641492 (+   261us) service_pool.cc:224] Handling call
0709 13:06:41.056306 (+1414814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.056969 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.058262 (+  1293us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000a9450. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:41.058412 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3252676480}
I20260709 13:06:41.022192 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.061259 15642 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.062304 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:41.062923 16330 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.049531 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1310) took 1331 ms. Trace:
I20260709 13:06:41.063520 15715 rpcz_store.cc:276] 0709 13:06:39.717956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.466818 (+748862us) service_pool.cc:224] Handling call
0709 13:06:41.049309 (+582491us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540017a2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:41.049435 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332397440}
I20260709 13:06:41.067593 15646 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:41.069769 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 188530us
W20260709 13:06:41.069904 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 212924us
I20260709 13:06:41.075889 15647 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:41.079933 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:41.082650 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.085291 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.088546 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.073843 18344 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:41.092068 15794 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.093662 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.062943 18286 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:41.100706 18143 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.101764 18344 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:41.104622 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.105476 16330 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:06:41.090030 18350 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.090699 18385 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.106698 18039 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.119355 18344 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:41.101634 18301 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:41.123518 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.130257 18383 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:41.139652 18383 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.140079 18383 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:41.140398 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.122195 18385 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.144315 18385 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.147801 18220 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:41.149188 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.150444 18350 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.151117 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:41.152640 15545 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 148) took 13182 ms (client timeout 15000 ms). Trace:
I20260709 13:06:41.157065 18282 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:41.158123 18328 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:41.159229 18328 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:41.159799 18328 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:41.161095 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.160828 18328 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:41.153095 15545 rpcz_store.cc:269] 0709 13:06:27.970559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.970804 (+   245us) service_pool.cc:224] Handling call
0709 13:06:41.152572 (+13181768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:36.130895 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:36.131852 (+   957us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:36.131915 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:06:36.131933 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:36.216414 (+ 84481us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:36.230632 (+ 14218us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:36.233698 (+  3066us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:36.425318 (+191620us) tablet.cc:701] Row locks acquired
0709 13:06:36.482944 (+ 57626us) write_op.cc:260] PREPARE: finished
0709 13:06:36.483135 (+   191us) write_op.cc:270] Start()
0709 13:06:36.483298 (+   163us) write_op.cc:276] Timestamp: P: 1783602396483064 usec, L: 0
0709 13:06:36.483318 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.484047 (+   729us) log.cc:844] Serialized 2100 byte log entry
0709 13:06:36.993914 (+509867us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad222fc0ac 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b
0709 13:06:37.617314 (+623400us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:38.224708 (+607394us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.542219 (+317511us) write_op.cc:301] APPLY: starting
0709 13:06:38.542353 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.542611 (+   258us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.542662 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:38.543801 (+  1139us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:38.544121 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:38.544206 (+    85us) write_op.cc:312] APPLY: finished
0709 13:06:38.544630 (+   424us) log.cc:844] Serialized 47 byte log entry
0709 13:06:38.544887 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.545026 (+   139us) write_op.cc:454] Released schema lock
0709 13:06:38.545115 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:39.748798 (+1203683us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b18003364c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad28e3cef0 00007fad28e3d489 00007fad28e3f71a
0709 13:06:39.748935 (+   137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:39.748983 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2253262,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":305979,"apply.run_cpu_time_us":3402,"apply.run_wall_time_us":3408,"num_ops":5,"prepare.queue_time_us":398077,"prepare.run_cpu_time_us":65984,"prepare.run_wall_time_us":1188258,"raft.queue_time_us":269873,"raft.run_cpu_time_us":17833,"raft.run_wall_time_us":1586680,"replication_time_us":1720999,"spinlock_wait_cycles":394128384,"thread_start_us":1475834,"threads_started":4,"wal-append.queue_time_us":817261,"wal-append.run_cpu_time_us":23203,"wal-append.run_wall_time_us":2241122}]]}
I20260709 13:06:41.162024 15641 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:41.162180 18328 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.162989 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.163602 15641 raft_consensus.cc:2376] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5. Re-sending same reply.
I20260709 13:06:41.164536 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.165195 15641 raft_consensus.cc:2368] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:06:41.167955 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.168584 15646 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.169101 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.171005 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.172155 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.172880 15645 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
W20260709 13:06:41.173367 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.166837 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.175035 15640 raft_consensus.cc:2368] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6.
I20260709 13:06:41.173657 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.185120 15646 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.186363 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.187335 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.156404 15540 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.188664 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.190533 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.191885 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.195807 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.196449 15640 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:41.195307 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:41.207727 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.217486 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.205794 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.222111 15646 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:41.199954 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.222842 15641 raft_consensus.cc:2376] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5. Re-sending same reply.
I20260709 13:06:41.188277 18291 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.196918 18379 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.194923 18039 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:41.190048 18220 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.189091 18020 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.195536 18350 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:41.236373 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.256644 15688 leader_election.cc:336] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.666s (SENT)
I20260709 13:06:41.257241 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:41.238638 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.255362 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1305) took 2388 ms. Trace:
I20260709 13:06:41.258880 15717 rpcz_store.cc:276] 0709 13:06:38.866688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.474935 (+608247us) service_pool.cc:224] Handling call
0709 13:06:40.635209 (+1160274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.648927 (+ 13718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.255145 (+606218us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540017c0d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:41.255297 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667540352}
I20260709 13:06:41.227229 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.261193 15640 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:41.242967 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.225618 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.248178 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.262737 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.263466 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.263752 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.246335 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.238535 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.266469 15646 raft_consensus.cc:2376] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
I20260709 13:06:41.267755 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.264865 15643 raft_consensus.cc:2376] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:41.234949 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.258719 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.284091 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.284822 15646 raft_consensus.cc:2376] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5. Re-sending same reply.
I20260709 13:06:41.285401 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.286844 15641 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:41.243749 18301 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.288803 17729 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.226959 18039 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:41.237115 18143 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:41.289582 15794 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.289978 18220 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:41.294325 18220 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:41.288861 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:41.296249 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.296283 15644 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.298200 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.298957 16334 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.299263 18290 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.300173 16334 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:06:41.237243 18264 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:41.305018 18286 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:41.295361 18220 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.298257 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.311769 15644 raft_consensus.cc:2368] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:41.295639 18309 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:41.314643 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58054.2us
W20260709 13:06:41.318061 15688 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.678s (SENT)
I20260709 13:06:41.251420 18379 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:41.253616 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:41.305593 18286 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:41.226645 18144 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.330205 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.330874 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.349159 15645 raft_consensus.cc:2376] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:41.331434 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.333129 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.337535 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:41.350944 15643 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:41.333690 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:41.321898 15688 leader_election.cc:336] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.771s (SENT)
I20260709 13:06:41.353276 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:41.341895 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1302) took 2627 ms (client timeout 2938 ms). Trace:
W20260709 13:06:41.344115 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.358973 15722 rpcz_store.cc:269] 0709 13:06:38.714867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.966505 (+251638us) service_pool.cc:224] Handling call
0709 13:06:41.341621 (+2375116us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540026d9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:41.341821 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680550144}
I20260709 13:06:41.258241 18350 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:41.317018 18239 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.350173 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:39.961331 15529 catalog_manager.cc:5028] TS c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): tablet 17db433a32844f26aa2fe7c2d4e4bf66 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:06:41.235119 18335 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:06:41.293196 18039 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.235239 18389 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:06:41.363092 15644 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:41.363162 15529 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.40183e+06us
I20260709 13:06:41.362093 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.357949 18264 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.361963 18020 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.362505 18371 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:06:41.327641 18385 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.366494 18296 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.374204 16325 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:41.374567 18302 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:41.375741 18330 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.780s	user 0.004s	sys 0.004s
I20260709 13:06:41.315644 18295 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:06:41.393317 15640 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.388731 18389 consensus_queue.cc:1243] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:41.363019 18350 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:41.420318 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.423689 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.425365 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:41.428234 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.403964 18264 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.362751 18309 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:41.442291 15641 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
W20260709 13:06:41.479600 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.463543 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:41.488379 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 253506us
W20260709 13:06:41.478917 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.490530 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.418233 18020 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.492446 15641 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.493628 16332 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.494194 18020 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:41.495299 15645 raft_consensus.cc:2368] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:41.496215 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.491685 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:41.496984 15645 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:41.442780 18371 consensus_queue.cc:1243] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:41.498834 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:41.499276 15792 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.499783 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:41.500064 18264 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.500602 15795 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:41.501506 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.502120 15793 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:41.425364 18355 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.496912 18294 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.487636 15794 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:41.503206 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:41.431293 15644 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:41.463210 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.504305 15793 raft_consensus.cc:2410] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:41.504536 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.505262 15644 raft_consensus.cc:2376] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
I20260709 13:06:41.491110 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.506254 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.506807 15644 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:41.507316 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.507572 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.508479 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.508631 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.427837 18379 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:41.510710 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:41.511679 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.511992 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:41.512219 15791 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.512777 15788 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.512722 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.511715 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.443629 18302 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.512271 15790 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:41.504436 16334 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:41.520766 15794 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:41.509683 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.523036 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.523355 15639 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:06:41.524192 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.524335 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.524454 15641 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:41.525676 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:41.526085 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 204223us
I20260709 13:06:41.526422 15795 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.526928 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.523068 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.525051 15644 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:06:41.527623 15794 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:41.528980 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:41.529320 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:41.529829 15645 raft_consensus.cc:2410] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:41.530891 15794 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:41.531235 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.533535 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:41.534029 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:41.534644 15722 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.535022 15714 pending_rounds.cc:85] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 5
I20260709 13:06:41.535343 15714 pending_rounds.cc:107] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:41.527997 15639 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:41.536469 15788 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:41.536895 15788 pending_rounds.cc:85] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 1
I20260709 13:06:41.537138 15788 pending_rounds.cc:107] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:06:41.520413 18386 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:41.537367 15788 raft_consensus.cc:2889] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.538815 15714 raft_consensus.cc:2889] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.539436 15790 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:41.562453 15793 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:41.540261 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.531303 15794 pending_rounds.cc:85] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 1
I20260709 13:06:41.541815 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:41.564285 15794 pending_rounds.cc:107] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:41.564713 15794 raft_consensus.cc:2889] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.542230 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:41.543255 18393 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:06:41.546250 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.498433 18371 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.576057 18371 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:41.564524 15795 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:41.567502 15639 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:41.568140 15688 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.825s (SENT)
I20260709 13:06:41.577627 15721 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:06:41.519721 18294 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:41.565534 15644 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:41.586678 15788 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:41.568863 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.588810 15644 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.590863 15639 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.587317 15790 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:41.591506 15644 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:41.589358 15688 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.938s (SENT)
I20260709 13:06:41.577603 15722 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:41.592724 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.588608 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.593674 15641 raft_consensus.cc:2376] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
I20260709 13:06:41.596076 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:41.565805 18239 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.599498 15644 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:06:41.601698 15644 pending_rounds.cc:85] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 1
I20260709 13:06:41.602011 15644 pending_rounds.cc:107] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:06:41.596802 15795 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:41.602538 15644 raft_consensus.cc:2889] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:41.607736 15610 connection.cc:256] RPC call timeout handler was delayed by -3.4119923829999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:06:41.608263 15610 connection.cc:256] RPC call timeout handler was delayed by -3.4092923829999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:06:41.608654 15610 connection.cc:256] RPC call timeout handler was delayed by -3.4029923829999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:06:41.586089 18371 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.612097 15641 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:41.609027 15610 connection.cc:256] RPC call timeout handler was delayed by -3.3948923830000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:06:41.614264 15610 connection.cc:256] RPC call timeout handler was delayed by -3.3921923830000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:06:41.614588 15639 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:41.614637 15610 connection.cc:256] RPC call timeout handler was delayed by -3.3777923830000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:06:41.615656 15610 connection.cc:256] RPC call timeout handler was delayed by -3.3489923829999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:06:41.618049 18294 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:41.618642 18385 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:41.613988 18383 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.619863 18302 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:41.626320 15644 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:41.584177 18165 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:41.612198 18376 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:41.628914 15645 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:41.629312 15641 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:06:41.626763 15610 connection.cc:256] RPC call timeout handler was delayed by -3.3381923829999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 13:06:41.639487 15645 pending_rounds.cc:85] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 3
W20260709 13:06:41.639219 15610 connection.cc:256] RPC call timeout handler was delayed by -3.3372923829999763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 13:06:41.639849 15645 pending_rounds.cc:107] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:41.639119 15641 pending_rounds.cc:85] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 3
W20260709 13:06:41.640053 15610 connection.cc:256] RPC call timeout handler was delayed by -3.1428923830000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 13:06:41.641866 15641 pending_rounds.cc:107] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 13:06:41.642118 15610 connection.cc:256] RPC call timeout handler was delayed by -3.1302923829999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:06:41.642597 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0996923830000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:06:41.642360 15641 raft_consensus.cc:2889] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:41.643018 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0996923830000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:06:41.643468 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0744923830000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:06:41.643863 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0258923830000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 13:06:41.606786 18239 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:41.666956 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.628329 18286 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:41.645216 15789 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:41.655622 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.640669 15645 raft_consensus.cc:2889] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.639374 18294 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.640759 18144 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:41.639701 18309 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:41.674836 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0258923830000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:06:41.685081 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 148986us
W20260709 13:06:41.689755 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.730584 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:41.686679 15576 debug-util.cc:398] Leaking SignalData structure 0x7b0800158d60 after lost signal to thread 15579
I20260709 13:06:41.753605 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:41.754406 15638 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:41.754446 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.762506 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:41.752998 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0087923830000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 13:06:41.764458 15610 connection.cc:256] RPC call timeout handler was delayed by -3.0006923830000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:06:41.764870 15610 connection.cc:256] RPC call timeout handler was delayed by -2.979992382999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:06:41.765331 15610 connection.cc:256] RPC call timeout handler was delayed by -2.8188923830000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20260709 13:06:41.690802 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:41.755715 15576 debug-util.cc:398] Leaking SignalData structure 0x7b080039cbe0 after lost signal to thread 15671
W20260709 13:06:41.702239 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 112891us
W20260709 13:06:41.765844 15610 connection.cc:256] RPC call timeout handler was delayed by -2.8188923830000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 13:06:41.803823 15688 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.971s (SENT)
I20260709 13:06:41.804385 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:06:41.805176 15610 connection.cc:256] RPC call timeout handler was delayed by -2.8179923830000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:06:41.805619 15610 connection.cc:256] RPC call timeout handler was delayed by -2.8026923830000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 13:06:41.806553 15610 connection.cc:256] RPC call timeout handler was delayed by -2.7936923830000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:06:41.807024 15576 debug-util.cc:398] Leaking SignalData structure 0x7b080039c900 after lost signal to thread 15672
W20260709 13:06:41.807319 15610 connection.cc:256] RPC call timeout handler was delayed by -2.7783923829999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:06:41.807996 15610 connection.cc:256] RPC call timeout handler was delayed by -2.6028923830000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24060000000000004s for a response
W20260709 13:06:41.808378 15610 connection.cc:256] RPC call timeout handler was delayed by -2.5398923830000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24760000000000001s for a response
W20260709 13:06:41.808714 15610 connection.cc:256] RPC call timeout handler was delayed by -2.05929238300007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.301s for a response
I20260709 13:06:41.714217 18383 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:41.641232 18376 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:41.766410 18404 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:41.803642 18397 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:06:41.809056 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08001adf20 after lost signal to thread 15746
W20260709 13:06:41.809124 15610 connection.cc:256] RPC call timeout handler was delayed by -2.0061923829999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3069s for a response
W20260709 13:06:41.845813 15610 connection.cc:256] RPC call timeout handler was delayed by -1.9710923830000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3108s for a response
W20260709 13:06:41.846246 15610 connection.cc:256] RPC call timeout handler was delayed by -1.8918923830000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31960000000000005s for a response
W20260709 13:06:41.846642 15610 connection.cc:256] RPC call timeout handler was delayed by -1.8729923829999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32170000000000004s for a response
W20260709 13:06:41.846972 15610 connection.cc:256] RPC call timeout handler was delayed by -1.8729923829999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32170000000000004s for a response
I20260709 13:06:41.847936 15639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95371a1d960048e7af7796052350a058"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
W20260709 13:06:41.848470 15576 debug-util.cc:398] Leaking SignalData structure 0x7b080039fca0 after lost signal to thread 15820
W20260709 13:06:41.746026 18328 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.007s
I20260709 13:06:41.848533 15639 raft_consensus.cc:606] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:41.806020 18296 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.852100 16330 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:41.849490 15576 debug-util.cc:398] Leaking SignalData structure 0x7b0800394600 after lost signal to thread 15821
I20260709 13:06:41.769449 18239 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:41.790647 18352 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.704160 18350 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.850449 15639 raft_consensus.cc:614] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:41.849362 15688 leader_election.cc:336] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.235s (SENT)
I20260709 13:06:41.843748 18371 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:41.787955 18264 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:41.854017 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0780 after lost signal to thread 16358
I20260709 13:06:41.856050 18376 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:41.810015 18144 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:41.854022 15610 leader_election.cc:400] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:41.859208 15788 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:41.866118 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.890414 18296 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:41.891572 15688 leader_election.cc:336] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.397s (SENT)
I20260709 13:06:41.892037 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.895661 18210 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:41.896066 18239 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.870725 18371 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:41.885528 16327 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:41.885881 18278 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:06:41.900156 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:41.900995 15640 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:41.898451 18291 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:41.886617 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0860 after lost signal to thread 17975
I20260709 13:06:41.902382 18291 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.888528 18271 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.906378 15794 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:41.903195 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe020 after lost signal to thread 18272
I20260709 13:06:41.888976 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:41.904124 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1336) took 1454 ms. Trace:
W20260709 13:06:41.907420 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9500 after lost signal to thread 18288
I20260709 13:06:41.907361 15716 rpcz_store.cc:276] 0709 13:06:40.449536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.836511 (+386975us) service_pool.cc:224] Handling call
0709 13:06:40.836849 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.837287 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.837317 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:40.858270 (+ 20953us) log.cc:844] Serialized 52 byte log entry
0709 13:06:40.975409 (+117139us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:40.991189 (+ 15780us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.903394 (+912205us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.903666 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.903785 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.903841 (+    56us) raft_consensus.cc:1685] finished
0709 13:06:41.903861 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.904050 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":911736,"prepare.queue_time_us":15923,"raft.queue_time_us":7582,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":206,"spinlock_wait_cycles":14672256,"thread_start_us":80319,"threads_started":1,"wal-append.queue_time_us":119699}
W20260709 13:06:41.912577 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.916278 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.906981 18296 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.912542 18376 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.919035 18210 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.933817 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:41.934424 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:41.913233 18271 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:41.937649 15688 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.912s (SENT)
W20260709 13:06:41.938597 15688 leader_election.cc:336] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.923s (SENT)
I20260709 13:06:41.939043 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:41.941273 15796 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.939859 18278 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:41.971055 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:41.973955 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:41.975615 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:41.977175 15717 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:41.939518 18376 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.980111 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:41.984882 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.990242 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.991925 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 60932.6us
I20260709 13:06:41.992492 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:41.993371 16329 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:41.938457 18371 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:41.969595 18278 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:41.999420 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.002210 18376 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.003175 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.003796 18376 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.004251 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.005146 18376 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.005571 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.006808 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.007380 18376 raft_consensus.cc:2764] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:42.008121 18376 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.009016 15610 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.009294 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.010591 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.011544 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.011759 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:42.012452 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.013168 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.013911 18374 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.014123 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.013289 15795 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:42.014907 15793 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:42.026703 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.016089 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:42.030742 15793 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:42.032709 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:42.034037 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.035027 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:42.035648 15644 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.020426 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:42.024808 15790 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.019055 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.038275 15642 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:42.039280 15643 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:42.039788 15643 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:42.039981 15639 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:42.041020 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:42.043294 15794 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.045138 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:42.046106 15638 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:42.046554 15638 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:42.048779 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2298) took 1336 ms. Trace:
I20260709 13:06:42.049230 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:42.050295 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.049247 15720 rpcz_store.cc:276] 0709 13:06:40.712200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.003016 (+290816us) service_pool.cc:224] Handling call
0709 13:06:41.003293 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.003469 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:41.996370 (+992901us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.048442 (+ 52072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.048502 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:42.048546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.048613 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.048723 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":899752,"prepare.queue_time_us":938007,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"thread_start_us":129122,"threads_started":2}
I20260709 13:06:42.051484 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.052115 15795 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:42.054322 16331 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:42.014691 18374 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.047271 15638 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.061167 15717 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:42.062302 15638 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.062872 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:42.046314 18350 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:42.046133 18282 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.077786 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.059728 18376 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:42.080171 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.083526 15759 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.077522 15643 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.094046 15720 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:42.095099 15638 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:42.071606 18264 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:42.108426 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 89454.5us
I20260709 13:06:42.109551 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.113395 15643 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.067242 18335 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:06:42.074039 18320 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:42.119107 15644 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:42.135943 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.160531 15643 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:06:42.094599 18111 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.146238 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 369) took 1607 ms. Trace:
I20260709 13:06:42.165139 15643 pending_rounds.cc:85] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 2
I20260709 13:06:42.166080 15643 pending_rounds.cc:107] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:06:42.165370 15719 rpcz_store.cc:276] 0709 13:06:40.538497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.987740 (+449243us) service_pool.cc:224] Handling call
0709 13:06:40.989791 (+  2051us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.990271 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:41.902659 (+912388us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b18003edf40. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:06:41.939212 (+ 36553us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.981180 (+ 41968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.981651 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.981793 (+   142us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.981823 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.981884 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.145840 (+163956us) raft_consensus.cc:1685] finished
0709 13:06:42.145970 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.146178 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11850,"prepare.queue_time_us":950906,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":37,"raft.queue_time_us":11352,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":5785,"spinlock_wait_cycles":43031424,"thread_start_us":63830,"threads_started":2,"wal-append.queue_time_us":105833}
I20260709 13:06:42.166687 15643 raft_consensus.cc:2889] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:42.139707 18421 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:42.170056 18282 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.172817 18282 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:42.174041 18282 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.176167 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.177525 18374 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:42.089700 18278 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.174440 18376 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:42.107095 18412 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.124236 18384 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.104950 18260 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.120766 18271 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:42.143587 18418 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:06:42.119484 18404 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.179724 18374 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.183372 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2300) took 1470 ms. Trace:
I20260709 13:06:42.194916 15718 rpcz_store.cc:276] 0709 13:06:40.712742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.039165 (+326423us) service_pool.cc:224] Handling call
0709 13:06:41.039466 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.039663 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:42.081952 (+1042289us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.182921 (+100969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.182990 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:42.183062 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.183166 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.183303 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":878309,"prepare.queue_time_us":902035,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":296,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2996,"thread_start_us":250222,"threads_started":2}
I20260709 13:06:42.198995 18384 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:42.217362 18384 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.220000 18354 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.224150 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.226792 15644 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:42.227113 15762 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.196646 18374 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.207050 18210 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.189183 18412 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.194475 18111 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:42.238411 15646 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:42.241376 15641 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:42.241851 15792 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:42.244629 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:42.248802 18352 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.242518 18165 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.268374 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52262us
I20260709 13:06:42.246716 18114 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:42.266376 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 100093us
W20260709 13:06:42.266921 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 89415.3us
I20260709 13:06:42.271000 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.248358 18039 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:42.255937 18378 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:42.292501 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:42.295506 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.278343 18352 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:42.303144 15794 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:06:42.304282 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.301800 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.290493 18039 consensus_queue.cc:1243] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:42.280021 18020 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:42.278957 18165 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.319453 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:42.285679 18291 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.353389 18291 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:42.314388 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:42.362352 15787 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:42.369820 18430 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:42.370313 15791 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:42.347090 18412 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:42.321813 18440 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.338361 18352 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.308197 18264 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.354063 18286 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:42.355204 15789 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:42.357482 18328 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.359886 18406 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:42.325467 18309 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:06:42.354125 18431 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:06:42.395172 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66297.5us
I20260709 13:06:42.376514 18440 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.428705 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.431205 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.432400 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:42.433115 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 132616us
W20260709 13:06:42.435155 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.423911 18328 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:42.424455 18406 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:42.437355 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.439258 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 119893us
I20260709 13:06:42.441430 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:42.444219 18119 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:42.446643 18119 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:42.432698 18309 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:42.431995 18440 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:42.459213 16300 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.881s (SENT)
I20260709 13:06:42.463099 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.464509 15760 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.429315 18439 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:42.442112 18406 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.474771 15721 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:42.478130 15721 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:42.476384 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:42.478932 15714 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:42.479295 15714 pending_rounds.cc:85] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:06:42.479590 15714 pending_rounds.cc:107] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:42.479825 15714 raft_consensus.cc:2889] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:42.479773 15721 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.481009 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:42.484751 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:42.489096 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56755.5us
I20260709 13:06:42.492384 15714 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:42.492969 18286 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.494346 15718 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:42.453254 18309 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:42.505209 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 62294.9us
I20260709 13:06:42.467645 18271 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.509483 15714 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:06:42.470283 18291 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.496695 18282 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.509927 15714 pending_rounds.cc:85] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 6
I20260709 13:06:42.507964 18441 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:42.525946 15714 pending_rounds.cc:107] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:42.526307 15714 raft_consensus.cc:2889] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:42.516844 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.503257 18328 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.531234 18328 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.497002 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 545) took 1252 ms. Trace:
I20260709 13:06:42.534088 16327 rpcz_store.cc:276] 0709 13:06:41.244346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.252115 (+  7769us) service_pool.cc:224] Handling call
0709 13:06:41.253089 (+   974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.899486 (+646397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.468127 (+568641us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54005b1dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:42.485826 (+ 17699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453443328}
I20260709 13:06:42.540673 18144 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.542043 18239 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:42.544188 15713 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:42.544669 15713 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:42.553238 15713 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.555588 18286 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.557030 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:42.558682 15713 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:42.563040 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 54904us
W20260709 13:06:42.599951 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53662.9us
I20260709 13:06:42.600267 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:42.614976 15688 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.526s (SENT)
I20260709 13:06:42.615650 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.541401 18144 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.620443 18039 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.621112 18039 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.602664 18450 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.622159 18450 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:42.622459 18282 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.622565 18450 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.647588 15641 pending_rounds.cc:85] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 2
I20260709 13:06:42.647953 15641 pending_rounds.cc:107] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:42.648360 15641 raft_consensus.cc:2889] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:42.648557 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 210447us
I20260709 13:06:42.603538 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:42.651177 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 53261.9us
I20260709 13:06:42.652264 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.651294 15713 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:42.657816 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54347.5us
I20260709 13:06:42.660728 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.662338 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.597769 18239 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:42.601835 17969 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:06:42.668465 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.623252 18309 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.668823 18271 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:42.669627 18282 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.623805 18374 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.710739 18455 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:42.618151 18354 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 13:06:42.785919 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.746289 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 84040.4us
I20260709 13:06:42.783565 16331 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:06:42.776684 16300 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.782s (SENT)
I20260709 13:06:42.699793 18404 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.722362 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 107425us
I20260709 13:06:42.697837 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1888) took 1107 ms. Trace:
W20260709 13:06:42.735116 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 228964us
W20260709 13:06:42.842926 15688 leader_election.cc:336] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.093s (SENT)
I20260709 13:06:42.843252 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:42.673146 18409 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:42.740438 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:42.666523 18262 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.812515 18294 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:42.791014 18453 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.785727 18447 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.809659 18039 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:42.837296 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.837857 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:42.856559 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 79920.6us
I20260709 13:06:42.816358 18412 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:42.844754 15688 leader_election.cc:336] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.170s (SENT)
I20260709 13:06:42.842003 15788 rpcz_store.cc:276] 0709 13:06:41.590416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.592907 (+  2491us) service_pool.cc:224] Handling call
0709 13:06:41.858929 (+266022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.889395 (+ 30466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.692949 (+803554us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001374d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:42.697721 (+  4772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580083584}
I20260709 13:06:42.829041 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:42.864240 15688 leader_election.cc:336] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.723s (SENT)
I20260709 13:06:42.865276 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:42.865521 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.846347 18309 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.839488 18461 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.870167 18459 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.879606 18448 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.879807 18447 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.858808 18412 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.879644 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.872898 16328 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.864864 18320 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.845654 18410 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:42.845654 18379 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:42.892998 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:42.894068 15722 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:42.896286 15713 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:42.839587 18404 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.889076 18459 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:42.934499 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 54958.3us
I20260709 13:06:42.859074 18294 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:42.933982 16300 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.209s (SENT)
I20260709 13:06:42.910179 18410 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:42.946466 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97994.5us
I20260709 13:06:42.948818 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.947430 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.935966 18447 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.901515 18210 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:42.953647 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:42.954607 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.936722 18461 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:42.888703 18460 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:06:42.959605 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.961217 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:42.951247 18414 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.946851 18459 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.955056 18374 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:42.963255 18210 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.964432 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:42.935133 18379 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:42.968755 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.969822 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.970280 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.971423 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.972007 18374 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.972651 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.973513 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.973825 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.974602 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:42.974798 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.971451 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:42.975831 15644 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:42.973663 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.979094 18450 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.979586 16328 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:42.981129 18412 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:42.967002 18210 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:42.981945 18210 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.982834 18379 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:42.983381 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.984622 18450 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:42.985718 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.986402 15641 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:42.987043 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:42.988181 18144 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:42.990355 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.990761 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.991286 18410 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:42.967234 18446 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:06:42.992537 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:42.993038 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.994668 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:42.971575 16300 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.959s (SENT)
I20260709 13:06:42.996708 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.957271 18445 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:42.996948 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:42.986095 15793 raft_consensus.cc:1217] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:06:42.961776 18453 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.963768 18239 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.007652 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:43.011519 18429 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:43.012969 15793 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:42.997330 15643 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:42.997974 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:43.013971 18434 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.013374 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.961947 18447 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:43.016531 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44989.5us
I20260709 13:06:42.964125 18441 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.017431 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:42.961001 18461 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.027522 15647 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:43.030354 15642 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:43.017926 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.017911 18465 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:43.013854 18450 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:43.022670 18467 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.023391 18404 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:42.968415 18440 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:42.956821 18455 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:06:43.024770 18414 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.012467 18445 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.016760 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:43.041594 18458 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:06:42.955245 18442 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:06:43.028625 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.014928 18374 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.010668 18210 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.031450 15639 raft_consensus.cc:2376] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
I20260709 13:06:43.021306 18239 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:43.033814 18460 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.037119 18296 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:43.039981 18165 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.051182 18450 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:43.032526 18434 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:43.034030 18406 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.006s
I20260709 13:06:43.074666 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.012969 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.090638 15645 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:43.090268 18239 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.091746 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.092327 15645 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.092712 18461 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:43.095551 18434 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.075706 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.097292 15643 raft_consensus.cc:2368] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.098237 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.099290 18210 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.099568 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:43.081670 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53117.2us
I20260709 13:06:43.085904 18460 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.100972 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.102635 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.073177 18445 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.102031 18410 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.105187 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.106611 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.107617 15644 raft_consensus.cc:2368] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.084317 15685 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.087059 15714 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:43.108486 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:43.112283 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 83884.9us
I20260709 13:06:43.109222 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.113457 15644 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:43.084214 18414 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:43.106842 18286 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
I20260709 13:06:43.108700 18320 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.114660 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.127770 15645 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
W20260709 13:06:43.125877 18443 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
I20260709 13:06:43.129009 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.129192 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.130362 18412 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.116411 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.118337 18309 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:43.101009 18460 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.087065 18374 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.120615 18467 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:43.123378 18451 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.465s	user 0.001s	sys 0.000s
I20260709 13:06:43.130708 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.132382 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.125954 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.086638 18459 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:43.145131 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 60913.6us
I20260709 13:06:43.149588 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.152782 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.153575 18320 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.136708 18165 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:43.166462 15645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:06:43.156078 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:43.157141 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.167527 15645 raft_consensus.cc:606] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:43.167943 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.168172 15645 raft_consensus.cc:614] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:43.168562 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.159759 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.156522 18450 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.170419 18414 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.147804 18309 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:43.171495 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.176542 15645 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:43.131291 18410 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.150977 18286 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.178675 15645 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:43.172885 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.169685 15639 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:43.161046 18328 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.107039 18406 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.181200 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.186769 15645 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:43.153704 18465 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:43.184751 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.194420 15639 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:43.196853 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:43.198348 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:43.171411 18320 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.182489 18264 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:43.174189 18165 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.186666 18467 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.193229 18328 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.203393 18328 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:43.203800 18328 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.184300 18210 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:06:43.198676 18271 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:43.210924 18459 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.211758 18165 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.202013 18309 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.188737 18461 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:43.212911 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:43.198909 18144 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.199175 18465 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.201805 18414 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:43.204305 18320 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.228636 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.229513 15638 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:43.218575 18144 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.231099 18320 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.231603 18320 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:43.232045 18320 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.204847 18264 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.231144 18144 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.239593 18264 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:43.239840 18473 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:43.240061 18294 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.240315 18473 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:43.241127 18473 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.221865 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:43.242743 18473 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.245852 18376 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:43.246438 18376 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:43.248029 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.247519 18376 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.249063 18376 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.251206 15721 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.254431 18374 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.255992 18406 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.225786 18440 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.260766 18260 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.261354 18260 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.263087 18351 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.263614 18260 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:43.263873 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.264473 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.223415 18459 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:43.261355 18271 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:43.208469 18119 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:06:43.224107 18414 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.266240 18414 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.266587 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2111) took 1746 ms. Trace:
I20260709 13:06:43.267089 15791 rpcz_store.cc:276] 0709 13:06:41.520575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.521138 (+   563us) service_pool.cc:224] Handling call
0709 13:06:42.369851 (+848713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.370854 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.266325 (+895471us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54002eb3d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:43.266516 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937327360}
I20260709 13:06:43.269892 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 352) took 1271 ms. Trace:
I20260709 13:06:43.270422 15789 rpcz_store.cc:276] 0709 13:06:41.998161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.998282 (+   121us) service_pool.cc:224] Handling call
0709 13:06:41.998565 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.395395 (+396830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.269551 (+874156us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001faed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:43.269817 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819678080}
I20260709 13:06:43.271783 18445 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.265226 18459 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:43.274423 18459 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.275076 18320 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.275808 18459 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.276225 16328 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:43.273475 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1894) took 1263 ms. Trace:
I20260709 13:06:43.278012 15793 rpcz_store.cc:276] 0709 13:06:42.010273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.031503 (+ 21230us) service_pool.cc:224] Handling call
0709 13:06:42.031824 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.985990 (+954166us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54002c9820. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad254081c0 00007fad25409231 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c
0709 13:06:43.027123 (+ 41133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.273264 (+246141us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b540047a9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:43.273416 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77198592}
I20260709 13:06:43.279644 18463 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.280171 18463 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.284119 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:43.286056 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.286782 15638 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:43.302124 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.302328 15721 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:06:43.303071 15642 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:43.303027 15721 pending_rounds.cc:85] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 6
I20260709 13:06:43.303813 15721 pending_rounds.cc:107] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:43.304051 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.304301 15721 raft_consensus.cc:2889] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:43.307348 18457 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.639s	user 0.001s	sys 0.003s
W20260709 13:06:43.312489 18471 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 13:06:43.312716 18460 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.264573 18351 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:06:43.326417 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.325412 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.304762 15642 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:43.336558 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:43.340603 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:43.341383 15792 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.346861 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.351079 15792 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:43.373278 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:43.374333 15762 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.374668 15796 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.299331 18376 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.321377 18328 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.345966 18278 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.383265 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.385268 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:43.386112 15787 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:43.369315 18119 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.380355 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:43.379257 15795 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:43.377655 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:43.397210 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.373823 18286 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.387565 18111 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.371886 18374 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:43.388432 18466 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.394555 18448 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:43.395546 18119 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:43.384581 18354 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.422327 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 241189us
I20260709 13:06:43.405380 18452 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:43.425697 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 240176us
I20260709 13:06:43.425978 18448 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:43.426321 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.436209 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:43.408900 18445 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:43.416534 18389 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.395162 18278 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.448171 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:43.457583 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.415628 18478 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.454535 15796 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:43.422852 18466 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.424768 18119 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.468768 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:43.462447 18210 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.471199 18264 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.472060 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.473107 18264 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.475746 18460 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.476409 18460 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:43.476912 18460 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:43.434113 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:43.479632 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:43.479859 18278 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.480963 16327 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:43.434721 18463 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.482362 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:43.483276 16330 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:43.446308 18144 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.421329 18414 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.486052 18448 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.486791 16325 raft_consensus.cc:2368] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.486976 18328 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.487573 18414 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.487802 18466 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.462790 18478 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.488536 18478 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.489923 15688 leader_election.cc:400] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.490321 15688 leader_election.cc:403] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:43.494343 18485 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:43.467372 18467 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:43.493368 18461 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:43.493901 18460 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.491427 18144 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.443015 18452 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.502421 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.511108 15688 leader_election.cc:400] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.511840 15685 leader_election.cc:400] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.523651 15644 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.523795 15685 leader_election.cc:403] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:43.512864 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.444957 18406 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.419312 18111 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.495349 18485 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.525308 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.522930 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.476032 18309 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.529255 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.531313 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:43.514741 18463 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.455778 18296 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:06:43.514979 18440 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:43.526938 18459 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.445845 18354 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.527349 18452 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.467052 18465 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:43.521116 18210 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:06:43.527501 18406 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:43.534904 18264 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.465912 18472 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:06:43.511416 18442 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:43.520671 18461 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.629074 15644 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:06:43.539845 18320 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:43.630908 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:43.638693 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.461261 18389 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.610193 18406 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.630918 18414 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.646327 18467 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.630906 18486 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.715312 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.720106 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:43.723196 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.726155 15642 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.670632 18374 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.670879 18440 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:43.733191 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 201947us
I20260709 13:06:43.740131 18467 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.741427 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:43.679183 18482 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:43.750388 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.715193 18296 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.734290 18434 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:43.719256 18414 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.744383 18374 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.758344 18482 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:43.758805 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:43.783880 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.759065 15638 raft_consensus.cc:2368] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.785339 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.786486 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:43.787093 15638 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:06:43.760412 18481 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:06:43.760447 18354 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:43.780306 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.798802 15644 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:43.791574 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.787842 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.758392 18485 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:43.779474 18486 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.761377 18489 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:43.803546 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.805169 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.806375 15722 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:43.806568 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.807554 15713 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:43.782155 18389 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:43.813592 15642 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:43.817147 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.822679 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:43.822849 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.781163 18320 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:43.827807 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.773379 18296 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.829063 15722 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:43.831230 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:43.832693 15713 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:43.790232 18260 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:43.781373 18434 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:43.804344 18472 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:43.853063 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:43.854419 15719 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.855329 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.856990 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.857703 15720 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:43.858572 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:43.859652 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.861763 15688 leader_election.cc:400] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:43.864257 18434 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:43.866192 18466 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:43.870532 15794 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:43.871461 18239 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.871560 18296 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:43.836474 18354 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.874565 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:43.875802 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.877046 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.882642 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:43.888010 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:43.890545 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.891947 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:43.894608 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:43.891467 15717 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:43.913241 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:43.924659 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:43.816018 18486 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:43.889834 18473 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 13:06:43.819320 18440 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:43.972651 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 50480.7us
I20260709 13:06:43.910342 18224 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.852665 18472 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:43.992156 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.915127 18296 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:43.993271 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:43.924065 18328 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.992384 16330 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.994300 16326 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:43.873654 18354 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.013978 15645 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:43.921993 18461 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.014448 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.022505 15714 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
W20260709 13:06:44.037452 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 45853.5us
I20260709 13:06:44.039148 15719 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:43.987543 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:44.059828 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 158403us
I20260709 13:06:44.063159 15787 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:44.071745 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.075003 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:44.077996 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:44.061491 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.079634 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.082986 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:44.083293 15791 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.012916 18296 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:44.011904 18328 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:44.021306 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:44.095988 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.017077 18414 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:44.049976 18493 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:43.883839 18482 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:44.114281 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 75801.6us
I20260709 13:06:44.118209 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:44.019425 18320 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:06:44.091952 18143 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.091434 18485 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.091753 18473 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.098394 18296 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:44.102101 18484 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.349s	user 0.001s	sys 0.001s
I20260709 13:06:44.100960 18328 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.099504 18374 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.143254 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.013682 18224 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.115453 18414 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.156025 18497 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:06:44.158710 18499 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:06:44.159389 18492 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:06:44.096575 18445 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:44.159938 18020 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:44.159976 18491 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:06:44.160356 18286 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:44.253856 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:44.164577 18495 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.207682 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:44.252516 15715 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.241601 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.170217 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.161886 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:44.271181 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 109418us
I20260709 13:06:44.124291 18351 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:06:44.167682 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 270) took 1180 ms. Trace:
W20260709 13:06:44.255743 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 160912us
I20260709 13:06:44.274255 15794 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
W20260709 13:06:44.167804 18488 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 13:06:44.279337 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.199081 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:44.281520 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:44.281669 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:44.283797 15643 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:44.285216 15716 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.146034 18475 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:44.165594 18309 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.631s	user 0.001s	sys 0.006s
I20260709 13:06:44.259320 15791 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:44.273926 15641 rpcz_store.cc:276] 0709 13:06:42.987607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.987721 (+   114us) service_pool.cc:224] Handling call
0709 13:06:42.988056 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.038198 (+ 50142us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:43.108521 (+ 70323us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.419889 (+311368us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.420301 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.420409 (+   108us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:43.420430 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.064498 (+644068us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b1800391780. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419
0709 13:06:44.167338 (+102840us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54002670d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:44.167385 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.167465 (+    80us) raft_consensus.cc:1685] finished
0709 13:06:44.167483 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.167634 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88374,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":11238,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":12460,"spinlock_wait_cycles":120946304,"thread_start_us":323386,"threads_started":2,"wal-append.queue_time_us":515813}
I20260709 13:06:44.169216 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:44.167325 18510 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:44.285231 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:44.176182 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:44.297576 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 128426us
I20260709 13:06:44.293669 15788 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:06:44.298398 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:44.298751 15791 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:44.184764 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:44.171350 18264 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.302294 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:44.303141 16297 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:44.175524 18111 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.142505 18143 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.170928 18354 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:44.166733 18472 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.165957 18374 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:44.239156 18473 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:06:44.318701 16332 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:44.307773 15643 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:44.309464 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:44.184159 18486 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.310492 18294 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:44.310397 18520 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:44.312184 18406 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:06:44.300650 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:44.274667 18442 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.279315 18445 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:44.328631 15788 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:44.170778 18296 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.269001 18455 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.290093 18286 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.287609 18515 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.363134 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1498) took 1756 ms. Trace:
I20260709 13:06:44.318310 18264 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:44.363598 15640 rpcz_store.cc:276] 0709 13:06:42.607247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.607468 (+   221us) service_pool.cc:224] Handling call
0709 13:06:42.607908 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.617896 (+  9988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.617926 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.618357 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.286670 (+668313us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800365680. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:06:43.511325 (+224655us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.511379 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.511443 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.358385 (+846942us) raft_consensus.cc:1685] finished
0709 13:06:44.358402 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.363062 (+  4660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9516,"raft.queue_time_us":10412,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":24196,"spinlock_wait_cycles":5919104,"thread_start_us":223937,"threads_started":1,"wal-append.queue_time_us":1141516}
I20260709 13:06:44.326844 15791 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:44.341361 18354 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:44.313894 18278 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.342370 18482 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.360226 18111 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.345091 18224 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:44.348625 18143 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:44.273761 18414 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.305299 18220 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:44.356776 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 56204.1us
I20260709 13:06:44.342823 18473 consensus_queue.cc:1243] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:44.353330 18445 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:44.397478 18445 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.375725 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:44.377401 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2121) took 1039 ms. Trace:
I20260709 13:06:44.400507 15793 rpcz_store.cc:276] 0709 13:06:43.337698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.337850 (+   152us) service_pool.cc:224] Handling call
0709 13:06:43.338148 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.369586 (+ 31438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.370177 (+   591us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.370672 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.712965 (+342293us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.757419 (+ 44454us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.764215 (+  6796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.764322 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.377195 (+612873us) raft_consensus.cc:1685] finished
0709 13:06:44.377216 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.377346 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72234,"prepare.queue_time_us":46128,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":39423,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":7012,"thread_start_us":311925,"threads_started":1,"wal-append.queue_time_us":432772}
I20260709 13:06:44.359701 18406 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.377619 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.375066 18111 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.406512 18260 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.407217 18111 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.363585 18455 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.381654 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.356813 18286 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:44.355635 18294 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.361832 18442 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.334751 18374 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.392838 15795 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:44.404237 18478 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.915s	user 0.003s	sys 0.007s
I20260709 13:06:44.435158 18478 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:44.436398 18463 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.895s	user 0.010s	sys 0.000s
I20260709 13:06:44.436964 18463 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:44.438107 15713 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:44.407178 18260 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:44.439622 18294 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.408185 15722 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:44.407974 18111 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:44.439760 18260 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.440971 18260 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.441126 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:44.388839 18376 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.005s	user 0.008s	sys 0.004s
I20260709 13:06:44.441893 15722 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 2.
I20260709 13:06:44.442000 18376 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.442849 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.443223 18111 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:44.444058 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.444403 18376 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:44.444871 18376 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:44.445202 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.420184 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2118) took 1083 ms. Trace:
I20260709 13:06:44.445670 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.445770 18376 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.446033 15790 rpcz_store.cc:276] 0709 13:06:43.336575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.337634 (+  1059us) service_pool.cc:224] Handling call
0709 13:06:43.372837 (+ 35203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.382863 (+ 10026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.382895 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.383417 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.680483 (+297066us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:43.728172 (+ 47689us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.744845 (+ 16673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.744956 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.419845 (+674889us) raft_consensus.cc:1685] finished
0709 13:06:44.419877 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.420100 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21817,"prepare.queue_time_us":47725,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":34632,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11658,"spinlock_wait_cycles":17750528,"thread_start_us":270430,"threads_started":1,"wal-append.queue_time_us":438789}
I20260709 13:06:44.391765 18414 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.449206 18328 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.369692 18354 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.450309 18354 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.452945 15722 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:44.422137 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.430392 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.430884 15795 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.431186 18406 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:44.431478 18264 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.432185 15641 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:44.432924 15646 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:44.433401 18442 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:44.433537 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 130495us
I20260709 13:06:44.468604 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:44.434597 18374 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.461679 15647 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
W20260709 13:06:44.452520 18452 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.002s
I20260709 13:06:44.470336 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:44.470878 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 116475us
I20260709 13:06:44.489341 15759 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:44.490804 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:44.491879 15610 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:44.472898 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.470396 18224 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.477849 18286 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.478683 18296 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:44.472924 18278 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.452785 18376 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.479849 18264 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.481626 15788 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:44.493484 15722 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:44.505048 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.505791 15722 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:44.507292 15722 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:44.508602 15722 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.509001 15722 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:44.495762 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.441571 18478 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.498695 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:44.514236 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.515249 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2122) took 1177 ms. Trace:
I20260709 13:06:44.515486 15790 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:44.486400 18119 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.967s	user 0.011s	sys 0.000s
I20260709 13:06:44.515792 15789 rpcz_store.cc:276] 0709 13:06:43.338098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.338240 (+   142us) service_pool.cc:224] Handling call
0709 13:06:43.338534 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.487836 (+149302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.487864 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.488309 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.779521 (+291212us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.785460 (+  5939us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.792395 (+  6935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.183896 (+391501us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54002193d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:44.183952 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.477047 (+293095us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b24002623e8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2219f9c4 00007fad2219dacb 00007fad22358dc9 00007fad22358a55 00007fad22357fb0 00007fad24fce488 00007fad24fcebe8 00007fad24fa6398 00007fad24fa176a 00007fad24fa0bb6
0709 13:06:44.514951 (+ 37904us) raft_consensus.cc:1685] finished
0709 13:06:44.514978 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.515170 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33702,"prepare.queue_time_us":13113,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":9151,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":2710,"spinlock_wait_cycles":351883904,"thread_start_us":290814,"threads_started":1,"wal-append.queue_time_us":372696}
W20260709 13:06:44.520301 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.520422 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.520828 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:44.523145 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:44.511871 15722 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.525280 15722 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.497532 18400 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:44.514524 18459 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.938s	user 0.013s	sys 0.000s
I20260709 13:06:44.499356 18379 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:44.503248 18520 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.503432 18224 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.499549 18465 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:44.637811 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:44.638684 15789 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.689493 15722 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:44.704959 15722 pending_rounds.cc:85] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:06:44.705677 15722 pending_rounds.cc:107] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:44.706429 15722 raft_consensus.cc:2889] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:44.708251 15722 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.708784 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.712792 15722 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.717137 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:44.717549 15790 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:44.516557 18442 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:06:44.519968 18294 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 13:06:44.577294 18379 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.497875 18452 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.640434 18459 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:44.638778 18271 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.535629 18119 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:44.747200 18530 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:44.721683 18111 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:44.722071 18328 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:44.727946 18379 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.765355 15639 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:06:44.713279 18518 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:44.768815 15720 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:06:44.771049 18529 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.780117 15789 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:44.782667 15796 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:06:44.788672 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 252698us
I20260709 13:06:44.794809 16297 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:44.798291 18412 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.799052 18412 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:44.800259 18412 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.690601 18465 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.815315 18465 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:44.828008 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:44.774071 18374 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.782522 18455 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.744004 18271 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:44.836192 18460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.001s	sys 0.012s
I20260709 13:06:44.832649 18328 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.839920 18374 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:44.864868 15713 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
W20260709 13:06:44.851227 18460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.001s	sys 0.013s
W20260709 13:06:44.889101 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.978114 18535 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:06:44.979879 18537 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:06:44.984663 18528 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:06:44.985541 18410 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:44.986203 18410 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:44.988282 18410 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.001652 18466 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.002403 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1902) took 1322 ms. Trace:
I20260709 13:06:45.002930 15796 rpcz_store.cc:276] 0709 13:06:43.680410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.680640 (+   230us) service_pool.cc:224] Handling call
0709 13:06:43.681048 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.789409 (+1108361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.002055 (+212646us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540010ca54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:45.002327 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532768128}
I20260709 13:06:45.015030 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:45.016266 18444 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.017061 18444 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.017995 18530 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.018534 18530 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.019418 18444 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:44.919184 18455 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.023759 18278 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:44.809664 18518 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.027611 16326 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.029955 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:44.869441 18328 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.046456 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.041918 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:45.029421 18264 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:06:45.024618 18530 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.039453 18224 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.044664 18465 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.044664 18466 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:45.035266 18455 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.065532 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:45.080651 18271 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.080194 16326 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:45.078061 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:45.086067 18520 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:45.089516 18260 consensus_meta.cc:287] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.648s	user 0.004s	sys 0.007s
I20260709 13:06:45.037930 18278 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.101007 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 393) took 1244 ms. Trace:
I20260709 13:06:45.080556 18119 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.101958 15795 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.077086 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:45.101516 15720 rpcz_store.cc:276] 0709 13:06:43.857044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.858348 (+  1304us) service_pool.cc:224] Handling call
0709 13:06:45.100804 (+1242456us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400439c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:45.100934 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036884864}
I20260709 13:06:45.083818 18465 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.090333 18466 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.058657 18374 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.111084 16328 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:45.148286 18374 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.148557 16298 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:45.149981 18478 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.150398 18478 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.150754 18478 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.136135 18278 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:45.172024 15685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.591s (SENT) [suppressed 52 similar messages]
I20260709 13:06:45.175523 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1903) took 1494 ms. Trace:
I20260709 13:06:45.176090 15787 rpcz_store.cc:276] 0709 13:06:43.681550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.681702 (+   152us) service_pool.cc:224] Handling call
0709 13:06:44.062763 (+381061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.063765 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.175224 (+1111459us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540021acd0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:45.175451 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853246848}
W20260709 13:06:45.181010 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.204304 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 55817.3us
I20260709 13:06:45.204928 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:45.205180 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:45.211304 18376 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.694s	user 0.006s	sys 0.006s
I20260709 13:06:45.214509 18374 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.215245 18466 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.206499 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:45.203087 18328 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.227756 18294 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:45.227805 18376 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.230306 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.215054 18374 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.233038 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.207123 18518 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.238569 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1852) took 1037 ms. Trace:
I20260709 13:06:45.233932 16330 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.235456 18455 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:45.242640 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.238914 15646 rpcz_store.cc:276] 0709 13:06:44.201461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.206447 (+  4986us) service_pool.cc:224] Handling call
0709 13:06:45.238411 (+1031964us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400346054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:45.238521 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410044160}
W20260709 13:06:45.247476 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 75500.2us
I20260709 13:06:45.244239 15759 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:45.232694 16325 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:45.222571 18551 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.254612 18465 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.250765 18271 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.256914 18271 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.257297 18271 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.248662 18294 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:45.243899 18376 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.263219 18494 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.213s	user 0.002s	sys 0.001s
I20260709 13:06:45.257885 18374 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.265480 18379 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.266834 18294 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.274991 18543 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
I20260709 13:06:45.277549 18519 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.277998 18519 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:45.278841 18519 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.280130 18519 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.281471 18445 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:45.283211 18536 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.564s	user 0.003s	sys 0.000s
W20260709 13:06:45.265162 18467 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:06:45.273627 18478 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.291188 18549 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:06:45.292214 18376 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:45.292968 18354 consensus_meta.cc:287] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.842s	user 0.007s	sys 0.007s
W20260709 13:06:45.293182 18547 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:06:45.293429 18354 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.297099 18354 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:45.313287 18541 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:06:45.314632 18286 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.363188 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:45.371417 15713 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:45.363853 15638 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:45.379045 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1904) took 1697 ms. Trace:
I20260709 13:06:45.382594 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 1907) took 1698 ms. Trace:
I20260709 13:06:45.383173 15794 rpcz_store.cc:276] 0709 13:06:43.684271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.290615 (+606344us) service_pool.cc:224] Handling call
0709 13:06:44.315565 (+ 24950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.315897 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.315923 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.485579 (+169656us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:44.486074 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.869686 (+383612us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:44.869809 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.870165 (+   356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.274422 (+404257us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:45.381987 (+107565us) raft_consensus.cc:1685] finished
0709 13:06:45.382043 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.382360 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":49442,"spinlock_wait_cycles":66652416,"thread_start_us":365311,"threads_started":1,"wal-append.queue_time_us":660565}
I20260709 13:06:45.390084 18220 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:45.379709 15792 rpcz_store.cc:276] 0709 13:06:43.681950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.682096 (+   146us) service_pool.cc:224] Handling call
0709 13:06:43.682517 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:43.683008 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.683046 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:45.177469 (+1494423us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:45.186244 (+  8775us) log.cc:844] Serialized 52 byte log entry
0709 13:06:45.270625 (+ 84381us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:45.270688 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.271143 (+   455us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.378239 (+107096us) raft_consensus.cc:1685] finished
0709 13:06:45.378275 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.378727 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20042,"raft.queue_time_us":3856,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":31807,"spinlock_wait_cycles":13733632,"thread_start_us":63537,"threads_started":1,"wal-append.queue_time_us":137346}
I20260709 13:06:45.391373 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:45.391202 18220 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.391924 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:45.392781 16325 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.393251 16326 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.394897 18220 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.398936 18264 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.400038 18264 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.403177 18264 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.403978 18264 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.404613 18264 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:45.407408 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.407127 18264 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.408648 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1849) took 1630 ms. Trace:
I20260709 13:06:45.409045 15639 rpcz_store.cc:276] 0709 13:06:43.777982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.869760 (+ 91778us) service_pool.cc:224] Handling call
0709 13:06:43.870070 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.774424 (+904354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.407942 (+633518us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54002dc154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:45.408381 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046702336}
I20260709 13:06:45.410679 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1543) took 1131 ms. Trace:
I20260709 13:06:45.411095 15641 rpcz_store.cc:276] 0709 13:06:44.279565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.324447 (+ 44882us) service_pool.cc:224] Handling call
0709 13:06:44.324761 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.466382 (+141621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.410112 (+943730us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000e79d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:45.410485 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246249216}
W20260709 13:06:45.412343 15647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 280) took 1955 ms (client timeout 2044 ms). Trace:
W20260709 13:06:45.412781 15647 rpcz_store.cc:269] 0709 13:06:43.457107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.457272 (+   165us) service_pool.cc:224] Handling call
0709 13:06:45.411902 (+1954630us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54000e83d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:45.412125 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264540416}
I20260709 13:06:45.421424 16325 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
W20260709 13:06:45.421639 15714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1386) took 1618 ms (client timeout 2100 ms). Trace:
W20260709 13:06:45.422374 15714 rpcz_store.cc:269] 0709 13:06:43.803101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.803239 (+   138us) service_pool.cc:224] Handling call
0709 13:06:45.421131 (+1617892us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540003d254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:45.421384 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490212608}
I20260709 13:06:45.321758 18379 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.468544 18461 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.471884 16326 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:45.474788 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:45.476568 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:45.473585 18374 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.482343 18374 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.485462 18374 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.487056 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1544) took 1196 ms. Trace:
I20260709 13:06:45.487468 15644 rpcz_store.cc:276] 0709 13:06:44.290595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.451432 (+160837us) service_pool.cc:224] Handling call
0709 13:06:45.238618 (+787186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.238909 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.238940 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.238997 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.239054 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.239148 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.486667 (+247519us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400346050. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:45.486853 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807649536}
I20260709 13:06:45.488847 18459 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:45.489709 18459 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.492374 18459 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:45.494087 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.493932 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1847) took 1716 ms. Trace:
I20260709 13:06:45.495502 15638 rpcz_store.cc:276] 0709 13:06:43.777395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.852216 (+ 74821us) service_pool.cc:224] Handling call
0709 13:06:43.863632 (+ 11416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.373264 (+1509632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.493539 (+120275us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000a9e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:45.493851 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3448041216}
I20260709 13:06:45.496277 18448 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:45.496979 18448 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:45.497040 18379 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:45.497720 18379 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:45.496318 18515 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.499091 18379 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.501072 18452 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.298250 18271 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.501161 18448 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.511174 18460 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.511400 18271 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.512310 18460 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.479032 18434 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.518564 18434 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.474839 18455 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.522501 18455 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.523384 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.521389 18434 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.546485 18448 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.551776 18512 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.552119 18521 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.552289 18512 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:45.552918 18521 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.554068 18533 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.555836 18533 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.559128 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:45.560140 15794 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:45.560760 18533 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.553615 18512 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.563498 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.564023 18512 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.568869 15792 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:45.569213 18544 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.435s	user 0.004s	sys 0.000s
I20260709 13:06:45.505280 18461 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.594779 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.596304 15714 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:45.597837 18320 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:45.599489 18521 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.602471 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 640) took 1702 ms. Trace:
I20260709 13:06:45.602906 16331 rpcz_store.cc:276] 0709 13:06:43.900142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.900740 (+   598us) service_pool.cc:224] Handling call
0709 13:06:43.901040 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.358407 (+457367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.358434 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.358479 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.358506 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.601925 (+1243419us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54004efa54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:45.602007 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.602252 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051368704}
I20260709 13:06:45.607329 18478 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.610597 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:45.614676 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.615556 15722 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 2.
I20260709 13:06:45.616621 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.617348 15722 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:45.620154 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.621160 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:45.623659 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:45.625828 18544 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:45.626338 18455 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.630854 18460 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.633499 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:45.635123 18460 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:45.585124 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 109015us
I20260709 13:06:45.635468 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:45.635615 18460 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.636158 18551 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.637224 18455 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.638432 18527 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:45.639173 18551 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.640476 18551 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.639887 18444 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:45.644824 18444 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:45.646955 18220 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:45.647567 18220 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:45.648212 18551 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.649217 18444 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.651232 18444 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.648660 18220 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.643857 18461 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.654029 18404 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.660939 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48096.6us
I20260709 13:06:45.650322 16330 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:45.636180 18460 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.666760 18448 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.697537 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:45.698642 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.667701 18521 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.698583 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:45.700719 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:45.702414 15718 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:45.707818 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.706911 15718 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:45.693539 18533 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:45.748314 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.759109 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.722781 18286 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.725548 18461 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:45.761261 15716 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.747205 18404 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.774140 18354 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:06:45.775229 16332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 649) took 1164 ms. Trace:
I20260709 13:06:45.775636 18404 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.776007 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:45.776712 15722 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.751555 18448 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.797519 18448 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:45.763785 18533 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.798861 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.799260 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.799993 15717 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:45.800199 18533 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:45.800944 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.801160 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.793598 18309 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:45.803637 18309 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.808836 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.809918 18567 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.810671 18567 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.812996 18567 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:45.749951 18521 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.792608 18445 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:45.793085 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 221563us
I20260709 13:06:45.794160 18434 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:45.800203 15713 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:45.815714 15715 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:45.775671 16332 rpcz_store.cc:276] 0709 13:06:44.519248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.519428 (+   180us) service_pool.cc:224] Handling call
0709 13:06:44.520513 (+  1085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.520990 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.521031 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.441159 (+920128us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b18003c1b40. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a
0709 13:06:45.571276 (+130117us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b2c00047568. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:45.572002 (+   726us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.588920 (+ 16918us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:45.588998 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.589120 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.660603 (+ 71483us) raft_consensus.cc:1685] finished
0709 13:06:45.660626 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.683512 (+ 22886us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10016,"raft.run_cpu_time_us":787,"raft.run_wall_time_us":112691,"spinlock_wait_cycles":35493120,"thread_start_us":16388,"threads_started":1,"wal-append.queue_time_us":60798}
I20260709 13:06:45.813602 18567 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:45.837577 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 151998us
I20260709 13:06:45.872186 15714 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.840765 15718 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.837930 18533 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.850011 18567 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.845873 18374 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.842846 18434 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.846158 18448 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.906111 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:45.843402 18286 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:45.924211 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54662.2us
I20260709 13:06:45.855085 18461 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:45.880090 18452 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.881208 18533 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:45.925805 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 72580us
I20260709 13:06:45.922195 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.874514 18445 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:45.934113 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 143079us
I20260709 13:06:45.905843 18551 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.885864 18455 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:45.934549 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:45.929942 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:45.942857 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:45.946727 16330 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:45.946918 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:45.953846 18570 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:45.955905 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:45.991154 15540 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 272) took 28765 ms (client timeout 15000 ms). Trace:
I20260709 13:06:45.991709 18570 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.992527 18376 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:45.940727 18309 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.008028 15722 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:45.993304 18111 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:46.010535 18111 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.012452 18220 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:46.013139 18111 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:46.013584 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 143156us
I20260709 13:06:45.944911 18448 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.015903 18448 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.016515 18448 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.017846 18406 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:06:46.019745 18465 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.020531 18465 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.021931 18376 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.023293 18465 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.023825 18498 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.024685 18376 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.024835 18498 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.033162 15719 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:06:46.033612 18434 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.002012 18529 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:45.999542 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 43739.7us
I20260709 13:06:46.001540 18459 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.034253 15720 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:45.930372 18519 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.174s
I20260709 13:06:46.004522 18576 raft_consensus.cc:2764] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:46.045718 18286 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:46.063212 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 108905us
I20260709 13:06:46.066463 16330 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.013178 18220 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:46.081224 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.985378 18455 consensus_queue.cc:1243] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:06:46.085043 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 144400us
I20260709 13:06:46.017248 18448 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:45.985268 18452 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:46.142480 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.062350 18459 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:46.005349 18551 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.180464 18220 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:46.181929 18445 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:45.994549 15540 rpcz_store.cc:269] 0709 13:06:17.158896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.159098 (+   202us) service_pool.cc:224] Handling call
0709 13:06:45.916206 (+28757108us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:41.677459 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:41.710710 (+ 33251us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:41.710751 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:06:41.710774 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:41.711172 (+   398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:41.711250 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:41.711294 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:41.711519 (+   225us) tablet.cc:701] Row locks acquired
0709 13:06:41.711540 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:41.711701 (+   161us) write_op.cc:270] Start()
0709 13:06:41.711821 (+   120us) write_op.cc:276] Timestamp: P: 1783602401711651 usec, L: 0
0709 13:06:41.711844 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:41.712592 (+   748us) log.cc:844] Serialized 535 byte log entry
0709 13:06:42.230231 (+517639us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b5400106920. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2537d6b8 00007fad2537d2fa 00007fad25401965 00007fad25401e09 00007fad28e3c581 00007fad28e3bd58 00007fad28e409f1 00007fad28e409a9 00007fad28e40939 00007fad28e40901
0709 13:06:42.234050 (+  3819us) op_driver.cc:464] REPLICATION: finished
0709 13:06:42.358246 (+124196us) write_op.cc:301] APPLY: starting
0709 13:06:42.358336 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:42.358447 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:42.358469 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:42.358734 (+   265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:42.358905 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:42.358969 (+    64us) write_op.cc:312] APPLY: finished
0709 13:06:42.359191 (+   222us) log.cc:844] Serialized 23 byte log entry
0709 13:06:42.359364 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.359441 (+    77us) write_op.cc:454] Released schema lock
0709 13:06:42.359481 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:42.359897 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.359987 (+    90us) write_op.cc:454] Released schema lock
0709 13:06:43.319640 (+959653us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540332a 00007fad25388f14 00007fad25388ec3 00007fad25388e38 00007fad25388df3 00007fad253880dc 00007fad253b1e16 00007fad25399cbb 00007fad2538439d 00007fad25387d75
Metrics: {"mutex_wait_us":162486,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":123902,"apply.run_cpu_time_us":1626,"apply.run_wall_time_us":1627,"num_ops":1,"prepare.queue_time_us":249403,"prepare.run_cpu_time_us":18807,"prepare.run_wall_time_us":553096,"raft.queue_time_us":40567,"raft.run_cpu_time_us":34626,"raft.run_wall_time_us":1468213,"replication_time_us":522028,"spinlock_wait_cycles":890247808,"thread_start_us":369950,"threads_started":4,"wal-append.queue_time_us":67928,"wal-append.run_cpu_time_us":14218,"wal-append.run_wall_time_us":1580419}]]}
I20260709 13:06:46.186637 15716 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:46.181951 18551 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.198144 18498 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:46.198645 18575 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:46.202579 18461 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:46.172657 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 155730us
W20260709 13:06:46.204236 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 257471us
I20260709 13:06:46.205081 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:46.206135 18445 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:46.206769 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:46.207808 18445 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.209678 18220 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:46.212877 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.213505 18498 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.214795 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.214660 18498 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.216804 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.217773 18475 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.218464 18498 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.218366 18475 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.219087 18465 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.219328 18498 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:46.219779 18465 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.220860 18406 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:46.221452 18406 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:46.174691 18533 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.174567 18529 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.222824 18406 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.080101 18434 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.224534 18406 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.225001 18434 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.082396 18111 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.154747 18521 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.154373 18459 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.203390 18448 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.009123 18374 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:46.176781 18568 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:06:46.180497 15718 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.224596 18570 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:46.231850 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:46.243618 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65930.3us
I20260709 13:06:46.231479 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.237833 16298 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:46.242022 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.234127 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 94407us
W20260709 13:06:46.246357 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.248332 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.157927 18567 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:46.253254 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.255609 15716 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:46.257119 18478 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.257431 15793 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:46.257762 18478 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:46.257890 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.258703 16326 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.258976 18478 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.264168 18374 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.269274 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.224596 18529 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.280797 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.281030 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:46.281931 18452 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.284255 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:46.285256 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:46.291728 15542 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 4, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.293287 15638 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.286139 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:46.287256 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.288059 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.289453 15646 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:46.290318 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:46.285413 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 76998.7us
I20260709 13:06:46.292407 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.245383 18460 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.296064 15645 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:46.220883 18475 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.294459 15639 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:46.321215 15642 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:46.229365 18576 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:46.321097 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.291947 18512 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:06:46.329347 15641 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:06:46.330111 15644 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:46.337664 15718 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:46.338469 15718 pending_rounds.cc:85] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
W20260709 13:06:46.344326 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.350196 18498 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.351984 18444 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.352562 18444 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.350960 18498 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.353931 18576 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.336656 18475 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.357726 15640 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.357846 18475 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.360705 18498 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.361220 18475 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.363131 18434 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.364835 18379 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.368113 15638 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:46.328903 18452 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.328420 18264 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.339816 18465 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.383749 15788 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.384454 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.306478 18455 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.386749 15640 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:46.388465 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.339651 18529 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:06:46.358583 18444 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.390152 15792 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.346053 15542 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 4, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.343477 15718 pending_rounds.cc:107] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:46.402395 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:46.403196 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.400909 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:46.410036 15718 raft_consensus.cc:2889] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.356949 18576 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:46.414402 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 133461us
I20260709 13:06:46.416848 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:46.419152 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.419862 15645 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:46.422426 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.423291 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.424304 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.424942 15644 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:46.426096 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.426841 15641 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.429911 15645 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:46.439791 15793 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.429934 18264 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.440287 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.442611 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.443812 15638 raft_consensus.cc:2410] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:46.454432 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.430922 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.451511 18444 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.455183 15639 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.452584 15719 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:46.452032 18455 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:46.467756 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.468078 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.468523 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.468693 15795 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.469111 16326 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.469981 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.470633 15793 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.473874 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:46.474036 18580 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:46.474040 18570 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.474763 18580 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.475055 18570 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.477144 18570 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.477993 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.477171 18580 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:46.480952 18406 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.481391 18406 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.481586 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.461658 18576 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.482154 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.482777 15792 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.458693 15542 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 4 to 5, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 5 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.488777 15793 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.488440 15542 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 4, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.489912 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.503189 15794 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.463198 18444 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.504092 18444 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.504550 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.481798 18406 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.507263 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.491957 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.510321 15787 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.511602 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.512384 15647 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:46.513206 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.492893 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.514786 15787 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.492929 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.494762 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.496526 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.516489 15796 raft_consensus.cc:2376] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
I20260709 13:06:46.492414 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.519932 18264 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.521436 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.522927 18406 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.524036 18455 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.526916 18455 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:46.527458 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 110720us
I20260709 13:06:46.527575 18455 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.528052 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.528357 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:46.529294 18379 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.529845 18379 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.530275 18379 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.531028 18452 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.531630 18452 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.529313 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:46.534006 18529 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.534638 18529 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.536078 18460 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.536844 18529 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.537307 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.537400 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.537935 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.537999 18452 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.538208 16332 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:46.538009 15644 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:46.538589 15645 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.539667 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:46.539875 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.540570 18264 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:46.525481 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.541232 18264 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.541460 16331 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:46.540611 15645 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.541752 18264 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.538352 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.542451 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.542946 15639 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.546236 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.546479 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.546974 15638 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.547459 15721 raft_consensus.cc:2410] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:46.548641 18455 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.552139 18455 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.552464 18460 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.553194 18460 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.553026 18455 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.554162 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.554800 15644 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:46.555537 18460 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.548995 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.557289 15639 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.529412 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:46.558749 18576 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.559141 18576 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.559489 18576 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.524063 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.561304 15793 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:46.568068 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.568853 15793 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:46.569267 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.569921 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.563970 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.563303 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.564574 15791 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.564730 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.565186 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.565461 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.572892 15790 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:46.573011 15794 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.569432 16325 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:46.569974 16326 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:46.563671 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.574223 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.576287 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.576207 18264 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.571650 16329 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:46.576649 18580 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:46.584692 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:46.577057 15647 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:46.588531 18459 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.582122 18455 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:46.590196 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.590698 18406 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.590893 15640 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:46.592545 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:46.594355 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.594967 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:46.595736 16326 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.596066 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.596978 15721 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.598480 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.599233 15640 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:46.601315 15792 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:46.606484 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.607125 18264 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.609573 18466 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:46.610599 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:46.595009 15718 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:46.561474 15542 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 5 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.622411 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.625644 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.624949 15719 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:46.629992 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.632572 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.633548 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.632087 16326 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.633232 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.635231 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:46.648136 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.637604 15713 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:46.648854 15715 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:46.654134 15722 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:46.572304 18576 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.651441 18529 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:46.632085 18570 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.651656 18406 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.663946 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.666975 15718 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:46.667181 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.664729 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.512429 18444 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.668145 15722 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:46.670001 18529 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.670228 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.671893 18406 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:46.672416 18529 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.666244 18570 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.673494 18570 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.674052 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.673584 18406 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.674927 15639 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:06:46.678104 18588 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:06:46.678802 15640 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.679278 18576 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:46.632238 18452 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.681038 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.681674 15795 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:46.683606 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.682596 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.684599 15647 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.683207 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:46.692147 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.702553 16329 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:46.652804 18286 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:06:46.714067 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.715152 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.716058 15716 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:46.736017 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.734597 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:46.738809 15644 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.647490 18379 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.739699 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.748867 18521 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.681077 18579 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:06:46.754938 15793 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:46.765908 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.758952 15542 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 3, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.766975 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.767460 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:46.704207 18452 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.767939 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.789701 15790 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:46.793974 15644 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:06:46.780776 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.781177 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:46.785815 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:46.757992 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:46.802142 18459 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.803313 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:46.804721 18452 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.805684 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.808032 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:46.809266 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.810253 15611 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.765302 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:46.811599 15611 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.822125 16330 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:46.824388 15794 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:46.780653 18587 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:06:46.872136 15716 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:46.826229 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.822293 18286 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.765966 18111 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:46.877333 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51207.6us
I20260709 13:06:46.780081 18444 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:46.836822 18529 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:46.826113 18452 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:46.782707 18379 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:46.749729 18521 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:46.834779 15542 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 4, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.878178 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.877269 18286 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.879971 18111 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:46.880507 18589 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:46.880939 18434 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:46.890748 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:46.883819 18529 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.883993 18452 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.912427 18286 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.979265 15542 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 4, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.969511 18452 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.983574 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:46.985206 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.985543 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.985946 15640 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:46.986068 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.986271 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:46.986678 15647 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:46.987013 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:46.987599 15638 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:46.985235 15645 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:46.988485 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:46.990036 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.991076 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:46.992048 18460 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:46.993052 18460 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:46.993425 18460 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.993829 18460 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.990064 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 410) took 1286 ms. Trace:
I20260709 13:06:46.995747 18465 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.996260 18465 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.996631 18465 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.998041 18455 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:46.998546 18455 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:46.999611 18455 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.003418 18521 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:47.004160 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.995039 15714 rpcz_store.cc:276] 0709 13:06:45.703415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.876726 (+173311us) service_pool.cc:224] Handling call
0709 13:06:45.877128 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.916697 (+ 39569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.916731 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.944493 (+ 27762us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.457033 (+512540us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:46.457099 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.457186 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.989773 (+532587us) raft_consensus.cc:1685] finished
0709 13:06:46.989800 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.989965 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25195,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":14528,"thread_start_us":383507,"threads_started":1,"wal-append.queue_time_us":638313}
W20260709 13:06:47.006297 18592 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.125s	user 0.000s	sys 0.005s
I20260709 13:06:46.944761 18570 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.008702 18570 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:47.013868 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 160122us
I20260709 13:06:47.016492 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:46.921720 18434 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.004160 18521 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.017957 18379 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:47.018220 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48913.4us
I20260709 13:06:47.018515 18521 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:46.943827 18444 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:47.018987 18521 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.017962 18434 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.019369 18444 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:47.020607 18444 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:47.022225 18585 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:47.018800 18379 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:46.966569 18529 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:47.019002 15685 leader_election.cc:336] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.591s (SENT)
I20260709 13:06:47.032088 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:47.024122 18455 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.030130 15542 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:47.031610 18320 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:47.048748 18286 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.040691 18111 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:47.057271 18459 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:47.061589 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.098325 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:47.103042 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.104779 15794 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:47.110263 15638 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.081393 18111 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.058495 18264 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:47.099282 18570 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.126348 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.132081 15795 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:47.134265 15794 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.144511 18286 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.145776 18286 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.146359 18286 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.148554 18286 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.154093 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:47.153949 18570 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.156383 18570 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:47.133090 18434 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.160179 18434 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.128552 18111 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.162931 18111 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.059116 18379 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.164774 18529 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.167659 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.168803 15645 raft_consensus.cc:2368] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:06:47.170133 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.173467 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.118233 18459 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:47.174623 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.173928 15640 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:47.176983 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.177727 15644 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:47.180169 15640 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:47.187263 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.188414 15646 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:47.188912 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.189481 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.189782 15647 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:47.199270 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 386216us
I20260709 13:06:47.199810 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:47.201089 15795 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.181802 18406 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:47.203891 15639 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:47.212040 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 333904us
I20260709 13:06:47.212056 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.213624 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.215699 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:47.216588 16331 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.185801 18459 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.245002 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.205626 18570 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.202790 18406 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:47.281029 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.238586 18434 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:47.280656 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 239983us
I20260709 13:06:47.291857 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:47.292862 15717 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:47.294579 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.295370 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.295886 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:47.296562 15715 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:47.298033 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.252444 18286 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.299880 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.300722 15714 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.301433 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.302276 15716 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.304342 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:47.307794 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.310917 15640 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:47.312009 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:47.320075 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.322510 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.325889 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.327049 18320 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.329718 18529 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.332365 18452 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.384014 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.333616 18455 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.287266 18434 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:47.334125 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.334235 18607 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.334831 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.335503 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.336314 15718 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:47.332370 15790 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:47.350019 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.299911 18286 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:47.351298 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.260215 18570 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.397117 15788 raft_consensus.cc:2368] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:47.397935 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.398736 16327 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:47.358317 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.359228 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.359304 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.401001 18459 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:47.381250 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.403024 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.404269 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.404817 15796 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:47.406035 15789 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:47.348320 18406 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.406976 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.407114 18406 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.396536 18286 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.393323 18607 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.410241 18607 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.414002 18613 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.416402 18264 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:47.416945 18264 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:47.394174 18434 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.405568 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.414240 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.419201 15787 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:47.422662 16331 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:47.423288 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.424125 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.394466 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.425872 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.430138 16333 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:47.430178 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:47.431015 15645 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.427403 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:47.432250 15639 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.434173 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:47.434958 15642 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.437207 15716 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:47.444979 15714 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:06:47.468078 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 297709us
W20260709 13:06:47.474956 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.475281 15638 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:47.494266 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 135152us
I20260709 13:06:47.474040 18111 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.502467 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:47.505625 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 256629us
I20260709 13:06:47.528484 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:47.468500 18465 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.493155 18608 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.437249 18286 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:47.557027 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 269662us
W20260709 13:06:47.567010 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 241182us
I20260709 13:06:47.552311 18529 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.581444 15642 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:47.552845 18608 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.586681 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.587432 15714 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.613950 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 580) took 1028 ms. Trace:
I20260709 13:06:47.614629 16328 rpcz_store.cc:276] 0709 13:06:46.532868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.533611 (+   743us) service_pool.cc:224] Handling call
0709 13:06:46.533980 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.534209 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:46.920268 (+386059us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.170423 (+250155us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b1800380320. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:06:47.543411 (+372988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.554338 (+ 10927us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:47.560420 (+  6082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.560539 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.560703 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":378449,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":21350,"raft.queue_time_us":80318,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":13308800,"thread_start_us":720191,"threads_started":2}
W20260709 13:06:47.617594 18602 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:06:47.639075 18220 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:47.642330 18605 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:06:47.642428 18452 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.644670 18434 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.574330 18478 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.647727 18478 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:47.648240 18478 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.525152 18111 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.641367 18608 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.699244 18465 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.701916 18611 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.702724 18611 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.705516 18570 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:47.709391 18521 consensus_meta.cc:287] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.690s	user 0.000s	sys 0.008s
I20260709 13:06:47.731417 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:06:47.677397 18460 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.006s
I20260709 13:06:47.506572 18264 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:47.672904 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 95984.3us
I20260709 13:06:47.715276 18286 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.726048 15639 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:47.724669 18616 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:06:47.742532 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 240133us
I20260709 13:06:47.752729 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.755347 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.664252 15795 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:06:47.730731 18444 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.665937 15645 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:47.762964 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.762981 15685 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:47.768677 18406 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:47.730186 18521 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:47.771018 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 203819us
I20260709 13:06:47.667951 15714 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
W20260709 13:06:47.793534 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 140738us
I20260709 13:06:47.764153 18529 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.824120 18521 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.824807 15641 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.782385 18444 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.825139 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:47.827219 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64329.8us
I20260709 13:06:47.827392 18444 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.827941 18444 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.828905 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.829177 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:47.829761 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:47.802690 18622 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:47.803025 18111 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:47.741600 18460 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.831133 18611 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.832144 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:47.832834 18460 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.833139 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:47.805327 18264 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.838045 18570 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.801554 18607 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.838510 18570 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.838881 18570 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.841288 18607 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.810912 18627 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:47.844810 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 81972.7us
I20260709 13:06:47.812863 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.841941 18466 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:47.844935 18611 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.811240 18478 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:47.849674 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 321284us
I20260709 13:06:47.846745 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.843327 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.848948 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.805437 18434 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.853138 15688 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.855676 18618 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.846503 18459 raft_consensus.cc:2764] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:47.847533 18465 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.855041 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.859493 18618 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.847663 18455 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.846458 18460 raft_consensus.cc:2764] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:06:47.846948 18406 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:47.857856 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.848781 18452 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:47.848641 18111 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.874577 18111 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.874702 15641 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:47.874990 18111 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.875766 18627 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.869928 18444 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.877194 18444 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:47.877570 18444 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.879918 15640 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:47.882277 18635 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 6 to 8, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:47.883080 18406 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.884025 18478 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:47.853876 18466 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:47.885202 18466 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.885910 18452 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:47.886396 18452 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.866372 18455 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:47.888401 18455 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.888695 18624 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.867234 18618 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.867781 18613 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:47.870977 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:47.866724 18465 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.871829 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.933951 18465 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.930783 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:47.934675 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62928us
W20260709 13:06:47.896236 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.864068 18607 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:47.898193 15611 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.938014 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:47.939214 18620 raft_consensus.cc:2764] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:47.939951 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.940580 18620 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:47.940838 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:47.941169 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.898833 18434 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:47.892721 18624 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:47.912050 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:47.917207 18608 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.921141 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.864929 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.924661 15641 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:47.916998 18455 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:47.930178 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59256.4us
I20260709 13:06:47.952201 15643 raft_consensus.cc:2368] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7.
I20260709 13:06:47.952577 15685 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:47.931865 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.931991 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:47.897785 16330 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:47.953361 15644 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:47.953509 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
W20260709 13:06:47.951819 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 86969.1us
I20260709 13:06:47.942850 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.943446 15646 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:47.943647 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.942523 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.955837 15717 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.942152 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:47.941771 15714 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.956485 15715 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:47.958014 15719 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:47.960040 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.960870 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.962668 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:47.961474 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.963236 15720 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.963276 15762 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:47.941727 18627 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:47.943441 18264 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.964326 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:47.971800 15644 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.967824 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:47.942924 18434 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:47.954653 18607 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:47.953608 18624 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.969864 18455 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:47.943373 18613 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:47.970508 18579 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.950018 18580 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:47.993876 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.995203 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.966586 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:47.980144 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.960320 18460 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.927115 18444 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:47.981721 18220 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.999244 18220 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:47.999358 18286 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:47.976147 18264 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:47.999964 18264 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.000295 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:47.999701 18220 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.976318 18459 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.999894 18286 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.975975 18475 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.001982 18459 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:48.002259 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.006736 18459 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.006938 15715 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.989943 18627 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:48.002353 18460 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.008857 18460 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.009673 18613 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:48.009372 18627 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.010178 18580 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.010638 18580 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.003224 15722 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:48.013988 18455 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:48.014617 18455 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.016888 18455 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:48.024107 15717 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:48.030845 15714 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:47.966490 18630 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.026206 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.071688 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:48.081027 15795 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:48.072849 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.077399 15644 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:48.083636 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.086198 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:48.086877 15794 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:48.087915 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.089058 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:47.989372 18608 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:48.070936 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 45099.1us
I20260709 13:06:48.092551 15611 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.095542 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.004483 18444 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.005370 18286 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.097443 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.102873 15792 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:48.095705 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 143198us
I20260709 13:06:48.099186 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:48.104612 15793 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:48.099963 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.104842 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.100646 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.101323 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.106076 15790 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.006107 18475 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:48.107255 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.108119 15722 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.106081 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.054538 18630 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.114638 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:48.062892 18613 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.086242 18611 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:48.063292 18629 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.070325 18455 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.015920 18618 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.114718 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:48.119205 15685 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.020512 18570 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.109987 18475 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.124827 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.127113 15720 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:48.135314 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:48.141055 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.142201 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 169237us
I20260709 13:06:48.141417 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.143281 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.143411 15714 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:48.117508 18634 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:48.115844 18630 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.128930 18635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56118 (request call id 76) took 2309 ms. Trace:
I20260709 13:06:48.163012 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.150785 18434 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.151038 18620 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:48.164690 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.157150 18466 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.171478 15790 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
W20260709 13:06:48.173441 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58825.4us
I20260709 13:06:48.170953 15715 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:48.175523 15792 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:48.123248 18613 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.149860 18611 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:48.182735 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.184176 15715 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:48.176750 18641 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:06:48.179984 18620 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:48.180051 18529 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:48.173938 18634 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:48.176211 18636 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:48.202612 18636 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.202701 18529 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.188089 18613 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.178567 18466 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:48.176245 18406 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.218883 18529 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.210892 18639 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.204944 18620 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:48.171653 18111 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.193509 18452 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.228096 18466 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.239414 18111 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.240482 18620 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.242108 18620 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.189005 18570 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:48.140761 18455 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.184818 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.200194 18611 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.200765 18220 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.203223 18636 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.140188 18607 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.132253 18629 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.172844 18635 rpcz_store.cc:276] 0709 13:06:45.809598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.809778 (+   180us) service_pool.cc:224] Handling call
0709 13:06:46.455725 (+645947us) log.cc:844] Serialized 487 byte log entry
0709 13:06:46.516720 (+ 60995us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540047c7d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540c735 00007fad254049fa 00007fad2a3cc4c9 00007fad23948c54 00007fad23948be2 00007fad23948b11 00007fad23948a8c 00007fad23947d42 00007fad2374148c 00007fad237408c6
0709 13:06:48.116726 (+1600006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9217,"raft.queue_time_us":9455,"raft.run_cpu_time_us":1149,"raft.run_wall_time_us":1148,"spinlock_wait_cycles":1315417216}
I20260709 13:06:48.202417 18634 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:48.212543 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77309.6us
I20260709 13:06:48.268393 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:48.211253 15720 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:48.212105 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 183674us
I20260709 13:06:48.188691 18320 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:48.224967 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.193492 18460 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.235087 18580 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:48.255653 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 111581us
I20260709 13:06:48.274865 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:48.260037 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 185770us
I20260709 13:06:48.242899 18452 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:48.245508 18618 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:48.258872 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 74131.9us
I20260709 13:06:48.282912 15719 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:48.276464 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.281512 15721 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:48.262526 18639 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.282375 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.243417 18465 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.244417 18264 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:48.290172 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65298us
I20260709 13:06:48.292269 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.292975 15762 leader_election.cc:400] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:06:48.303059 15762 leader_election.cc:403] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.294610 15717 raft_consensus.cc:2368] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:48.295691 15720 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:48.305015 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.302220 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:48.246536 18466 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.305985 15720 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.297344 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.314282 18262 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:48.314994 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.315742 15721 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:48.316534 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.307587 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:48.317076 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48806.1us
I20260709 13:06:48.317212 15721 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.263141 18286 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.324846 15720 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:48.325505 15610 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.329807 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:48.292991 18111 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.327152 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.328697 15719 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:48.332065 15716 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.294939 18478 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.293984 18529 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:48.295143 18406 raft_consensus.cc:2764] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:06:48.302417 18639 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:48.337389 15720 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:48.334174 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b106b4017dc84b21a7c6f58814593886 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:06:48.338166 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51833.9us
I20260709 13:06:48.338822 15719 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:06:48.339136 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.341580 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:48.329214 18521 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.328936 15714 raft_consensus.cc:2368] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:48.276021 18624 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.332438 18452 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.331360 18579 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:06:48.334748 18660 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:48.351042 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.352648 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.345639 18618 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.347766 18529 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:48.358222 15719 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.392752 15715 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:48.448923 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 97944.1us
I20260709 13:06:48.363968 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.456138 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.355468 15720 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:48.376348 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.338054 18631 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:06:48.463907 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.462996 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 99105.5us
I20260709 13:06:48.355461 18613 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.465487 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.347108 18478 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.360443 18111 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.469839 15720 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.363174 18220 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:48.363516 18580 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:48.367771 18455 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:48.458487 18569 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.366637 18264 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.363767 18618 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:48.363287 18406 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.464679 18579 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.393662 18668 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.367077 18475 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.485183 18466 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:48.485941 18465 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.369208 18459 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.488210 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.490067 18455 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.392969 18660 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.468269 18613 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:48.492576 18618 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:48.536099 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 204440us
I20260709 13:06:48.481729 18664 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.472071 18661 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:06:48.479799 18111 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:48.593796 18665 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:48.367383 18529 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.540897 18286 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.583549 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:48.537178 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 241988us
W20260709 13:06:48.586498 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 121096us
I20260709 13:06:48.533034 18444 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.532548 18668 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:48.534600 18569 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:48.591207 15718 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:48.591984 15717 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:48.595402 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 131331us
I20260709 13:06:48.596927 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:48.549050 18579 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:48.597527 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.542105 18460 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.613080 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.582890 18613 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:48.612705 18658 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:06:48.625597 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:48.625824 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.627095 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:48.628625 15640 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.629679 15639 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:48.552476 18629 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:48.480748 18639 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.635407 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:48.615341 18262 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.635756 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:48.620880 18111 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.640261 15610 leader_election.cc:400] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:48.644268 15643 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:48.644835 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.583945 18632 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.269s
I20260709 13:06:48.616789 18668 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.634233 18286 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.615861 18631 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:48.647678 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50179.3us
I20260709 13:06:48.646600 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:48.649173 15610 leader_election.cc:403] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.656030 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:48.659349 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:48.654712 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 315625us
I20260709 13:06:48.666726 15722 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:48.668704 18521 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:48.669433 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.670127 15720 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.671218 15644 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:48.677881 18677 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:48.679414 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 82584us
I20260709 13:06:48.680521 18610 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:48.677330 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.682106 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:48.682814 18666 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:48.683308 18666 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.683656 18666 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.684723 15721 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:48.685201 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45081.1us
I20260709 13:06:48.686012 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.686466 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:48.686746 15721 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.687659 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.689134 15720 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:48.690299 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.691301 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.691846 15720 raft_consensus.cc:2368] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:48.692481 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:48.693293 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.637511 18634 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.699295 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.699882 15720 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:48.710520 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 51283.4us
I20260709 13:06:48.713796 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:48.713815 15717 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:48.714820 15717 pending_rounds.cc:85] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 6
I20260709 13:06:48.715062 15717 pending_rounds.cc:107] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:48.715325 15717 raft_consensus.cc:2889] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.694168 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:48.701377 15721 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:48.647331 18262 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:48.717854 16331 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:06:48.717859 15721 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.718086 18262 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.719345 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:48.719515 18262 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.719661 15721 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.721179 15721 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:48.722321 15721 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:48.634336 18661 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:06:48.723865 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46646.1us
I20260709 13:06:48.763298 18611 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:48.767769 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.659741 18475 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:48.739691 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 45600.3us
W20260709 13:06:48.752316 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 144075us
W20260709 13:06:48.774662 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.775355 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:48.753885 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54661.1us
I20260709 13:06:48.753968 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:48.763648 15721 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.776451 16330 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.703099 18607 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 4. Current term is 5.
I20260709 13:06:48.710160 18608 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.777076 18611 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:48.779697 18569 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.778187 18460 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:48.781078 18460 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:48.780462 18611 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.781461 18460 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:48.810024 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.771698 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.772046 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:48.783020 18478 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.786536 18660 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:48.763965 18286 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.774339 18579 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.722910 18671 raft_consensus.cc:2764] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:48.795228 18624 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.795075 18613 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.796205 18459 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.800092 18618 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.711458 18521 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.833213 18521 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.833640 18521 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.762535 18677 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.810873 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:48.825965 18664 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 13:06:48.817773 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46129.6us
I20260709 13:06:48.840931 18618 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.841289 16330 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:48.842097 15722 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.843616 18466 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:48.844033 18466 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:48.845790 18679 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:48.848989 18631 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.762555 18621 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:48.853427 18621 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:48.855095 18630 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.000s
I20260709 13:06:48.855788 16333 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:48.855602 18630 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.857651 16333 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:06:48.859107 15720 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:48.859737 18636 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 13:06:48.860210 18613 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.860160 18636 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.860514 18475 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:48.861593 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.822192 18629 raft_consensus.cc:2764] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:48.865409 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:48.877065 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.878397 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.886229 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.887265 15716 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:48.888412 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:48.890259 15716 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:48.891724 15639 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:48.902473 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45076.7us
I20260709 13:06:48.863804 18661 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.901242 15646 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
W20260709 13:06:48.908545 16300 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.044s (SENT)
I20260709 13:06:48.886716 18662 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:48.917765 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 141231us
I20260709 13:06:48.849080 18666 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.864249 18624 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:06:48.894832 18620 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.919255 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:48.915524 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.928319 18673 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.921207 18656 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:48.903359 18521 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.931232 18521 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:48.904094 18570 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:06:48.893831 18632 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:06:48.936482 18570 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:48.936872 18570 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:48.937713 18624 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.938140 18624 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:48.938256 18630 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:48.913014 18466 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.938993 18624 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:48.940213 18466 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.940290 18624 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.946784 15714 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:48.950224 15714 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:48.951634 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:48.902621 18635 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:48.959386 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:48.963320 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48197.9us
I20260709 13:06:48.964449 15714 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:48.966539 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 100153us
I20260709 13:06:48.946509 18521 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:48.970759 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:48.973585 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68170.8us
I20260709 13:06:48.963094 18610 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.965255 18669 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.992282 16330 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.995801 15760 leader_election.cc:400] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:48.996130 15760 leader_election.cc:403] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:06:48.987437 15685 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.786s (SENT)
W20260709 13:06:48.998417 15685 leader_election.cc:336] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.824s (SENT)
W20260709 13:06:48.941850 18220 consensus_queue.cc:1175] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" responder_term: 8 status { last_received { term: 7 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:49.024807 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:48.914248 18621 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:48.968164 18631 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.974800 18286 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.001503 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.003134 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:49.007262 15688 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.688s (SENT)
I20260709 13:06:48.937773 18570 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.000607 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.041401 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.042969 15638 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:49.036243 15714 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.043924 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:49.040380 15642 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.046715 15645 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:49.042152 15641 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.047839 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:48.994374 18669 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:49.053330 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:48.971658 18608 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:48.974228 18678 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:06:49.022595 18693 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:49.067203 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68801.3us
I20260709 13:06:48.974691 18521 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.069370 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.070472 15638 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.060173 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.071094 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.059144 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:48.975395 18529 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:49.071921 15644 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.073635 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:48.999781 18656 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:06:49.073061 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.071378 15642 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.034792 18630 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:49.052976 18610 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.045449 18631 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.078333 15645 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:49.078269 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.057096 18669 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.079172 15647 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:49.080556 18286 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:49.081429 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.035223 18635 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:49.057825 18678 consensus_queue.cc:1243] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:49.103559 15716 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:49.090612 18654 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:49.092317 18673 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.054241 18632 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:49.097452 18286 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.113328 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.077642 18674 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.114645 15640 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.114547 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.115000 18286 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.098899 18656 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:49.116307 18656 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.117151 18656 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.118407 18656 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.118467 18668 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.119963 16328 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.121142 18668 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:49.077945 18570 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:49.101344 18649 consensus_queue.cc:1175] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:49.068679 18664 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:49.050354 18569 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:49.089830 18666 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:49.112048 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.067426 18579 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:49.112987 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.115149 15647 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.126513 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.138648 15645 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.099706 18630 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.128135 15644 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.153175 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.154213 15644 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.133288 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:49.135989 15638 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.110548 18673 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:49.196233 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63046.3us
I20260709 13:06:49.197268 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.198750 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.067801 18662 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:06:49.103418 18636 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.195041 15642 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:49.202800 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:49.206765 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.207593 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
W20260709 13:06:49.207922 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 129442us
I20260709 13:06:49.211771 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.212378 15644 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.159446 18629 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.151024 18630 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:49.220151 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.127573 18654 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.202790 18611 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.218441 18685 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.232577 18693 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:49.232129 18673 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.208688 18678 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.217152 18629 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:49.236984 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.237389 18580 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.277668 15647 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.206712 18286 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:49.240801 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 187469us
I20260709 13:06:49.240901 15644 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.278647 15760 leader_election.cc:400] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
W20260709 13:06:49.247063 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:49.234524 18631 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:49.274768 16331 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:49.276808 18671 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.241346 18610 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:49.285017 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:49.282356 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.237927 18475 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:49.285974 15718 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.295209 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:49.295783 18444 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.295974 15717 raft_consensus.cc:2368] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:49.296401 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:49.277437 18521 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.282295 18460 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.301033 18700 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:49.300889 18610 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:49.302492 18262 consensus_meta.cc:287] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:06:49.250331 18624 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:49.277496 18580 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.316128 15713 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:49.316919 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.317183 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.317693 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.318686 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.338006 15647 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.317513 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:49.286083 18671 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.304235 18673 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.344604 18262 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:49.354552 18262 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.355208 18460 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.355871 18630 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.356748 18262 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:49.357304 18630 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.282711 18664 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:06:49.358354 18624 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.358779 18624 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:49.360433 18624 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.339114 15646 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:49.341727 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:49.343598 18619 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:49.344604 18706 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:49.344847 18676 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.345681 18580 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.374771 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.347731 18654 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.366788 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:06:49.337419 18434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.013s	sys 0.008s
I20260709 13:06:49.362758 18671 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.362149 18636 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:49.389967 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.391377 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.372901 18676 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:49.392870 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.357340 18262 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:49.385749 18434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.013s	sys 0.008s
I20260709 13:06:49.414994 15647 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:06:49.415136 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.415931 15796 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.417156 15645 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.420145 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.421260 18654 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:49.396638 18580 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.425830 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.426283 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.427610 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.428211 15791 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.394681 18676 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.374833 18619 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.425709 18654 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:49.438874 18654 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.443281 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.450580 18657 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:49.451264 18657 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.459138 18657 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.462249 18635 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:49.462745 18635 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.463662 18635 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.464731 18635 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.484246 15791 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:49.491149 15791 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:49.421538 18693 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:49.418329 18262 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.499029 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.499837 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.501076 15789 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:49.501865 15788 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:49.504312 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:49.504489 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.511147 15789 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:49.511946 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.516041 16333 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:49.516230 18475 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.518105 15789 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.516299 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.521275 15787 raft_consensus.cc:2410] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:49.516572 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.522333 15788 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:49.549881 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.515834 18693 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.557183 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.557893 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.558691 15794 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:49.561718 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.565904 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.520547 18613 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:49.603623 18613 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.564420 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.606056 18613 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.606782 15645 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:49.584400 18704 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:06:49.610307 18619 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.566160 18701 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.573901 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.610841 18701 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:49.611281 18701 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.611726 15640 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:49.587749 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.613557 18611 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.615165 18634 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.615576 18634 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:49.617372 18627 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.616380 18634 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.618914 18654 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:49.618981 18627 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:49.619697 18634 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.619566 18654 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.620560 18569 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.620935 18569 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.621773 18569 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.622738 18569 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:49.622776 18111 consensus_queue.cc:1175] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c1927141dc2540dab644a00fd6843fc6" responder_term: 5 status { last_received { term: 5 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 5 index: 5 } }
I20260709 13:06:49.624938 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.625671 15646 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.599006 15643 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:49.582032 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.629449 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.611579 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.589192 18621 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.631273 15787 raft_consensus.cc:2410] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:49.632439 15645 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.634114 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1592) took 1004 ms. Trace:
I20260709 13:06:49.601377 18629 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.634529 15639 rpcz_store.cc:276] 0709 13:06:48.629536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.635138 (+  5602us) service_pool.cc:224] Handling call
0709 13:06:49.633904 (+998766us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400345654. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:49.634032 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587268864}
I20260709 13:06:49.634931 18262 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:49.635371 18629 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.600741 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.644694 15642 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.652890 15796 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:49.654201 15794 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:49.656284 15796 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:49.658802 15646 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:49.583323 18693 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:49.660202 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.667449 15760 leader_election.cc:400] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:49.671348 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.672463 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.667351 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:49.673645 15643 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.675084 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.676913 15714 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:49.680297 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:49.683449 15716 raft_consensus.cc:1217] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-7.4]   Dedup: 3.2->[5.3-7.4]
I20260709 13:06:49.591552 18664 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:49.683951 15716 pending_rounds.cc:85] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 2
I20260709 13:06:49.523864 18669 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.689854 15714 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:49.690333 15716 pending_rounds.cc:107] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:49.692453 15716 raft_consensus.cc:2889] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.689453 15793 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:49.693023 15793 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.693166 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:49.665064 18630 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.658406 18654 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.693813 15793 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.700876 15793 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.678413 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.706669 15714 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:06:49.708971 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.708801 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 341878us
I20260709 13:06:49.692324 18674 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.696080 18662 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.700250 18611 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.711229 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.723758 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:06:49.727324 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 212891us
I20260709 13:06:49.730724 16333 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.732445 15713 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:49.732882 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:49.715675 18220 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.733533 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.695446 18664 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.712795 18662 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.720645 18685 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.705420 18630 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.705945 18639 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:06:49.750769 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.727073 18444 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.744287 18613 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.761492 15793 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:49.743709 18220 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.764235 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.717267 18676 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.765501 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:49.765476 15793 pending_rounds.cc:85] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 4
I20260709 13:06:49.770772 15793 pending_rounds.cc:107] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:49.771205 15793 raft_consensus.cc:2889] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.771353 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.745337 18611 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:49.767671 18262 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.767297 18459 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:49.766829 18613 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:49.784322 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.772866 18264 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.767364 18444 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:49.763357 18607 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:49.772799 18434 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.767745 18674 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:06:49.793772 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.770776 18685 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:49.800658 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.770552 18671 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.772544 18716 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:49.795373 18678 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.790581 18613 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:49.811098 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45671.4us
I20260709 13:06:49.831061 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:49.811317 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.793066 18459 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:49.771514 18724 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:49.815164 15641 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:49.834786 15788 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:49.835573 18459 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.836874 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.794049 18728 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.842365 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.794399 18262 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:49.848657 15722 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7.
I20260709 13:06:49.786855 18703 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:06:49.860283 15789 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:06:49.863215 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 66416.2us
I20260709 13:06:49.865084 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:49.865247 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.871851 18739 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.872684 18739 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:49.873955 18739 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.875939 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.876695 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.877334 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.878432 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.878271 15789 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:49.879611 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:49.877671 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 60326us
I20260709 13:06:49.886132 15645 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:49.887724 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.787901 18662 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:49.898524 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.900558 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:49.901064 15641 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.894461 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:49.894949 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:49.896070 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.896907 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.831974 18434 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:06:49.924207 15788 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:49.885720 18678 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:49.879194 18660 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.876912 18669 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:49.932878 18724 consensus_queue.cc:1243] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:49.933319 18743 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:49.993113 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:49.935952 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.937646 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:49.805559 18220 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.960714 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:49.961268 18662 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.961962 18735 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:49.963290 18730 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:49.964411 18671 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:49.965832 18660 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:49.928216 18264 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:49.970072 18262 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.034611 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:49.975914 15641 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:49.977945 18630 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:49.996447 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 101794us
I20260709 13:06:49.999117 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:49.999872 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:50.000366 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:50.068972 15719 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:50.014061 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:49.934337 18678 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:50.019666 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:50.029206 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.029920 18734 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.031134 18660 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.032413 18264 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.019608 18220 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.066876 16328 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.108633 15788 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:50.069599 15789 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.036573 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:50.109987 15645 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.011673 18664 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:50.072990 15718 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:50.009197 18619 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.037048 18674 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.029234 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:50.084110 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:50.112323 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:50.078591 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:50.147023 15717 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:50.151293 15788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:06:50.204843 15788 raft_consensus.cc:606] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:50.134518 18619 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.206152 18619 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.152146 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:50.210446 15713 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.979494 18444 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:50.217422 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.137100 18730 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:06:50.150748 18634 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.009s
I20260709 13:06:50.077369 18728 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:50.235440 15790 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:50.267181 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.144151 18636 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.020443 18743 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:50.235441 18701 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.000s
I20260709 13:06:50.274919 15721 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:50.212915 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 346404us
I20260709 13:06:50.235425 18654 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.294405 15645 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:50.293908 15789 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:50.296314 15720 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:50.275259 18607 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.280499 18627 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:50.305913 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.287542 18618 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.290505 18624 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.324905 16332 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:50.281534 18636 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.338860 18745 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:50.339686 18745 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.085366 18734 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.288367 18701 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.351316 15719 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:50.352492 15720 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:50.321574 18685 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 13:06:50.359616 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 514702us
I20260709 13:06:50.382346 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:50.326224 18741 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.385234 18741 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.306478 18607 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.387966 18741 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.388427 18607 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.389079 18607 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:50.302939 18654 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:50.389561 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 524232us
I20260709 13:06:50.362560 18752 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:50.370091 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.408095 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.375583 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:50.378701 18743 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:50.279274 18678 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:50.361227 15685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.526s (SENT) [suppressed 21 similar messages]
I20260709 13:06:50.380466 18701 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.321172 18627 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.429029 18627 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:50.328424 18618 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.389966 18630 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:50.452746 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.446643 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50904.8us
W20260709 13:06:50.457871 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 96659.4us
W20260709 13:06:50.458621 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.418357 18752 consensus_queue.cc:1243] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:50.431298 18705 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.471999 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:50.472788 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.462040 18621 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.003s
I20260709 13:06:50.484283 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:50.487489 18750 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:06:50.488417 18747 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:06:50.354158 18728 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.493773 18636 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:50.469380 18744 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 13:06:50.495064 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.504225 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.473793 18620 raft_consensus.cc:993] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:06:50.501142 15787 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:50.508105 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:50.504905 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.508525 16332 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:50.485877 18700 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.511904 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:50.497648 15685 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.666s (SENT)
I20260709 13:06:50.543200 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:50.541136 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:50.500305 18676 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.500941 18701 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:50.547044 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 190751us
I20260709 13:06:50.514950 18621 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.584540 15715 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.498608 18685 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:06:50.540311 18466 raft_consensus.cc:2764] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:06:50.588269 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 90673.7us
W20260709 13:06:50.576992 18744 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:50.506629 18745 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.594553 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:50.599983 15720 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:50.523334 18718 raft_consensus.cc:1081] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
W20260709 13:06:50.546223 18629 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.910s	user 0.012s	sys 0.001s
I20260709 13:06:50.587239 18264 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:50.585820 18569 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.962s	user 0.009s	sys 0.006s
I20260709 13:06:50.540652 18620 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.592322 18662 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 13:06:50.605446 18762 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:50.540436 18700 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.582104 18262 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:50.596566 18444 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.636816 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 232945us
I20260709 13:06:50.582581 18701 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.590996 18630 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:50.591274 18621 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:50.639878 18757 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:06:50.634192 18752 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.654953 15720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:06:50.655565 15720 raft_consensus.cc:606] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:50.655900 15720 raft_consensus.cc:614] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:50.644863 18654 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:50.673774 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 169112us
I20260709 13:06:50.641425 18620 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.677372 16333 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.652660 18669 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.679390 15789 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:50.668373 18758 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.649905 18444 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:50.677712 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 130295us
I20260709 13:06:50.682952 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:50.695315 15791 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:50.658946 18752 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.673970 18734 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.662356 15796 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:50.718847 18669 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:50.698789 18613 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.838s	user 0.012s	sys 0.000s
W20260709 13:06:50.735870 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88725.8us
I20260709 13:06:50.718555 18618 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.740242 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:50.685913 18379 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:50.742756 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:50.743393 16333 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:50.743783 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:50.742161 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:50.736544 18761 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:06:50.748828 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:50.700755 18764 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:06:50.736456 18734 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.756824 18734 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.757323 18444 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:50.761477 18722 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.035s	user 0.004s	sys 0.000s
I20260709 13:06:50.734699 18613 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:50.766193 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1463) took 1481 ms (client timeout 1599 ms). Trace:
I20260709 13:06:50.696235 18758 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.770026 15714 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
W20260709 13:06:50.765499 18220 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.000s
W20260709 13:06:50.772364 15722 rpcz_store.cc:269] 0709 13:06:49.284352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.284463 (+   111us) service_pool.cc:224] Handling call
0709 13:06:50.765975 (+1481512us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54001e7b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:50.766130 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268137344}
I20260709 13:06:50.780397 15645 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.781688 15641 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:50.766738 18379 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:50.785300 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.787866 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:50.788599 15642 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.791651 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.793893 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.794564 15645 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 3.
I20260709 13:06:50.793618 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:50.800097 15793 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
W20260709 13:06:50.801842 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.804734 18767 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:06:50.807276 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.807544 15641 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:50.809028 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.809659 15645 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:50.812376 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.813324 15639 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:50.784230 18676 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:50.827068 15639 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:50.806843 18765 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:06:50.836257 15717 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:50.843910 15717 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:50.836442 18379 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.830525 15642 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:50.793159 18700 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:50.811877 18621 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:50.823001 18220 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.850096 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:50.843218 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:50.850711 15790 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.848785 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:50.854528 18669 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.855134 18611 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:50.855574 18611 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:50.856426 18611 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.857128 18613 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:50.858170 15717 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.846249 18379 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.859330 15717 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.860637 18379 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:50.862274 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:50.862737 18734 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:50.863500 18778 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.864027 18778 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:50.865963 18752 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:50.866416 18771 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:06:50.868283 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1981) took 1078 ms. Trace:
I20260709 13:06:50.868650 15793 rpcz_store.cc:276] 0709 13:06:49.790100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.793512 (+  3412us) service_pool.cc:224] Handling call
0709 13:06:50.868083 (+1074571us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b540047ccd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:50.868202 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275960576}
W20260709 13:06:50.870517 18619 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.003s
I20260709 13:06:50.870939 18619 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.872977 18619 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.875540 18769 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.876030 18769 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:50.879251 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:50.880498 18758 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:50.880900 15760 leader_election.cc:336] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.599s (SENT)
I20260709 13:06:50.881517 18620 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:50.822682 18770 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:06:50.881918 18716 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.886606 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2187) took 1415 ms. Trace:
I20260709 13:06:50.887328 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:50.887176 15792 rpcz_store.cc:276] 0709 13:06:49.470913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.471359 (+   446us) service_pool.cc:224] Handling call
0709 13:06:49.480757 (+  9398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.498518 (+ 17761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.498552 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.499147 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.663317 (+164170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:49.669527 (+  6210us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.689987 (+ 20460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.690081 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.760800 (+1070719us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:50.886294 (+125494us) raft_consensus.cc:1685] finished
0709 13:06:50.886398 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.886542 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75126,"prepare.queue_time_us":5680,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":42396,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9604,"spinlock_wait_cycles":7242752,"thread_start_us":163597,"threads_started":1,"wal-append.queue_time_us":188954}
I20260709 13:06:50.881551 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:50.895437 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:50.895531 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:50.902490 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53832.3us
I20260709 13:06:50.903977 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:50.844939 18701 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:50.924700 15717 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:50.954748 15717 pending_rounds.cc:85] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 8
I20260709 13:06:50.955107 15717 pending_rounds.cc:107] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:50.955413 15717 raft_consensus.cc:2889] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.886405 18579 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:51.006831 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 56136.7us
W20260709 13:06:51.024147 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 231503us
I20260709 13:06:50.844977 18676 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.951890 18580 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.955322 18685 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.877007 18769 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:50.951098 18700 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.005834 18701 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:51.006312 18579 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:51.042101 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.051973 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.053454 15642 raft_consensus.cc:2410] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:51.054744 15640 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 13:06:51.034768 18778 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.078367 18788 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:51.078691 18621 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:51.081513 18753 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.083051 18772 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.060281 18379 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:51.085213 18379 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.088475 18379 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:51.108726 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 83539.6us
I20260709 13:06:51.049113 18701 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.036669 18685 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.116732 15790 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:51.067550 18580 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:51.121026 15610 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:51.123292 18778 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.124728 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:51.126021 18784 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:06:51.126654 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:51.079552 18621 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.127565 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:51.118194 18705 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.003s
W20260709 13:06:51.129583 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 225678us
I20260709 13:06:51.131454 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:51.133839 15645 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.084400 18779 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:51.130558 18619 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.120741 18620 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.132640 18610 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:06:51.142891 18610 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:51.137388 18768 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.127986 18778 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:51.119372 18579 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.079208 18788 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:51.150439 18740 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:06:51.152202 18788 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:51.167187 18621 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:51.169332 18220 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:51.169935 18699 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.170382 18699 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:51.171170 18699 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.172355 18699 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.172824 18701 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.173913 18264 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.174511 18264 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.176462 15717 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:51.155056 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.134460 18705 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:51.144521 18778 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.140543 18619 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:51.197872 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.082237 18753 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.130834 18669 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.157251 18613 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:51.147253 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66607.9us
I20260709 13:06:51.200841 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:51.184794 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.183241 15646 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:51.138378 18654 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.083691 18772 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.208671 18627 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:51.209327 15638 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:51.209286 18627 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.210752 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.211555 15638 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:51.211740 18627 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.212607 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:51.212666 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.213307 15647 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.206132 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.205355 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.187225 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.185585 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.189139 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:51.190946 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54330.3us
I20260709 13:06:51.196245 15713 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:51.196724 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:51.198669 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:51.201095 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.202665 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.176558 18264 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.203259 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.127792 18286 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:51.186264 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.176409 18475 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:51.218384 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:51.216815 15643 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:51.226527 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.188416 18434 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.246304 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.234443 18627 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:51.246304 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65015.7us
I20260709 13:06:51.230382 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.254371 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.226737 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.256645 18780 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.199743 18619 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.200978 18669 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:51.266321 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2199) took 1686 ms. Trace:
I20260709 13:06:51.266894 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
W20260709 13:06:51.266471 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 47793.4us
I20260709 13:06:51.262261 15647 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:51.196578 18618 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.270414 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.199338 18716 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.219267 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.342809 15795 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:51.277493 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:51.298974 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.343845 15719 raft_consensus.cc:2410] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:06:51.343708 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 125395us
I20260709 13:06:51.346691 15642 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:51.344013 15714 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:51.354633 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.345630 15787 rpcz_store.cc:276] 0709 13:06:49.580178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.631918 (+ 51740us) service_pool.cc:224] Handling call
0709 13:06:49.632213 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.506880 (+874667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.266058 (+759178us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540016d5d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:51.266253 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996655488}
I20260709 13:06:51.296911 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.344623 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:51.350785 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.356302 15795 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:51.356302 15720 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:51.357003 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.357347 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 706) took 1464 ms. Trace:
I20260709 13:06:51.342756 15640 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:51.357802 16328 rpcz_store.cc:276] 0709 13:06:49.893420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.893572 (+   152us) service_pool.cc:224] Handling call
0709 13:06:49.893927 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.108984 (+215057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.349305 (+1240321us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54004d53d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:51.357300 (+  7995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327786368}
I20260709 13:06:51.358739 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.343420 15713 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:51.359228 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:51.360231 16330 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:51.372000 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 152806us
I20260709 13:06:51.218336 18613 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.376915 15721 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.385818 15721 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:51.362149 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.387194 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.387396 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.387995 15714 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:51.277063 18676 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.342638 18627 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:51.347337 18735 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.409164 18627 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.415060 18753 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.354678 18618 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.343206 18785 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:51.347476 18669 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.302615 18466 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:51.396657 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.396270 18790 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.399900 18465 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:51.400349 18789 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:06:51.349963 18475 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.389814 18788 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:51.530999 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:51.401979 18639 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.402415 18452 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.531877 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:51.402755 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.532648 15787 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:51.471838 18685 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.405440 18613 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.396660 18677 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:51.349499 18434 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.386147 18624 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:51.370584 18772 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.385710 18745 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:06:51.393929 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:51.427919 18778 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.382257 18780 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:51.382527 18786 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 13:06:51.490478 15796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 1977) took 1769 ms (client timeout 2108 ms). Trace:
I20260709 13:06:51.386397 18734 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:51.432325 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.436146 18736 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:51.374109 18740 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.500535 16328 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:51.500790 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:51.502234 16325 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:51.510318 15719 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:51.590312 15646 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:51.518244 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.561798 18677 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.516207 15643 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:51.509555 18790 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:51.532948 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:51.403157 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.595824 15717 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:51.558239 18639 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.595044 18790 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.597410 15717 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:51.598341 15717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:06:51.535904 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.558036 18452 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.599702 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.600411 18452 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.600776 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:51.533471 18465 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:51.601615 15719 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.567921 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:51.602468 16331 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:51.602578 18465 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.610031 18379 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.610237 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2407) took 1935 ms. Trace:
I20260709 13:06:51.610813 15716 rpcz_store.cc:276] 0709 13:06:49.674965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.682941 (+  7976us) service_pool.cc:224] Handling call
0709 13:06:49.683263 (+   322us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:49.699929 (+ 16666us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:49.711211 (+ 11282us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.933366 (+222155us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.163647 (+1230281us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b2c000108d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:06:51.164422 (+   775us) log.cc:844] Serialized 52 byte log entry
0709 13:06:51.374855 (+210433us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:51.374893 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.374969 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.609828 (+234859us) raft_consensus.cc:1685] finished
0709 13:06:51.609952 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.610165 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12112,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":76196,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":35892,"spinlock_wait_cycles":2472320,"thread_start_us":368410,"threads_started":3,"wal-append.queue_time_us":599258,"wal-append.run_cpu_time_us":1188,"wal-append.run_wall_time_us":1005226}
I20260709 13:06:51.623394 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1470) took 1601 ms. Trace:
I20260709 13:06:51.623914 15715 rpcz_store.cc:276] 0709 13:06:50.021848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.225001 (+203153us) service_pool.cc:224] Handling call
0709 13:06:50.225334 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.586816 (+361482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.623127 (+1036311us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54003bb854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:51.623319 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825666304}
I20260709 13:06:51.593680 18677 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:51.591862 18734 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:51.629887 18734 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.569443 18624 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:51.637841 15717 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:51.638322 15717 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:51.418711 18618 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:51.512264 18466 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:51.569680 15796 rpcz_store.cc:269] 0709 13:06:49.721501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.868425 (+146924us) service_pool.cc:224] Handling call
0709 13:06:51.490260 (+1621835us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54002198d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:51.490409 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751455104}
I20260709 13:06:51.644761 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:51.625614 15715 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:51.598376 18639 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:51.572641 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 220209us
I20260709 13:06:51.657022 15787 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:51.658390 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:51.660130 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.621181 18619 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.595485 18736 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:51.664042 15685 leader_election.cc:336] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.526s (SENT)
I20260709 13:06:51.651841 18580 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:51.693156 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:51.718555 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54554.3us
I20260709 13:06:51.662704 15717 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.701719 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.687228 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.720768 15715 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:51.689656 16333 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.667904 15796 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:51.725301 15717 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.726792 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:51.733919 15715 raft_consensus.cc:2393] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:51.728303 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:51.730696 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:51.736536 15787 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:51.741370 18759 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.061s	user 0.000s	sys 0.015s
I20260709 13:06:51.742336 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:51.747543 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.717550 18618 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.751638 18569 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:51.670783 18753 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:51.773530 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.722235 18740 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.780797 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:51.670246 18718 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:06:51.721210 18452 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:51.802295 18452 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.787202 18636 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.806416 18636 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:51.809275 18636 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:51.783615 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.726997 18475 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.779438 15796 raft_consensus.cc:2410] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:51.792125 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 439) took 1792 ms. Trace:
W20260709 13:06:51.775557 18766 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:51.795851 18745 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.787477 18705 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:51.792841 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:51.811239 18434 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.719184 18627 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.811574 18669 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:51.721045 18624 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:51.781535 15529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 283328us
I20260709 13:06:51.865460 15787 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:06:52.392514 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.274034 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 448) took 1097 ms. Trace:
I20260709 13:06:52.399004 15721 rpcz_store.cc:276] 0709 13:06:51.176217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.196410 (+ 20193us) service_pool.cc:224] Handling call
0709 13:06:52.273675 (+1077265us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540026d9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:52.273931 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363693440}
I20260709 13:06:52.396193 15718 rpcz_store.cc:276] 0709 13:06:50.009761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.135176 (+125415us) service_pool.cc:224] Handling call
0709 13:06:50.135579 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.290402 (+154823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.290430 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.290471 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:50.290500 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.791824 (+1501324us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540003c354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:51.791893 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.792054 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355580288}
I20260709 13:06:51.942277 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.409170 15795 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
W20260709 13:06:52.410478 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 1.01655e+06us
W20260709 13:06:52.413810 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.414696 16328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.027s	sys 0.053s
W20260709 13:06:52.415143 16328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.027s	sys 0.053s
I20260709 13:06:51.768919 18459 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:52.424328 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 633771us
I20260709 13:06:52.424820 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 330) took 1071 ms. Trace:
I20260709 13:06:52.425115 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:52.443157 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:52.443285 15787 raft_consensus.cc:2376] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4. Re-sending same reply.
W20260709 13:06:51.929525 18800 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:06:51.783188 18782 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:51.933023 18796 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:06:51.933709 18580 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.440136 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.445088 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:52.445853 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:52.283910 18734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.019s	sys 0.034s
I20260709 13:06:52.444620 15645 rpcz_store.cc:276] 0709 13:06:51.353613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.353722 (+   109us) service_pool.cc:224] Handling call
0709 13:06:51.354686 (+   964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.693089 (+338403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.693119 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.693157 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:51.693188 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.424561 (+731373us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54002670d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:52.424610 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.424765 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777867904}
I20260709 13:06:51.932509 18799 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.438393 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.210191 18807 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:52.015169 18802 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:51.929500 18736 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:51.789870 18264 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.814014 18619 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.486537 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:52.458003 15639 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.811853 18778 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.400732 18745 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.400113 18634 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.058475 18777 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:52.399999 18703 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:52.466142 16329 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.469425 18475 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:52.476835 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.500015 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:51.786903 18569 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.439690 18465 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.789510 18618 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.479034 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.489816 18801 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.439919 18636 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:51.939554 18677 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.485384 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:52.474947 18734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.022s	sys 0.038s
I20260709 13:06:52.454275 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.524945 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.469273 18782 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.477942 18580 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.490967 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:51.931414 18790 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.493942 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:52.535302 15645 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:52.497112 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2216) took 1251 ms. Trace:
I20260709 13:06:52.536213 15792 rpcz_store.cc:276] 0709 13:06:51.245525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.246635 (+  1110us) service_pool.cc:224] Handling call
0709 13:06:51.267071 (+ 20436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.294511 (+ 27440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.294556 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.310751 (+ 16195us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.637731 (+326980us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:51.637790 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.637855 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.496849 (+858994us) raft_consensus.cc:1685] finished
0709 13:06:52.496878 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.497040 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29134,"raft.queue_time_us":27906,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":30799,"thread_start_us":255307,"threads_started":1,"wal-append.queue_time_us":344923}
I20260709 13:06:52.486444 18264 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.450273 18459 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.511461 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.405104 18780 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:52.489338 18736 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.513402 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:52.492007 18466 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:52.514174 18111 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:52.494685 18745 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.519609 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 401) took 1017 ms. Trace:
I20260709 13:06:52.546008 15796 rpcz_store.cc:276] 0709 13:06:51.503381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.477370 (+973989us) service_pool.cc:224] Handling call
0709 13:06:52.519528 (+ 42158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.499809 18634 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.478622 18799 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.523767 16330 raft_consensus.cc:2410] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:06:52.487622 15788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.034s	sys 0.048s
W20260709 13:06:52.549429 15788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.034s	sys 0.048s
I20260709 13:06:52.528650 15715 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:06:52.549877 15715 pending_rounds.cc:85] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 7
I20260709 13:06:52.549574 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.550130 15715 pending_rounds.cc:107] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:06:52.550448 15715 raft_consensus.cc:2889] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:52.517846 18434 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:52.531021 18782 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.531769 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:52.539605 15795 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:52.512364 18778 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:52.565992 18778 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.567426 18459 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.540921 18264 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.568638 18778 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.485024 18807 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.571241 18807 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.551652 18111 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.545143 18780 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.573994 18780 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.548545 18452 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.576072 18780 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:52.576817 18769 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.576999 18669 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.569290 18778 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.578660 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 397) took 1078 ms. Trace:
I20260709 13:06:52.502044 18777 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.579171 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 331) took 1225 ms. Trace:
I20260709 13:06:52.579113 15795 rpcz_store.cc:276] 0709 13:06:51.500578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.564963 (+1064385us) service_pool.cc:224] Handling call
0709 13:06:52.565357 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.565585 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.565611 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.565663 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.565694 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.578493 (+ 12799us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.578607 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.579695 15643 rpcz_store.cc:276] 0709 13:06:51.353954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.596588 (+242634us) service_pool.cc:224] Handling call
0709 13:06:51.616156 (+ 19568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.616717 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.616744 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.617371 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.767111 (+149740us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:51.767156 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.767243 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.578966 (+811723us) raft_consensus.cc:1685] finished
0709 13:06:52.578985 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.579120 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":66,"thread_start_us":149344,"threads_started":1,"wal-append.queue_time_us":852782}
W20260709 13:06:52.533011 18791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.011s	sys 0.051s
I20260709 13:06:52.574237 18111 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.526626 18636 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.581250 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 399) took 1080 ms. Trace:
I20260709 13:06:52.581614 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2421) took 1403 ms. Trace:
I20260709 13:06:52.582679 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2214) took 1338 ms. Trace:
I20260709 13:06:52.582909 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 398) took 1082 ms. Trace:
I20260709 13:06:52.550454 15792 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:52.589146 15645 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:52.502614 18703 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.578773 18618 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.622063 15795 rpcz_store.cc:276] 0709 13:06:51.501168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.580468 (+1079300us) service_pool.cc:224] Handling call
0709 13:06:52.580764 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.580958 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.580984 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.581023 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.581055 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.581107 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.581201 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.624747 15795 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:52.627086 15787 rpcz_store.cc:276] 0709 13:06:51.500858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.582159 (+1081301us) service_pool.cc:224] Handling call
0709 13:06:52.582451 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.582632 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.582654 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.582692 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.582731 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.582782 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.582866 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.629305 15787 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:52.592648 18791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.012s	sys 0.052s
I20260709 13:06:52.581179 18777 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.631342 18569 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.632189 18634 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.635285 18703 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.638000 18627 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.547281 18736 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.640125 18264 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.640784 18736 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.641857 15790 rpcz_store.cc:276] 0709 13:06:51.244767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.244931 (+   164us) service_pool.cc:224] Handling call
0709 13:06:51.245296 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.245530 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.245555 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.256596 (+ 11041us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.663814 (+407218us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:51.667223 (+  3409us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.667386 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.667458 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.582502 (+915044us) raft_consensus.cc:1685] finished
0709 13:06:52.582519 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.582629 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6948,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1012,"raft.queue_time_us":75471,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":406909,"threads_started":1,"wal-append.queue_time_us":523828}
I20260709 13:06:52.643465 18799 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:52.646015 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:52.646405 18264 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.646709 15643 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:52.647729 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:52.578785 18580 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:52.648115 15793 raft_consensus.cc:606] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:52.648806 15793 raft_consensus.cc:614] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:52.648878 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:52.649672 15645 raft_consensus.cc:2368] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:52.650874 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1624) took 1406 ms. Trace:
I20260709 13:06:52.651414 18618 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.651377 15639 rpcz_store.cc:276] 0709 13:06:51.244870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.274397 (+ 29527us) service_pool.cc:224] Handling call
0709 13:06:51.274774 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.487679 (+1212905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.650676 (+162997us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540019c654. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:52.650823 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720550784}
I20260709 13:06:52.651966 18618 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.653128 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1627) took 1279 ms. Trace:
I20260709 13:06:52.654742 15792 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:52.655372 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2000) took 1010 ms. Trace:
I20260709 13:06:52.655727 15792 rpcz_store.cc:276] 0709 13:06:51.645079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.623560 (+978481us) service_pool.cc:224] Handling call
0709 13:06:52.654405 (+ 30845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.655149 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.655324 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.656980 18618 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.661075 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1625) took 1287 ms. Trace:
I20260709 13:06:52.653447 15639 rpcz_store.cc:276] 0709 13:06:51.373866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.652426 (+1278560us) service_pool.cc:224] Handling call
0709 13:06:52.652694 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.652846 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.652868 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.652904 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.652934 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.652982 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.653078 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.648276 15643 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:52.670055 18662 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:52.670614 18662 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:52.671315 15643 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:52.671643 18662 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.673216 18662 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.684373 18790 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:52.650929 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1626) took 1277 ms. Trace:
I20260709 13:06:52.687163 15645 rpcz_store.cc:276] 0709 13:06:51.373578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.650257 (+1276679us) service_pool.cc:224] Handling call
0709 13:06:52.650523 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.650678 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.650700 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.650738 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.650764 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.650813 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.650887 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.578300 18778 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.661592 15647 rpcz_store.cc:276] 0709 13:06:51.373258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.595906 (+222648us) service_pool.cc:224] Handling call
0709 13:06:51.639349 (+ 43443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.639705 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.639731 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.663083 (+ 23352us) log.cc:844] Serialized 52 byte log entry
0709 13:06:51.903943 (+240860us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:51.930201 (+ 26258us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.408448 (+478247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.408540 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.655297 (+246757us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:52.660672 (+  5375us) raft_consensus.cc:1685] finished
0709 13:06:52.660799 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.660998 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33660,"prepare.queue_time_us":24597,"prepare.run_cpu_time_us":44037,"prepare.run_wall_time_us":485826,"raft.queue_time_us":45282,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":50878,"spinlock_wait_cycles":36390272,"thread_start_us":216931,"threads_started":1,"wal-append.queue_time_us":941395}
W20260709 13:06:52.708830 15722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.035s	sys 0.026s
W20260709 13:06:52.710332 15722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.035s	sys 0.026s
I20260709 13:06:52.716467 15647 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:52.625829 15719 rpcz_store.cc:276] 0709 13:06:51.177960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.602363 (+424403us) service_pool.cc:224] Handling call
0709 13:06:51.602631 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.602972 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.602997 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.603429 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.786125 (+182696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:51.786174 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.786278 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.581435 (+795157us) raft_consensus.cc:1685] finished
0709 13:06:52.581450 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.581560 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11463,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":182278,"threads_started":1,"wal-append.queue_time_us":936270}
I20260709 13:06:52.718086 15647 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:52.719564 15647 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:52.715704 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2424) took 1516 ms. Trace:
I20260709 13:06:52.709503 18778 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.720654 15722 rpcz_store.cc:276] 0709 13:06:51.199244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.617896 (+418652us) service_pool.cc:224] Handling call
0709 13:06:51.618170 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.618360 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:51.854483 (+236123us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.713691 (+859208us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.715378 (+  1687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.715432 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.715473 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.715534 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.715654 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11898,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2768,"raft.queue_time_us":1776,"raft.run_wall_time_us":7040,"spinlock_wait_cycles":15390208,"thread_start_us":1092896,"threads_started":2}
W20260709 13:06:52.724023 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.724903 15716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.026s	sys 0.030s
I20260709 13:06:52.720368 18736 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:06:52.724745 16327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.016s	sys 0.031s
I20260709 13:06:52.714468 18434 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.723260 18286 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.731570 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 718) took 1232 ms. Trace:
W20260709 13:06:52.733253 15716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.026s	sys 0.030s
W20260709 13:06:52.735164 16327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.016s	sys 0.031s
I20260709 13:06:52.749590 16333 rpcz_store.cc:276] 0709 13:06:51.499318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.500900 (+  1582us) service_pool.cc:224] Handling call
0709 13:06:51.501144 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.721281 (+220137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.731248 (+1009967us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400240c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:52.731489 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433009408}
I20260709 13:06:52.755086 15640 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:52.803049 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.040s	sys 0.057s
W20260709 13:06:52.803570 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.040s	sys 0.057s
I20260709 13:06:52.748278 18781 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.757364 18753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.038s	sys 0.031s
I20260709 13:06:52.747466 18736 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:52.844573 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.747567 18434 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.810775 18627 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:52.812609 18790 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:52.838063 18753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.039s	sys 0.032s
W20260709 13:06:52.854182 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 363967us
I20260709 13:06:52.755378 18286 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:52.859275 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 345949us
I20260709 13:06:52.861346 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:52.838626 18781 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.853464 18753 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:52.851588 18677 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:52.865944 15794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.000s	sys 0.018s
I20260709 13:06:52.865944 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.883888 18636 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:52.852345 18627 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.862185 18580 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:52.852571 18790 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:52.974110 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.864990 18262 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.977533 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.978348 15717 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:52.866902 18569 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.884442 15761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.000s	sys 0.019s
W20260709 13:06:52.948809 18797 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
I20260709 13:06:52.939798 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.984093 15790 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
W20260709 13:06:52.938653 15794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.000s	sys 0.018s
I20260709 13:06:52.961403 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:52.965006 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:52.966012 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.986150 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:52.945849 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:52.956643 18831 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.964859 18703 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:52.991138 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:52.983003 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:52.969237 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:52.971467 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:52.972504 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:52.972910 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.993676 16326 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:52.974857 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:52.976467 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.976263 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:52.979550 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.961272 18619 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:52.980237 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.000805 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:53.001408 15717 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:52.980880 15761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.000s	sys 0.020s
I20260709 13:06:52.938625 15720 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:52.984687 16332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 714) took 2291 ms. Trace:
I20260709 13:06:52.967854 18634 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.987468 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:52.977487 18618 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:52.988837 15719 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:52.982249 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1628) took 1311 ms. Trace:
I20260709 13:06:52.990406 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2221) took 1631 ms. Trace:
I20260709 13:06:52.991564 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:52.974370 16298 connection.cc:256] RPC call timeout handler was delayed by -1.9826111710000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 13:06:52.973124 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:52.967296 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 522232us
I20260709 13:06:52.937558 18791 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.996547 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:52.991092 18799 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:06:52.996954 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:53.053030 16326 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:06:53.052014 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51712.3us
I20260709 13:06:52.979307 18677 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:52.998610 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:52.970186 18459 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:53.002475 16332 rpcz_store.cc:276] 0709 13:06:50.687467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.687595 (+   128us) service_pool.cc:224] Handling call
0709 13:06:50.687855 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.743135 (+ 55280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.743164 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.743209 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:50.743239 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.978667 (+2235428us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54004d85d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:52.978710 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.978808 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126727552}
I20260709 13:06:53.004936 15647 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:52.942749 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 721) took 1442 ms. Trace:
I20260709 13:06:53.057843 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.058688 15717 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.006233 15722 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:53.007244 18434 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.046265 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.048480 15721 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
W20260709 13:06:53.046267 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50391.6us
I20260709 13:06:52.988740 18636 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.054919 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:53.061843 16298 connection.cc:256] RPC call timeout handler was delayed by -1.8431111710000323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:06:53.068135 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.049212 15639 rpcz_store.cc:276] 0709 13:06:51.670451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.663233 (+992782us) service_pool.cc:224] Handling call
0709 13:06:52.663800 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.664042 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:52.664376 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.981899 (+317523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.981946 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.981990 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.982049 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.982157 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60924,"prepare.queue_time_us":175,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":61157,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":17005,"thread_start_us":255995,"threads_started":1,"wal-append.queue_time_us":330299}
I20260709 13:06:53.070888 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:53.060290 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 87253.4us
I20260709 13:06:53.009773 18769 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:53.049012 18634 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.074216 18627 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.074788 18634 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:52.977448 18580 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.076885 18580 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.077688 18753 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:52.988444 18569 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.057875 16329 rpcz_store.cc:276] 0709 13:06:51.500165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.501302 (+  1137us) service_pool.cc:224] Handling call
0709 13:06:51.501571 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.498835 (+997264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.942502 (+443667us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540066e4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:52.942688 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217680640}
I20260709 13:06:52.999862 18619 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:52.994400 18703 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.999523 18777 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:53.092768 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 82838.5us
I20260709 13:06:52.984237 18262 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.059439 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.063635 18459 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:53.063900 18819 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:06:53.066001 15790 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.066560 18677 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:53.068362 16298 connection.cc:256] RPC call timeout handler was delayed by -1.5245111710000856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:06:53.067535 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.050951 18829 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.056066 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.094306 15688 leader_election.cc:400] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:53.057363 18825 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.095327 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:53.062961 18624 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:53.063279 18790 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.067082 15795 raft_consensus.cc:2410] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:53.050356 18791 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.066905 18736 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.103312 15688 leader_election.cc:403] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:53.103688 16298 connection.cc:256] RPC call timeout handler was delayed by -1.5002111710000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:06:53.124662 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68665.9us
W20260709 13:06:53.125854 16298 connection.cc:256] RPC call timeout handler was delayed by -1.3379299530000708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 13:06:53.126276 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.126673 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.104518 15642 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.095502 18703 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:53.091562 18818 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:06:53.097117 15647 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:52.999300 18831 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.114487 18808 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.060258 18618 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.011787 18778 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.133999 15790 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.093291 18777 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:53.132899 15791 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.094534 18569 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.105497 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.138523 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:53.130465 18705 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.139730 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2218) took 1893 ms. Trace:
I20260709 13:06:53.204005 15789 rpcz_store.cc:276] 0709 13:06:51.246336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.246487 (+   151us) service_pool.cc:224] Handling call
0709 13:06:51.246849 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.270582 (+ 23733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.270626 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.271320 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 13:06:51.729894 (+458574us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:51.729933 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.729996 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.948112 (+1218116us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:53.138458 (+190346us) raft_consensus.cc:1685] finished
0709 13:06:53.138481 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.139663 (+  1182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23202,"raft.queue_time_us":24139,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":42663,"spinlock_wait_cycles":5893888,"thread_start_us":380776,"threads_started":1,"wal-append.queue_time_us":1129238}
I20260709 13:06:53.205921 18841 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.206693 18459 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.206588 18841 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.207435 18459 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
I20260709 13:06:53.208204 18459 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.125454 18769 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:06:53.209192 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 143001us
I20260709 13:06:53.130051 18828 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.144621 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.119350 18624 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.194500 15647 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.049835 15796 rpcz_store.cc:276] 0709 13:06:51.359015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.551928 (+1192913us) service_pool.cc:224] Handling call
0709 13:06:52.563348 (+ 11420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.563546 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:52.846423 (+282877us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.990064 (+143641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.990127 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:52.990173 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.990238 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.990350 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22139,"prepare.queue_time_us":393429,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":41069,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":345496,"threads_started":2,"wal-append.queue_time_us":223871}
W20260709 13:06:53.147033 18782 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 13:06:53.195101 15639 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.131094 15611 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:53.123037 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.139617 18619 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.210925 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:53.235865 16329 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:06:53.240286 15647 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:06:53.210096 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.241950 18569 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:53.242401 18569 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.242830 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.242901 18569 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.244161 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:53.215348 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 75878.9us
I20260709 13:06:53.248023 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:53.215929 15713 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 3.
I20260709 13:06:53.150887 18286 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.226016 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.250073 18846 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.250614 18846 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.251010 18846 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.194144 18777 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.228091 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:53.225556 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 99393.6us
I20260709 13:06:53.254467 16334 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:53.254539 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:53.217443 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 123876us
I20260709 13:06:53.255991 18828 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.129555 18825 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.258172 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:53.259028 18825 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.259747 18710 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:53.260982 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.261250 18710 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.261827 18710 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:53.261878 18828 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.248111 18790 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.265395 15685 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.265637 18790 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:53.266393 18790 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.264357 18710 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.266533 18569 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.227275 18660 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.305168 18777 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.123806 18829 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.307518 18777 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.229513 18782 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.271569 18831 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:53.269361 18839 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:06:53.223381 18624 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.274868 18262 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.149909 18808 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.276777 18790 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.277671 18778 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.277933 18828 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.278414 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.278784 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.278852 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:53.279899 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:53.282694 18791 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:53.282527 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 151479us
I20260709 13:06:53.345240 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:53.283365 18842 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.283982 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2422) took 2105 ms. Trace:
I20260709 13:06:53.345969 15716 rpcz_store.cc:276] 0709 13:06:51.178230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.613598 (+435368us) service_pool.cc:224] Handling call
0709 13:06:51.639531 (+ 25933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.639906 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:51.781830 (+141924us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.750218 (+968388us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.750793 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.750959 (+   166us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:52.751005 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.751099 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.283745 (+532646us) raft_consensus.cc:1685] finished
0709 13:06:53.283766 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.283920 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":79114,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1058,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":10952,"thread_start_us":1007285,"threads_started":2,"wal-append.queue_time_us":1070408}
I20260709 13:06:53.249665 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:06:53.289789 18834 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:53.290602 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:06:53.292639 18745 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.002s
I20260709 13:06:53.349886 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1634) took 1286 ms. Trace:
I20260709 13:06:53.350242 18745 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.350255 15643 rpcz_store.cc:276] 0709 13:06:52.063469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.672962 (+609493us) service_pool.cc:224] Handling call
0709 13:06:52.673325 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.678548 (+  5223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.678593 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.682574 (+  3981us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.962554 (+279980us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.962595 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.962657 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.349656 (+386999us) raft_consensus.cc:1685] finished
0709 13:06:53.349678 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.349830 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":234533,"threads_started":1,"wal-append.queue_time_us":408170}
I20260709 13:06:53.352133 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.352614 18745 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.295594 18825 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.353300 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:53.353431 18825 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.355273 18808 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.299059 18846 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.355652 18825 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.268049 18710 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.296468 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.357221 18846 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.300372 18678 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.307736 18829 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.268714 18781 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.224207 18841 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:53.317924 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 223732us
I20260709 13:06:53.328899 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51714 (request call id 11) took 2062 ms. Trace:
I20260709 13:06:53.343590 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.352609 18660 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.319772 18703 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:53.377245 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 127701us
I20260709 13:06:53.380802 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.380714 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:53.393373 15796 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:53.393477 15640 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.394140 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.301151 18619 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.385535 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:53.370631 15787 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.301688 18705 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:53.392403 15795 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.394174 15793 rpcz_store.cc:276] 0709 13:06:51.266635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.266762 (+   127us) service_pool.cc:224] Handling call
0709 13:06:53.328686 (+2061924us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25400853 00007fad2a3ce60a 00007fad239547d4 00007fad23954762 00007fad23954691 00007fad2395460c 00007fad239538c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:53.328808 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994535296}
W20260709 13:06:53.402601 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 123826us
I20260709 13:06:53.380396 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.355106 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.403441 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.404196 15789 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.409049 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:53.370270 18748 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 3.043s	user 0.018s	sys 0.005s
W20260709 13:06:53.411052 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 120522us
I20260709 13:06:53.414341 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.414355 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.409592 15795 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:53.413307 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.405551 18751 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.377386 18782 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.377631 18824 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:53.365222 18657 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.366246 18611 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.347499 18842 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:53.445063 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2220) took 2167 ms. Trace:
W20260709 13:06:53.444963 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68647.5us
I20260709 13:06:53.445495 15788 rpcz_store.cc:276] 0709 13:06:51.277839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.492619 (+214780us) service_pool.cc:224] Handling call
0709 13:06:51.492993 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.493219 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:51.721579 (+228360us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.382100 (+1660521us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b1800465be0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a
0709 13:06:53.444720 (+ 62620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.444772 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:53.444814 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.444885 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.445005 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62400,"prepare.queue_time_us":143816,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"spinlock_wait_cycles":8028544,"thread_start_us":1023090,"threads_started":2,"wal-append.queue_time_us":827777}
I20260709 13:06:53.448197 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.448753 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.407598 18753 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:53.409993 18264 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:53.421079 18850 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:53.428663 18852 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:53.429021 18660 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:53.429260 18745 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:53.401567 18286 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:53.375505 18618 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.405398 18699 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.432399 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.434134 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.505673 15643 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.449380 15796 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.507925 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:53.449721 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59600.8us
I20260709 13:06:53.412261 18636 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.455439 15795 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:53.413321 18808 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.460862 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.429481 18828 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:06:53.457520 18850 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:53.533674 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:53.534722 15788 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.454136 18780 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:53.501955 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 98579.1us
I20260709 13:06:53.539821 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:53.501039 18790 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:53.505196 18569 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.510744 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.466789 18858 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.517570 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.454667 18791 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:53.513248 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.458140 18824 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:53.537423 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:53.567957 15796 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.540729 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.541144 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.421586 18825 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.509671 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.571432 15716 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:06:53.454536 18842 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.546579 15722 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.572432 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.511839 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.514335 18699 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:53.551091 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:53.628422 18699 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.628659 15718 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.544525 18780 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.539373 18850 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.554415 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:53.470139 18264 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:53.501564 18286 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:53.568987 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 55823.3us
I20260709 13:06:53.638833 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.569078 15721 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:53.572739 18860 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:53.591426 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1910) took 3683 ms. Trace:
I20260709 13:06:53.642421 15644 rpcz_store.cc:276] 0709 13:06:49.883251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.883383 (+   132us) service_pool.cc:224] Handling call
0709 13:06:49.899917 (+ 16534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.900171 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.900187 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.961338 (+ 61151us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.083332 (+121994us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:50.083373 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.083443 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.342693 (+3259250us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:53.546044 (+203351us) raft_consensus.cc:1685] finished
0709 13:06:53.546068 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.566743 (+ 20675us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66648,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":12150528,"thread_start_us":121604,"threads_started":1,"wal-append.queue_time_us":307017}
I20260709 13:06:53.592581 18824 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:53.594305 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 53228.9us
I20260709 13:06:53.583706 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.595630 18858 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.590400 18862 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:53.649511 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65907.1us
I20260709 13:06:53.649649 18791 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:53.649820 18862 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:53.532325 18808 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.652407 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.606431 15796 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:53.608762 18636 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.618706 18703 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.458869 18657 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.632405 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.633118 15643 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:53.634128 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:53.500207 18859 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:06:53.635743 18837 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.561s	user 0.004s	sys 0.000s
I20260709 13:06:53.636044 18264 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.646435 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.647624 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:53.601490 18677 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.641583 18860 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.651675 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:53.651221 18862 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.597270 18624 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.670640 15640 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:53.677270 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:53.681613 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.642164 18286 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.683307 15718 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:53.663446 18828 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:53.686793 15793 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:53.687907 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.707026 15722 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:53.651536 18791 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:06:53.654904 18825 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.694455 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:53.746069 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51733.5us
I20260709 13:06:53.746255 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:53.733981 15638 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:53.695732 15717 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:06:53.696790 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 51064.1us
I20260709 13:06:53.747982 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.667071 18569 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.662457 18849 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.758006 18849 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.758563 18849 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.700605 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:53.760269 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59799.1us
W20260709 13:06:53.701429 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1923) took 2503 ms (client timeout 1501 ms). Trace:
I20260709 13:06:53.762387 16325 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:53.701958 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.763162 15640 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.685374 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:53.764209 15716 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.710587 18620 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:53.715008 18820 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.777s	user 0.000s	sys 0.001s
I20260709 13:06:53.706768 18751 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.759595 18678 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.701152 18677 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.723656 18624 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.730027 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.730505 18657 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.733445 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:53.740061 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:53.771133 18751 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.744351 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:53.741063 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:53.746850 15611 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:53.747217 18639 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.787199 18639 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.787640 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.788627 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.695529 18703 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.790230 18703 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.790566 18782 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:53.791150 18782 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:53.791378 15716 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:53.791983 18782 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.793303 18841 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.793773 18841 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:53.794178 18841 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.666458 18636 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.766276 18778 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:53.761974 15646 rpcz_store.cc:269] 0709 13:06:51.188395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.203061 (+ 14666us) service_pool.cc:224] Handling call
0709 13:06:53.691466 (+2488405us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54003ebcd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:53.691662 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794402048}
I20260709 13:06:53.767784 15789 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 4.
I20260709 13:06:53.680023 18705 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:53.771330 18678 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.798775 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.804116 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:53.805013 15646 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:53.775388 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.778548 15644 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:53.767781 18620 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:53.741720 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:53.808164 16326 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:53.769210 18859 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.764894 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:53.815122 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50433.6us
I20260709 13:06:53.784981 16333 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.797266 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:53.797490 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 726) took 1861 ms. Trace:
I20260709 13:06:53.770126 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.819541 15640 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.821419 15640 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:53.806923 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:53.808704 15641 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:53.823655 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:06:53.823751 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1639) took 1006 ms. Trace:
I20260709 13:06:53.809346 15792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5622436c83fb41fa8923df2295b99818"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:06:53.824527 15792 raft_consensus.cc:606] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:53.795671 18751 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.812721 15646 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.807040 18705 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.813382 18620 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.827091 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1635) took 1022 ms. Trace:
I20260709 13:06:53.827529 18620 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.827467 15646 rpcz_store.cc:276] 0709 13:06:52.805135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.812132 (+1006997us) service_pool.cc:224] Handling call
0709 13:06:53.812489 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.826724 (+ 14235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.827031 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.827862 18860 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.745496 18828 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.811174 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.830590 18828 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.824230 15640 rpcz_store.cc:276] 0709 13:06:52.817575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.820363 (+1002788us) service_pool.cc:224] Handling call
0709 13:06:53.820990 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.823388 (+  2398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.823693 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:53.831835 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 407953us
I20260709 13:06:53.832387 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.840948 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.841786 18828 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.842043 18781 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.842818 18781 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.842484 18828 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.844951 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:53.845954 18860 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.845985 18787 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.847225 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.847926 18787 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.848387 18781 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.848495 18787 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.850319 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:53.840819 15685 connection.cc:256] RPC call timeout handler was delayed by -1.8280758649999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:06:53.851495 15685 connection.cc:256] RPC call timeout handler was delayed by -1.4797758649999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:06:53.851679 18785 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:53.851976 15685 connection.cc:256] RPC call timeout handler was delayed by -1.3078758650000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 13:06:53.845319 18828 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.854540 18781 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.855060 18781 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.855402 18781 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.810348 18678 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.818181 16327 rpcz_store.cc:276] 0709 13:06:51.935886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.001074 (+ 65188us) service_pool.cc:224] Handling call
0709 13:06:52.013793 (+ 12719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.751384 (+737591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.751660 (+   276us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.752169 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.920260 (+168091us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.920316 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.920422 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.631486 (+711064us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:53.783901 (+152415us) raft_consensus.cc:1685] finished
0709 13:06:53.783928 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.797432 (+ 13504us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":495041,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2367,"spinlock_wait_cycles":16667520,"thread_start_us":812650,"threads_started":2,"wal-append.queue_time_us":236752}
I20260709 13:06:53.867496 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:53.826188 18773 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.869194 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 457083us
I20260709 13:06:53.822803 18778 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.825953 18624 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.879998 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.880841 15716 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:53.838816 18452 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:53.903764 18611 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.904289 18611 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:53.904402 18636 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.904776 18611 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.906086 18781 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.925693 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.927386 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.928792 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:53.929647 15716 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:53.930692 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.932030 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.932946 15716 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:53.933713 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:53.935025 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.939513 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:53.995182 15716 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:53.838064 18677 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:06:53.839833 18859 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:06:53.899761 18624 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.949661 18781 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.950825 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.952315 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:53.956079 18815 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 1.314s	user 0.011s	sys 0.005s
I20260709 13:06:53.958132 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:54.020601 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 62582.3us
I20260709 13:06:53.864639 18850 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.941882 18452 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:53.972452 18808 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:53.970227 18699 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:53.975544 18579 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.957121 18849 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.981484 18841 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:53.983714 18639 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:53.984802 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2226) took 1055 ms. Trace:
I20260709 13:06:53.986479 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1486) took 2299 ms. Trace:
I20260709 13:06:54.040516 15715 rpcz_store.cc:276] 0709 13:06:51.686736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.734763 (+ 48027us) service_pool.cc:224] Handling call
0709 13:06:51.735073 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.562106 (+827033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.986125 (+1424019us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003bcc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:53.986368 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824226048}
I20260709 13:06:53.987601 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2213) took 2747 ms. Trace:
I20260709 13:06:54.041952 15794 rpcz_store.cc:276] 0709 13:06:51.239838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.262662 (+ 22824us) service_pool.cc:224] Handling call
0709 13:06:51.263027 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.779854 (+516827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.779899 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.790457 (+ 10558us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.985080 (+1194623us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:52.985120 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.987145 (+1002025us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400421dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:53.987193 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.987240 (+    47us) raft_consensus.cc:1685] finished
0709 13:06:53.987259 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.987507 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20056,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"spinlock_wait_cycles":763121408,"thread_start_us":1137867,"threads_started":2,"wal-append.queue_time_us":1159644}
W20260709 13:06:53.971001 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 468051us
W20260709 13:06:53.995565 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 56153.9us
I20260709 13:06:53.839514 18858 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
W20260709 13:06:54.049352 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.049451 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.021950 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:53.873371 18773 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.029282 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:53.997757 18657 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.056553 15646 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.021888 18624 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:54.050086 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.063400 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.039785 15791 rpcz_store.cc:276] 0709 13:06:52.929044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.974131 (+ 45087us) service_pool.cc:224] Handling call
0709 13:06:53.984583 (+1010452us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540021b6d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:53.984729 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323525504}
I20260709 13:06:54.050099 15716 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:06:54.030339 18379 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.059618 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.060935 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.076838 18841 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:54.078860 18849 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:54.107501 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.109347 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.079265 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.081992 18850 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.083515 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.061252 18822 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:54.063344 18791 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:54.092267 15791 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:54.067996 15792 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:54.055316 18808 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.156701 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.110937 15713 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.066592 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.157792 15795 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:54.158737 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.160225 15795 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:54.142208 15716 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:54.148401 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.164333 15792 raft_consensus.cc:2376] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5. Re-sending same reply.
I20260709 13:06:54.165335 18822 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.068964 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.167261 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.164578 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.073354 18790 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.166008 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.168661 15792 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:54.114483 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 723) took 2473 ms. Trace:
I20260709 13:06:54.110922 18700 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.170763 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.172214 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.169854 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.169345 16328 rpcz_store.cc:276] 0709 13:06:51.641565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.641708 (+   143us) service_pool.cc:224] Handling call
0709 13:06:51.665933 (+ 24225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.666266 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.666291 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.679924 (+ 13633us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.415573 (+735649us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.848400 (+432827us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.860271 (+ 11871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.860341 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.949672 (+1089331us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:54.105908 (+156236us) raft_consensus.cc:1685] finished
0709 13:06:54.114239 (+  8331us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.114411 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11563,"prepare.queue_time_us":683838,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":16863,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":23842,"spinlock_wait_cycles":99595648,"thread_start_us":1123980,"threads_started":2,"wal-append.queue_time_us":896604}
I20260709 13:06:54.174160 15792 raft_consensus.cc:2368] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:06:54.106108 18379 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:54.143463 18620 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:54.168264 18790 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.178589 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 336) took 1068 ms. Trace:
I20260709 13:06:54.186870 18379 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.189433 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.162544 18847 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:54.161060 18808 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.193161 15791 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:06:54.193389 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 77578.7us
I20260709 13:06:54.192791 15792 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:54.188511 15644 rpcz_store.cc:276] 0709 13:06:53.109969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.824354 (+714385us) service_pool.cc:224] Handling call
0709 13:06:53.868623 (+ 44269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.868840 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:53.902022 (+ 33182us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.178182 (+276160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.178237 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:54.178291 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.178375 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.178515 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40962,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":226,"thread_start_us":275535,"threads_started":1}
I20260709 13:06:54.203831 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.205655 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.206566 15716 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:54.174683 18700 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.213052 15796 raft_consensus.cc:2376] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:06:54.174988 18849 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:54.214064 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2229) took 1119 ms. Trace:
I20260709 13:06:54.219892 15787 rpcz_store.cc:276] 0709 13:06:53.094955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.095078 (+   123us) service_pool.cc:224] Handling call
0709 13:06:54.213874 (+1118796us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540047bdd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:54.213997 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551914240}
I20260709 13:06:54.221484 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.223836 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.224598 15791 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:54.226900 15795 raft_consensus.cc:2376] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:06:54.230233 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.142539 18452 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.233404 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.230990 15787 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.190011 18620 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.241699 18787 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.243249 18790 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.208570 18847 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.243252 18620 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.248993 15789 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:54.251535 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.252934 18751 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.254350 15643 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:54.215235 18700 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.255553 18751 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:54.264833 18819 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:54.265805 18823 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:54.266363 18823 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:54.252300 15789 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:54.273905 15787 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:06:54.274592 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.288861 15791 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:06:54.276926 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.272292 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:54.287938 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 422295us
I20260709 13:06:54.289875 15639 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.290551 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:54.291085 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.292712 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.294275 18822 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.295161 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.295809 18846 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:54.295364 18779 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.296514 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.296775 18779 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.297205 18779 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.297173 15716 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:54.298026 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.299572 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.300704 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.295181 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.302795 18846 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.303254 18846 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.303714 18787 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:54.230604 18849 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.303618 18846 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.312134 18849 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.285368 18751 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:54.312384 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.312819 18751 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.253475 18678 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.317003 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.317446 18678 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:54.318534 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.319641 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.320061 18773 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:54.320508 18790 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:54.321079 18703 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.004s
I20260709 13:06:54.321228 18790 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.309427 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2239) took 1032 ms. Trace:
I20260709 13:06:54.320674 18769 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:54.304667 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.322846 15639 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:54.323740 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.322386 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:54.324901 15715 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 3.
I20260709 13:06:54.327764 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.325275 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.329172 15789 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:54.332633 15714 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:54.322881 15788 rpcz_store.cc:276] 0709 13:06:53.276745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.540055 (+263310us) service_pool.cc:224] Handling call
0709 13:06:53.554576 (+ 14521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.567758 (+ 13182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.567789 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.568222 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.008710 (+440488us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:54.009639 (+   929us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.010359 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.010469 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.255992 (+245523us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b18003c4120. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:06:54.308973 (+ 52981us) raft_consensus.cc:1685] finished
0709 13:06:54.309126 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.309339 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12744,"prepare.queue_time_us":559,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7333,"raft.queue_time_us":15049,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":55275,"spinlock_wait_cycles":16273280,"thread_start_us":440166,"threads_started":1,"wal-append.queue_time_us":626300}
I20260709 13:06:54.324095 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:54.337234 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46772.8us
I20260709 13:06:54.338514 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:54.342273 15647 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.321556 18703 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.374110 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:54.340005 18699 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.302863 18808 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.357082 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.402948 15719 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.367375 18677 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:54.304896 18662 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.279883 18624 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.403658 18791 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.406265 18662 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.406622 18791 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.257591 18611 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.407492 18624 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.408017 15644 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.408106 18379 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.408661 18791 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.408859 18611 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:54.410279 18379 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.371590 18620 raft_consensus.cc:2764] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:54.410493 15794 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:06:54.388298 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 64259.6us
I20260709 13:06:54.411708 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.412642 18779 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.345774 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.414599 18379 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:54.414837 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 69148.1us
I20260709 13:06:54.267267 18823 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.416294 18823 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.363276 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.340065 18610 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.340389 18716 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.345369 18639 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.402683 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:54.423928 15610 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:54.381507 18842 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.005s
I20260709 13:06:54.419077 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.384096 18773 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:54.424893 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.384398 18781 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.403513 18710 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.420414 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.428122 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.430601 18781 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.422544 18716 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.430431 18842 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.420567 18610 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:54.429028 18379 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.438707 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.442652 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 337) took 1332 ms. Trace:
I20260709 13:06:54.464939 15721 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:54.465283 15646 rpcz_store.cc:276] 0709 13:06:53.110251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.828536 (+718285us) service_pool.cc:224] Handling call
0709 13:06:53.828854 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.057172 (+228318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.442364 (+385192us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540028b254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:54.442579 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522985344}
W20260709 13:06:54.443949 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1620) took 3239 ms (client timeout 1843 ms). Trace:
I20260709 13:06:54.402174 18847 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:54.466557 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.467010 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.445864 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1475) took 3269 ms. Trace:
I20260709 13:06:54.447362 15716 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.378677 18569 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:54.474050 18569 consensus_queue.cc:1243] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:54.474561 18569 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:54.474881 18569 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:54.475728 18569 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.476851 18569 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.478299 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2246) took 1188 ms. Trace:
I20260709 13:06:54.478631 15787 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:54.478677 15793 rpcz_store.cc:276] 0709 13:06:53.289947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.407551 (+117604us) service_pool.cc:224] Handling call
0709 13:06:54.478120 (+1070569us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002193d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:54.478240 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620222848}
I20260709 13:06:54.452101 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.482111 15722 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:54.457036 18841 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.458467 15789 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:54.461176 15640 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.428808 18699 raft_consensus.cc:2764] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:54.467499 15646 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:06:54.467746 15644 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:06:54.486877 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.462455 18781 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.472154 18639 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.473029 18780 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.448158 18710 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.467871 15720 rpcz_store.cc:276] 0709 13:06:51.176778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.405949 (+229171us) service_pool.cc:224] Handling call
0709 13:06:51.406248 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.002248 (+1596000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.445458 (+1443210us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003bd154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:54.445664 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3523607808}
I20260709 13:06:54.464754 18823 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:54.487670 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.469270 18842 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:54.466572 15638 rpcz_store.cc:269] 0709 13:06:51.204066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.212345 (+  8279us) service_pool.cc:224] Handling call
0709 13:06:54.443747 (+3231402us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54000e7ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:54.443870 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5796385920}
I20260709 13:06:54.488266 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.499007 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.464679 18610 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.463670 18716 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.489277 18620 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.492340 15716 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:54.492105 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.491516 18841 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:54.499534 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.500957 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.507122 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.516577 15644 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.517957 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:06:54.509570 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 143183us
I20260709 13:06:54.456483 18773 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:54.511149 15713 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:54.523820 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.524391 15713 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.497210 18710 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.529206 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.531312 15713 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:54.514027 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.515378 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.521342 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:54.522447 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.532989 15638 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:54.533190 15722 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.453897 18579 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.533994 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.518222 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.534551 15638 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.534986 15720 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:54.536909 15716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:57470
I20260709 13:06:54.537575 15716 raft_consensus.cc:606] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:06:54.537485 15685 leader_election.cc:400] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:06:54.539234 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.533249 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.545091 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.536041 18639 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.542250 18880 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:54.548098 18624 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.523341 18842 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.551294 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:06:54.564263 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:54.564812 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.566864 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.548327 18864 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.564814 15720 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.567430 15644 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:06:54.570397 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.571188 15716 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:54.526003 18858 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:54.564180 18842 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.573916 18842 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.576475 15719 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:54.557384 18862 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.577802 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.577977 18862 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:54.578094 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.578439 18862 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.578047 18841 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.580039 18858 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:54.580468 18858 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:54.571805 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.583051 15638 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:54.552160 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.578703 18849 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.584345 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.552062 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.588040 15721 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:54.567433 15722 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:54.590737 15611 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.593091 18887 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:54.593591 18887 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:54.594049 18887 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.552721 18639 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:54.577118 18846 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.523811 18700 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.600975 15720 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:54.552279 18699 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.598623 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.627624 15713 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:54.627863 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.511584 18823 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.677163 15644 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:06:54.649718 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.628729 18849 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:54.552899 18880 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:54.554437 18779 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.673913 15788 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:54.671712 18699 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:54.570688 18884 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:06:54.626708 18860 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:54.689616 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68461.7us
I20260709 13:06:54.553875 18618 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:06:54.581307 18858 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.692363 18858 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.629165 18678 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.694043 18678 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:54.694967 18678 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.676460 15638 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:54.664017 15721 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:54.680210 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 87464.7us
I20260709 13:06:54.662258 15720 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:54.624112 18639 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.555019 18773 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.585824 18452 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:54.683282 18624 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:54.700783 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.711311 15791 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:06:54.705371 18700 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.706086 18849 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:54.706913 16297 connection.cc:256] RPC call timeout handler was delayed by -1.4602729740000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 13:06:54.708122 18452 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:54.710341 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1621) took 3506 ms (client timeout 2233 ms). Trace:
I20260709 13:06:54.720150 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.696092 18860 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:54.722278 15795 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:54.720471 15641 rpcz_store.cc:269] 0709 13:06:51.204235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.253858 (+ 49623us) service_pool.cc:224] Handling call
0709 13:06:54.710143 (+3456285us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54001be4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:54.710252 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5657870592}
W20260709 13:06:54.710371 18886 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:06:54.713920 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:54.730199 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:54.731490 16297 connection.cc:256] RPC call timeout handler was delayed by -1.4242729740000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:06:54.732583 16332 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:54.733544 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.725672 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.735167 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:54.737493 18888 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:54.740077 18452 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:54.740664 18865 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.197s	user 0.000s	sys 0.006s
I20260709 13:06:54.742038 15793 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:06:54.732103 16297 connection.cc:256] RPC call timeout handler was delayed by -1.3171729740000728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:06:54.742718 16297 connection.cc:256] RPC call timeout handler was delayed by -1.24517297400007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:06:54.743424 15641 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:54.744690 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:54.745106 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.745623 16330 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.747502 15638 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:54.751250 15641 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:54.752977 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.754221 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.755066 16327 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:06:54.752539 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.691048 18842 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.758446 15789 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:06:54.760424 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46599.4us
I20260709 13:06:54.741055 18846 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.719872 18660 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:54.764964 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:54.761413 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.712356 18710 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.714552 18881 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 13:06:54.773346 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.729144 18860 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.731292 18824 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:54.786415 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:54.772447 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:54.778741 16334 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:54.789377 16330 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:54.790575 16297 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.792086 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:54.795578 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.797281 18710 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.797565 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.798278 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.801810 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.766717 18790 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.804076 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.804500 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.805847 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:54.806449 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.818334 16330 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:54.819748 15645 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:54.807360 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.723227 18887 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.801391 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:54.777556 18569 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.798704 18822 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.820626 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:54.779158 18660 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.820780 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.761988 18699 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.826814 18624 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:54.833508 18895 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:54.793008 18676 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.834525 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.801311 18868 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:54.836748 15642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1642) took 1992 ms (client timeout 1712 ms). Trace:
I20260709 13:06:54.769908 18892 raft_consensus.cc:2764] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:54.837386 15792 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.842459 18660 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:54.840397 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.841327 15787 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:54.851329 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:06:54.847831 15642 rpcz_store.cc:269] 0709 13:06:52.844398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.971246 (+126848us) service_pool.cc:224] Handling call
0709 13:06:54.836565 (+1865319us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b54000a9454. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:54.836680 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193198464}
I20260709 13:06:54.801949 18864 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:54.858806 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.852183 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:54.854509 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.860544 15787 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.861438 15795 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:06:54.857252 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57748.2us
W20260709 13:06:54.841225 18889 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:54.863374 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.864084 16330 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:54.799214 18824 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.862353 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.764544 18880 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:54.868196 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.868901 15795 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:54.869633 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:54.870654 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.871683 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:54.842310 18823 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:54.872973 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:54.847545 18620 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:54.839470 18569 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:54.863569 18894 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.902518 16328 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:54.903565 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:54.903692 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:54.866331 18660 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.905911 16330 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
W20260709 13:06:54.922392 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.008255 15789 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.872488 18862 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.033365 15787 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:54.909235 18579 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.036096 15645 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:55.024241 18889 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:06:55.065346 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.049144 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:55.108700 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:55.109454 15787 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
W20260709 13:06:55.104625 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.100895 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:54.901597 18620 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.119165 15645 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:54.891350 18624 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.123133 15795 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:55.128454 15722 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.123872 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.138623 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.100196 18868 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.103734 18779 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:54.911537 18894 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.145999 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 453) took 1091 ms. Trace:
I20260709 13:06:55.187500 15719 rpcz_store.cc:276] 0709 13:06:54.054347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.577298 (+522951us) service_pool.cc:224] Handling call
0709 13:06:54.577630 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.583746 (+  6116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.583776 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.584204 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.679802 (+ 95598us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:54.697382 (+ 17580us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.697590 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.697665 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.145684 (+448019us) raft_consensus.cc:1685] finished
0709 13:06:55.145714 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.145919 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11377,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":2386,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":49579,"spinlock_wait_cycles":7110400,"thread_start_us":95322,"threads_started":1,"wal-append.queue_time_us":119650}
W20260709 13:06:55.198581 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.121165 15645 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:55.166214 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.026721 18657 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
W20260709 13:06:55.205118 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 301611us
I20260709 13:06:55.102464 18887 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.199887 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:55.212797 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46718.5us
I20260709 13:06:55.236539 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.207196 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:55.239163 15789 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:06:55.251106 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51325.6us
I20260709 13:06:55.251431 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.251957 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:06:55.254467 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.255988 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.256889 15787 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:55.257962 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:55.258147 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 363611us
I20260709 13:06:55.260524 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:55.261068 18770 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:55.262428 18770 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.259867 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:55.263382 18770 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.262262 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:55.264360 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.262622 18880 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.266086 18880 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.265921 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:55.266909 18880 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.267077 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56118 (request call id 84) took 2010 ms. Trace:
I20260709 13:06:55.267556 15790 rpcz_store.cc:276] 0709 13:06:53.257103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.287825 (+ 30722us) service_pool.cc:224] Handling call
0709 13:06:55.266778 (+1978953us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400422cd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540c735 00007fad254049fa 00007fad2a3cc4c9 00007fad23948c54 00007fad23948be2 00007fad23948b11 00007fad23948a8c 00007fad23947d42 00007fad2374148c 00007fad237408c6
0709 13:06:55.266977 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2578789760}
I20260709 13:06:55.268711 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:55.270386 18806 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.270697 18662 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.271051 18806 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.271395 18662 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.271517 18806 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:55.272104 18806 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:55.224601 18781 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.730s	user 0.000s	sys 0.012s
I20260709 13:06:55.100293 18896 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.198s
I20260709 13:06:55.275580 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:55.279434 15787 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
W20260709 13:06:55.277189 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:55.205664 18900 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.276185 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.258533 18895 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.288394 15790 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.285405 18620 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:55.231792 18699 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.257292 18881 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:55.275542 18901 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:06:55.304155 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.259846 18858 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:55.274019 18790 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.273352 18611 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.305640 15645 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.275801 18627 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.210711 18779 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.259572 18868 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:06:55.272637 18807 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:55.294628 18841 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.358677 15790 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:06:55.301364 18895 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:55.329886 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.363163 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 255827us
W20260709 13:06:55.366016 18899 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:06:55.344108 18858 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.458252 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.366832 18894 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.352713 18824 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.372835 18880 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.373998 18452 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:55.468511 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 201031us
I20260709 13:06:55.468931 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:55.455500 18909 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.472455 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:55.375779 18610 consensus_meta.cc:287] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.862s	user 0.009s	sys 0.000s
I20260709 13:06:55.399401 18569 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:55.404989 15643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1652) took 2028 ms (client timeout 1890 ms). Trace:
I20260709 13:06:55.406296 15644 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:06:55.477676 15643 rpcz_store.cc:269] 0709 13:06:53.376565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.668927 (+292362us) service_pool.cc:224] Handling call
0709 13:06:55.404743 (+1735816us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54000e79d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:55.404908 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087174016}
W20260709 13:06:55.416136 18902 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.517s	user 0.002s	sys 0.000s
I20260709 13:06:55.288897 18781 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.323858 18790 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:55.432049 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:55.361449 18845 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 2.222s	user 0.000s	sys 0.020s
I20260709 13:06:55.453536 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.316442 18660 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:55.460006 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.488653 15790 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.488792 15787 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:55.442983 18850 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:55.442629 18636 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.296779 18900 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.474476 18618 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:55.457980 18466 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.462024 18914 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:55.496878 15642 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:06:55.489473 18716 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.970s	user 0.008s	sys 0.005s
W20260709 13:06:55.499825 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46397.1us
I20260709 13:06:55.500797 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:55.471163 18452 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.473693 18862 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:55.501792 15793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.012s	sys 0.004s
W20260709 13:06:55.524976 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 52615.9us
W20260709 13:06:55.543082 15793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.013s	sys 0.005s
I20260709 13:06:55.524258 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 338) took 2318 ms. Trace:
I20260709 13:06:55.543895 15640 rpcz_store.cc:276] 0709 13:06:53.206079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.832067 (+625988us) service_pool.cc:224] Handling call
0709 13:06:53.832394 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.484223 (+651829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.523889 (+1039666us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54002670d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:55.524171 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445219200}
I20260709 13:06:55.518501 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1658) took 1237 ms. Trace:
I20260709 13:06:55.545514 15639 rpcz_store.cc:276] 0709 13:06:54.281215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.290852 (+  9637us) service_pool.cc:224] Handling call
0709 13:06:55.518252 (+1227400us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b540019ad54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:55.518436 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71256960}
I20260709 13:06:55.526898 15719 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:55.494868 18466 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:55.488833 18790 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.490983 18868 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.520347 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.553237 18868 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:55.539829 15790 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:06:55.487566 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 223374us
I20260709 13:06:55.554180 18868 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.554986 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:55.555420 18868 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.502874 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:55.489832 18912 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.556159 18912 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:55.556797 18912 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.556092 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.496641 18914 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.560374 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:55.477535 18909 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.481541 18610 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.499284 18618 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:55.538157 18894 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:55.537947 18892 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.562597 18859 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:06:55.568156 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 65382.1us
W20260709 13:06:55.568663 18903 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:55.570082 18907 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.572134 18900 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.563222 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:55.576496 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.579493 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:55.587123 15714 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.497128 18850 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.498658 18636 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.585860 16326 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.500598 18898 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:06:55.563407 18914 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.609656 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:55.576093 18880 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.540437 18716 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.566644 18862 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:06:55.628454 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:55.609897 18787 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.643998 15720 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:55.645814 15719 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:55.573359 18618 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.577872 18917 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:55.654991 18860 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.845s	user 0.012s	sys 0.000s
I20260709 13:06:55.578073 18770 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.654431 18718 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:55.611047 18807 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.676990 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:55.678591 15720 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:55.658635 18782 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.668627 18677 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:55.567397 18911 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:06:55.609923 18900 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:06:55.683143 18858 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.703325 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.694428 18895 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.704525 16327 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:55.689970 18779 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:55.661715 18918 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:06:55.613984 18660 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.696525 18718 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.697485 18807 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.696587 18894 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:55.689782 18860 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.702509 18782 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:55.706374 18932 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.716892 18864 raft_consensus.cc:993] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:55.712420 18858 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.723001 18858 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:55.723304 18920 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:55.714334 18910 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:55.724098 18860 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.723970 18858 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.726270 18926 raft_consensus.cc:1081] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:06:55.729261 18910 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.731259 18909 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.733495 18910 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.732767 18894 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.735553 18912 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.714308 18929 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:06:55.673791 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 45411.8us
W20260709 13:06:55.679122 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 134101us
I20260709 13:06:55.776654 15719 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:55.780444 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:55.782385 15716 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:55.786406 15790 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:55.608943 18466 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.709652 18610 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.814462 18466 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.814704 18782 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.864569 18850 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:55.727110 18858 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.878782 18773 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:55.880098 18773 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.880429 18849 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:55.871888 18699 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:55.882872 18699 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.885970 18459 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.870651 18636 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.887228 18917 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:55.887810 18909 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:55.888923 18912 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.869510 18716 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.868566 18770 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.901160 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.873422 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.902631 18718 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:55.905795 18773 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.888850 18807 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.884931 18880 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:06:55.919742 18787 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:55.873070 18910 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.922561 18910 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:55.920954 18787 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:55.885001 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 92325us
I20260709 13:06:55.947811 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.948789 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1940) took 1491 ms. Trace:
I20260709 13:06:55.949853 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:55.950727 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 343) took 1231 ms (client timeout 1564 ms). Trace:
W20260709 13:06:55.951161 15638 rpcz_store.cc:269] 0709 13:06:54.719367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.719821 (+   454us) service_pool.cc:224] Handling call
0709 13:06:55.950381 (+1230560us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54000e83d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:55.950561 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60111616}
I20260709 13:06:55.955341 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1947) took 1456 ms. Trace:
I20260709 13:06:55.955937 15642 rpcz_store.cc:276] 0709 13:06:54.499230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.856190 (+356960us) service_pool.cc:224] Handling call
0709 13:06:54.856649 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.497463 (+640814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.954566 (+457103us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b540045fbd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:55.955093 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471760768}
I20260709 13:06:55.961055 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.962396 16327 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:55.963012 18909 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:55.963774 18909 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:55.967083 18787 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.967788 18778 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.967926 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 456) took 1912 ms. Trace:
I20260709 13:06:55.968683 18778 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:55.887264 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 92926.6us
I20260709 13:06:55.970614 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:55.969067 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:55.974013 18932 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.974220 18860 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:55.974383 18624 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:55.975114 18932 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:56.078917 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 81506.8us
I20260709 13:06:55.997162 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:55.949286 15646 rpcz_store.cc:276] 0709 13:06:54.457482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.486629 (+ 29147us) service_pool.cc:224] Handling call
0709 13:06:55.948352 (+1461723us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54003eadd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:55.948584 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857863424}
I20260709 13:06:55.938122 18910 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:56.007678 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.968449 15722 rpcz_store.cc:276] 0709 13:06:54.055153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.590428 (+535275us) service_pool.cc:224] Handling call
0709 13:06:54.590738 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.129049 (+538311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.967304 (+838255us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540011a3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:55.967703 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236077824}
I20260709 13:06:55.971747 18778 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:55.945725 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1943) took 1458 ms. Trace:
I20260709 13:06:55.996675 18932 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:56.109889 15714 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.014s
I20260709 13:06:56.110232 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:56.036900 18662 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.005s
W20260709 13:06:56.036940 15759 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.596s (SENT) [suppressed 22 similar messages]
I20260709 13:06:56.006529 18699 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.111327 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2021) took 1914 ms. Trace:
I20260709 13:06:56.108976 15644 rpcz_store.cc:276] 0709 13:06:54.486675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.677842 (+191167us) service_pool.cc:224] Handling call
0709 13:06:55.406006 (+728164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.477938 (+ 71932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.945171 (+467233us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54000e79d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:55.945494 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673806208}
I20260709 13:06:56.113457 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2033) took 1312 ms. Trace:
I20260709 13:06:56.114305 18909 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:56.114928 15794 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2004) took 2052 ms (client timeout 2096 ms). Trace:
I20260709 13:06:56.116236 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2265) took 1271 ms. Trace:
W20260709 13:06:56.116691 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.118121 18935 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.119881 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 743) took 1375 ms. Trace:
I20260709 13:06:55.975770 18624 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.121116 15719 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:56.122295 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2267) took 1227 ms. Trace:
W20260709 13:06:56.125912 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.096704 18914 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.086731 18610 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.136385 18610 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:56.136900 18610 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.138326 18807 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.139195 18807 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:56.096099 18868 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.014s
I20260709 13:06:56.142364 18807 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:56.143024 16328 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:56.143877 15714 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:56.145556 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.146138 18699 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:56.147147 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.147876 15714 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.133477 18624 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:55.974005 18850 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:06:56.132063 15795 rpcz_store.cc:276] 0709 13:06:54.844891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.871480 (+ 26589us) service_pool.cc:224] Handling call
0709 13:06:56.115903 (+1244423us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54004222d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:56.116063 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565839232}
I20260709 13:06:56.131111 15791 rpcz_store.cc:276] 0709 13:06:54.197346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.289487 (+ 92141us) service_pool.cc:224] Handling call
0709 13:06:54.710973 (+421486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.711702 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.110862 (+1399160us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540047c2d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:56.111113 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921379584}
I20260709 13:06:56.132753 16326 rpcz_store.cc:276] 0709 13:06:54.744648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.766809 (+ 22161us) service_pool.cc:224] Handling call
0709 13:06:54.767095 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.611439 (+844344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.119293 (+507854us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54004b4954. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:56.119626 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882174848}
W20260709 13:06:56.131699 15794 rpcz_store.cc:269] 0709 13:06:54.062975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.063158 (+   183us) service_pool.cc:224] Handling call
0709 13:06:56.114539 (+2051381us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400422cd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:56.114728 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796471552}
I20260709 13:06:56.151835 18914 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.158135 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:56.158845 15794 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.159130 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:56.161053 15791 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:56.162189 18627 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:56.162639 18627 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:56.162849 15715 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.163780 18627 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.164459 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.153318 18624 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.167095 18624 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.132707 18935 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:56.170928 18935 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.172684 18935 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.154654 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.131523 15792 rpcz_store.cc:276] 0709 13:06:54.800952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.802574 (+  1622us) service_pool.cc:224] Handling call
0709 13:06:54.802847 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.848930 (+ 46083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.112907 (+1263977us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54001f77d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:56.113238 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78865152}
I20260709 13:06:56.127806 18932 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:56.176666 18806 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.904s	user 0.013s	sys 0.006s
I20260709 13:06:56.180828 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:56.176882 18790 consensus_meta.cc:287] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.602s	user 0.017s	sys 0.001s
I20260709 13:06:56.177595 18662 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:56.189549 18945 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:56.194339 16331 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:06:56.194775 18854 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 2.647s	user 0.004s	sys 0.010s
I20260709 13:06:56.149708 18621 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.170984 18781 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.198391 15722 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:56.201560 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.203150 15715 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.207094 18621 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.212699 16327 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 4: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:56.215292 15720 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:56.152631 18610 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.219651 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.222788 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.224507 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2030) took 1772 ms. Trace:
I20260709 13:06:56.226065 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2034) took 1424 ms. Trace:
I20260709 13:06:56.226173 18621 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.249351 15788 rpcz_store.cc:276] 0709 13:06:54.451935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.452114 (+   179us) service_pool.cc:224] Handling call
0709 13:06:54.465707 (+ 13593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.685252 (+219545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.223984 (+1538732us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400152554. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:56.224323 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478024576}
I20260709 13:06:56.249689 15789 rpcz_store.cc:276] 0709 13:06:54.801961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.802076 (+   115us) service_pool.cc:224] Handling call
0709 13:06:56.225674 (+1423598us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540047a9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:56.225883 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371776896}
I20260709 13:06:56.256561 18677 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:56.257383 18677 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.258327 18932 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.260251 18932 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.233189 15794 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:56.234052 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:56.240654 18751 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.134332 15787 rpcz_store.cc:276] 0709 13:06:54.895112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.492308 (+597196us) service_pool.cc:224] Handling call
0709 13:06:55.492552 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.492819 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:55.598188 (+105369us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.118306 (+520118us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.119562 (+  1256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.119724 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.119901 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.121552 (+  1651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.121924 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66527,"prepare.queue_time_us":176113,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":7915,"raft.queue_time_us":76361,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":209,"thread_start_us":410139,"threads_started":2,"wal-append.queue_time_us":345352}
I20260709 13:06:56.200385 18790 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.253224 15791 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:56.253240 15715 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:56.262442 18618 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:56.272387 18751 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.275362 18751 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.278009 18751 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.272579 18618 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.281806 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.272127 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.282769 15715 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:56.286283 15685 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.090s (SENT)
I20260709 13:06:56.281632 18610 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:56.286808 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:56.284718 18618 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.287907 18907 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.287052 15714 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:56.288529 18264 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:56.292641 18264 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.294768 18264 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.295117 15715 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:56.296104 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.297933 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.299597 18909 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.299698 15715 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:56.300292 18909 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.195330 18806 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.298319 15714 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:56.302443 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.302692 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.303779 15715 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.303831 15793 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.304526 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.306175 18906 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.306661 18906 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:56.306691 18892 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.307466 18892 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.308179 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.307878 18906 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.311389 18906 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.312701 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2458) took 2769 ms. Trace:
I20260709 13:06:56.319844 15714 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:06:56.321103 15715 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:56.322305 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.322608 18777 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:56.324975 15796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2015) took 2188 ms (client timeout 2090 ms). Trace:
I20260709 13:06:56.325284 15795 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:56.313114 15718 rpcz_store.cc:276] 0709 13:06:53.543386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.703399 (+160013us) service_pool.cc:224] Handling call
0709 13:06:53.703755 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.830065 (+126310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:55.673314 (+1843249us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18004696c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf
0709 13:06:55.673485 (+   171us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.882762 (+209277us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.883072 (+   310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.883152 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.883279 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.312306 (+429027us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001e6c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:56.312350 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.312508 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107055,"prepare.queue_time_us":315376,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":110,"raft.queue_time_us":108864,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":377,"spinlock_wait_cycles":300512640,"thread_start_us":460466,"threads_started":2,"wal-append.queue_time_us":192325}
W20260709 13:06:56.331821 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.337808 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.340922 18678 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:56.342386 18892 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.260278 18677 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:56.345105 15796 rpcz_store.cc:269] 0709 13:06:54.136846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.166988 (+ 30142us) service_pool.cc:224] Handling call
0709 13:06:56.324557 (+2157569us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b540021a7d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:56.324772 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103912320}
I20260709 13:06:56.342835 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:56.343021 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.344285 15790 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:56.345057 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 308315us
I20260709 13:06:56.360553 18751 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.361265 18751 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.363112 16334 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:56.364177 18751 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.366655 16327 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.370723 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.372069 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.372884 15718 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:56.374266 15722 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:56.375191 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.376287 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.377805 16333 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 3.
I20260709 13:06:56.378373 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:56.377394 18677 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.383172 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.383896 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.384980 15715 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:06:56.388119 15717 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:56.389717 15714 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 5: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:56.389513 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:56.398625 15718 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:56.392953 18892 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.387775 18677 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.395159 18751 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.380540 18932 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:56.422690 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.490238 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:56.520351 18459 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:56.521016 18459 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:56.521215 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.522019 16331 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:56.406108 18892 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:56.520568 18858 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:56.543464 18945 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:06:56.489809 15715 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:56.530464 18849 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.533296 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:56.534021 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:56.538600 18892 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.578179 15789 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:06:56.586356 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.578322 18849 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.590754 15787 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:56.528326 18787 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:56.601120 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.602200 16331 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:56.598711 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:56.419751 18751 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:56.606369 16326 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.606289 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:56.609135 16333 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.611130 15788 raft_consensus.cc:2410] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:56.606547 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.616642 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:56.641105 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.628383 16325 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
W20260709 13:06:56.649755 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 116559us
I20260709 13:06:56.615175 18943 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.609251 18787 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:56.668255 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.682555 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.687206 15722 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 13:06:56.685622 18847 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:56.693221 18751 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.694769 18710 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:56.706462 15788 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:56.686136 18948 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:56.707172 18787 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.681093 18849 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.683883 18624 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.722890 16326 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:56.724078 18824 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:56.725382 18824 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.725723 18824 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:56.725961 16330 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.726347 16330 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:56.726752 18824 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.727263 16330 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.728111 18824 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.728456 16330 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:56.731025 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 222774us
W20260709 13:06:56.711946 18946 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
W20260709 13:06:56.734243 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.737285 15787 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.744927 18897 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.745515 18897 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:56.746272 18951 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:56.746678 18897 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.747926 18897 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.734418 18662 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.749066 18662 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:56.750128 18662 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.751650 18662 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.752421 18823 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.752983 18823 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.756589 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:56.758602 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.732148 18906 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.754128 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:56.768631 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:56.716981 18847 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.769938 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:56.774598 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:56.775532 15789 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:56.776176 18823 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:56.776925 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:56.783938 18935 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:56.784761 18935 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:56.785825 18935 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:56.791420 18618 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.792830 15719 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.794433 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.795923 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.796872 15719 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:56.741317 18624 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.797716 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.798573 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:56.801322 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:56.802132 15722 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:56.803385 15722 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.804594 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:56.805373 16330 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:56.806602 18929 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:56.807320 18916 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.807824 18916 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:56.805613 15646 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:56.810927 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 482) took 1113 ms. Trace:
I20260709 13:06:56.811169 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:56.811417 16330 rpcz_store.cc:276] 0709 13:06:55.697897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.698118 (+   221us) service_pool.cc:224] Handling call
0709 13:06:55.698403 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.648896 (+950493us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b54004e2120. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad254081c0 00007fad25409231 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c
0709 13:06:56.806137 (+157241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.810865 (+  4728us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216913664}
I20260709 13:06:56.818493 18929 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:56.819964 18929 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:56.820398 18929 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:56.821412 18929 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.823833 18929 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.826645 18610 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:56.828217 18677 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.828540 18610 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:56.833865 18950 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.834472 18950 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.834396 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:56.835093 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2489) took 1300 ms. Trace:
I20260709 13:06:56.836864 18624 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.835696 15713 rpcz_store.cc:276] 0709 13:06:55.534747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.534854 (+   107us) service_pool.cc:224] Handling call
0709 13:06:55.535134 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:55.679772 (+144638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.679817 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:55.680603 (+   786us) log.cc:844] Serialized 52 byte log entry
0709 13:06:55.872868 (+192265us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:55.872983 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.834469 (+961486us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b540026d4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:56.834522 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.834574 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:56.834605 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.834897 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12253,"raft.queue_time_us":78232,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3986,"spinlock_wait_cycles":110067456,"thread_start_us":170212,"threads_started":2,"wal-append.queue_time_us":100624}
I20260709 13:06:56.765509 18906 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:56.839635 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 78070.8us
I20260709 13:06:56.841811 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2477) took 2480 ms. Trace:
I20260709 13:06:56.842245 15716 rpcz_store.cc:276] 0709 13:06:54.361598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.676376 (+314778us) service_pool.cc:224] Handling call
0709 13:06:54.678455 (+  2079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.783850 (+1105395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.841476 (+1057626us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540017a2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:56.841729 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527423872}
I20260709 13:06:56.844468 18842 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.847254 18858 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:56.847873 18858 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.852530 16333 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:56.835098 18950 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.858948 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:56.860968 18678 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.861507 18678 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:56.862020 18678 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.809011 18916 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:56.866395 18824 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:56.874716 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:56.875741 15795 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.882176 18909 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.894013 18916 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:56.896606 15542 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 247) took 20313 ms (client timeout 15000 ms). Trace:
W20260709 13:06:56.899793 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.903566 18943 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:56.904430 18790 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:56.903292 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44630.7us
I20260709 13:06:56.910414 18822 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.910995 18822 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:06:56.911317 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.916390 18624 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:56.948181 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 266241us
I20260709 13:06:56.951013 15795 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:06:56.954109 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.955152 16330 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:56.957166 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:56.958875 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.961685 16334 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.963587 18943 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.963896 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:56.964862 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:56.965138 18787 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.965710 18787 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:56.966066 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:56.966866 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:56.967347 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:56.965728 15644 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.964862 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.969578 16328 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:56.968734 18778 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.966320 18787 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.970994 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.916919 18677 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.971048 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:56.935153 18806 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.966920 15646 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 4.
I20260709 13:06:56.973409 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:56.927861 18906 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:56.985348 18847 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:57.001655 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.014273 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:56.975422 18778 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.964300 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:56.964285 18943 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:56.977934 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.029002 18943 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.029637 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.037652 18710 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.038264 18710 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.038798 18710 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.054126 18710 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.060094 18710 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:56.912227 18822 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.070247 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:57.070623 18822 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.013767 18782 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:06:57.072327 18452 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.072665 18782 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.073170 18782 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:57.074244 18782 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.076138 18782 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.066587 18829 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:06:57.079082 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:57.081964 15795 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:57.083775 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:57.084499 15795 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:57.087280 18678 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.088207 16328 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:56.980154 18624 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.093178 18624 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.094099 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:57.094978 16328 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.095505 16330 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:57.096145 18781 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.096737 18781 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:57.097203 18781 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:57.097995 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.098165 18790 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.923300 18459 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.098738 18790 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.099267 18459 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.101159 18790 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:57.102455 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 131219us
I20260709 13:06:57.103320 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.103370 18627 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.104545 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.105326 18951 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.106033 18286 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.106176 16333 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:57.106799 18286 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:57.111104 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.116911 15644 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 5.
I20260709 13:06:57.119841 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:57.019712 18847 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.128688 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:57.144536 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 122502us
I20260709 13:06:57.110057 18778 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.150789 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:57.114450 18829 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:57.155539 18777 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.156199 18777 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:57.155875 18829 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.156720 18777 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.162536 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:57.166215 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.014966 18677 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.142429 18286 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.172123 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.109841 18892 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.172847 15644 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:06:57.153267 18710 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.174639 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.130721 18824 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:57.153038 18452 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.186327 16328 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:06:57.154278 18678 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.180095 18710 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:57.178143 15641 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:57.167970 18782 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.181339 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.189457 15718 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:57.197525 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 67159.9us
I20260709 13:06:57.151665 18847 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:57.198529 15644 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:57.186627 18940 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:57.216568 15541 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 6, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 6 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.195644 18858 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.205856 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:57.206521 18829 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.209856 18841 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:56.897125 15542 rpcz_store.cc:269] 0709 13:06:36.583424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.583636 (+   212us) service_pool.cc:224] Handling call
0709 13:06:37.652330 (+1068694us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2540ef3a 00007fad2b1c51cc 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:06:37.952111 (+299781us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5400310010. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e2640 00007fad2b1b9b76 00007fad2b2c3c3e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:06:56.896264 (+18944153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:47.606706 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:47.718200 (+111494us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:47.718275 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:06:47.718312 (+    37us) tablet.cc:662] Decoding operations
0709 13:06:47.719791 (+  1479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:47.719894 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:47.719940 (+    46us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:06:47.721178 (+  1238us) tablet.cc:701] Row locks acquired
0709 13:06:47.721248 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:06:47.721465 (+   217us) write_op.cc:270] Start()
0709 13:06:47.721683 (+   218us) write_op.cc:276] Timestamp: P: 1783602407721384 usec, L: 0
0709 13:06:47.721717 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:06:47.803838 (+ 82121us) log.cc:844] Serialized 3582 byte log entry
0709 13:06:48.210072 (+406234us) op_driver.cc:464] REPLICATION: finished
0709 13:06:48.477501 (+267429us) write_op.cc:301] APPLY: starting
0709 13:06:48.477661 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:48.483919 (+  6258us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:48.484101 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:48.485522 (+  1421us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:48.486023 (+   501us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:06:48.486086 (+    63us) write_op.cc:312] APPLY: finished
0709 13:06:48.486476 (+   390us) log.cc:844] Serialized 71 byte log entry
0709 13:06:48.490048 (+  3572us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.490201 (+   153us) write_op.cc:454] Released schema lock
0709 13:06:48.490271 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:48.546058 (+ 55787us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.546106 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6505,"reported_tablets":39,"spinlock_wait_cycles":1640935552,"child_traces":[["op",{"apply.queue_time_us":246915,"apply.run_cpu_time_us":4048,"apply.run_wall_time_us":17406,"num_ops":9,"prepare.queue_time_us":413194,"prepare.run_cpu_time_us":28856,"prepare.run_wall_time_us":271504,"raft.queue_time_us":259934,"raft.run_cpu_time_us":20787,"raft.run_wall_time_us":77426,"replication_time_us":488127,"thread_start_us":606621,"threads_started":4,"wal-append.queue_time_us":128334,"wal-append.run_cpu_time_us":21613,"wal-append.run_wall_time_us":1660373}]]}
I20260709 13:06:57.211938 18677 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.174515 18699 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:06:57.201135 18710 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.188212 18790 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.222115 18777 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.222973 18781 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:57.223784 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.230266 15759 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:06:57.261848 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.262239 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.252648 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68985.7us
I20260709 13:06:57.264917 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.255153 18841 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.257027 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.248178 18940 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:06:57.271099 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 68462us
I20260709 13:06:57.270749 15641 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:57.275734 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.259495 18824 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.198302 18452 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.276397 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:57.281910 15642 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.283988 15646 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:57.272158 18841 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.287928 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.277179 18662 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:57.277413 18906 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:57.291590 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:57.297952 15641 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:57.296043 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.276886 15541 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 2 to 5, 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.303241 15714 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:57.278343 18929 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:57.310515 15720 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:06:57.292457 18790 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:57.312090 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.312363 15638 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:57.297475 18662 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:57.317988 15714 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:06:57.310884 15720 pending_rounds.cc:85] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 1
I20260709 13:06:57.314306 18621 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:57.321357 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.305565 18678 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.323014 15716 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:57.324982 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 306830us
I20260709 13:06:57.328228 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:57.328823 18859 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:57.319631 15720 pending_rounds.cc:107] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:57.330777 15720 raft_consensus.cc:2889] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.309973 18906 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:06:57.332886 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.333262 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.329609 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:57.318377 18822 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:57.335888 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.341926 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:57.342865 16328 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:06:57.324081 18806 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:57.344727 15641 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.328843 18220 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.346819 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.302776 18940 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.317634 18790 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.373013 15541 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.303205 18847 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.338649 18822 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:57.386564 18781 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.389117 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2503) took 1027 ms. Trace:
I20260709 13:06:57.382867 18806 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:57.389516 15715 rpcz_store.cc:276] 0709 13:06:56.362103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.599936 (+237833us) service_pool.cc:224] Handling call
0709 13:06:56.603865 (+  3929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.648343 (+ 44478us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:56.668263 (+ 19920us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.878129 (+209866us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b18004690c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:06:57.281904 (+403775us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.292064 (+ 10160us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.292194 (+   130us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:57.292226 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.292289 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.388821 (+ 96532us) raft_consensus.cc:1685] finished
0709 13:06:57.388925 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.389058 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19453,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":63,"raft.queue_time_us":4805,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":11330,"spinlock_wait_cycles":16382336,"thread_start_us":402577,"threads_started":1,"wal-append.queue_time_us":636187}
I20260709 13:06:57.390982 18806 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.394354 18940 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.396112 18906 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.341250 18824 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:06:57.336421 18678 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.398057 18611 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:57.399513 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:57.400717 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:57.402449 18955 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:57.402582 18935 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.403081 18935 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.403498 18935 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.403168 18286 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:57.404228 18956 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:06:57.411271 15788 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:57.377766 15541 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.401604 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:57.411828 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.414896 15641 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:57.418141 15642 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
W20260709 13:06:57.425202 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.425669 18858 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.401420 18611 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:06:57.430454 18958 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:57.432243 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:57.434520 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.435185 15713 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
W20260709 13:06:57.436132 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.418237 18677 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.436807 18677 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.437085 15722 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:06:57.437196 18677 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.437541 15722 pending_rounds.cc:85] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 4
I20260709 13:06:57.437891 15722 pending_rounds.cc:107] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:06:57.438174 15722 raft_consensus.cc:2889] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.442435 18777 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.444725 18916 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.445432 18916 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.448004 18916 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:57.449580 18823 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.451261 18822 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.452853 18822 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.462177 18662 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:57.466388 18961 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:57.467449 18452 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:57.371095 18892 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.337697 18859 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.470357 18859 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:57.473976 18900 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.474468 18900 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.474836 18900 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.479233 15715 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:57.333906 18950 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.486047 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:57.486894 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.487457 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68149.6us
I20260709 13:06:57.489951 15722 raft_consensus.cc:2410] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:57.488029 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:57.490382 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.492470 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:57.493302 15718 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:57.492247 18778 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.495389 18778 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.495975 15647 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:57.496140 18841 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.497254 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:06:57.508083 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.497982 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.497848 18850 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:57.490559 15721 raft_consensus.cc:2376] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7. Re-sending same reply.
I20260709 13:06:57.497004 18677 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.500612 18621 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.501659 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:57.502230 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.484320 18452 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.486249 18710 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.503475 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.506085 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.515720 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.556576 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:57.557070 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:57.522626 16297 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.349835 18787 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.519287 15541 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:57.521669 18823 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.557231 15721 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:06:57.499603 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:57.557760 15714 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
W20260709 13:06:57.567835 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 66237.3us
I20260709 13:06:57.559652 15722 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:06:57.488801 18951 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.561604 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:57.570706 15795 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
W20260709 13:06:57.572072 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.573998 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 51511.7us
I20260709 13:06:57.578859 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.580222 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.580919 15639 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:57.581835 18777 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.582649 18611 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:57.582993 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.584875 15640 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.588872 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.589646 15639 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:57.590411 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:57.591073 15639 raft_consensus.cc:2368] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:06:57.591776 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.592756 15639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:06:57.593379 15639 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:57.594292 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:06:57.597275 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97733.2us
W20260709 13:06:57.597842 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.606864 15647 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:06:57.608026 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.612375 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.633322 15646 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:57.593716 15639 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.645015 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:57.648465 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:57.649353 15644 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:57.650233 15638 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:57.613673 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:57.614511 16298 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.573247 18778 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.659514 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:57.661441 15646 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:06:57.664808 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.598150 15541 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.654315 18678 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:57.670063 18822 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.670153 18954 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.670771 18822 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:57.670902 18954 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.671465 18954 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.671779 18822 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:57.674155 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 327377us
I20260709 13:06:57.566777 18943 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.596535 18459 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.597450 18892 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.679032 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:57.685106 16334 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.604964 18897 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.599213 18841 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.596123 18624 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.682786 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 357127us
I20260709 13:06:57.600651 18677 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.560330 18452 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.687338 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.683449 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:57.695055 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.617992 18823 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.659415 18611 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:06:57.707907 15640 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:57.717262 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:06:57.702158 18824 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.659745 18829 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:06:57.712714 15541 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 7, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 7 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.725440 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.663165 18940 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:06:57.678262 18778 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:57.716037 18964 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:06:57.690228 18459 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.712980 18909 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:06:57.768383 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51225.8us
I20260709 13:06:57.704535 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:57.715996 18892 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:57.725955 18777 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:57.684299 18943 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.785795 15541 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 3, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 3 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:06:57.802583 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:57.710819 18897 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.682508 18951 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:57.788208 16333 raft_consensus.cc:1813] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Handling vote request from an unknown peer 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:57.766927 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.790933 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:57.727353 18850 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.721688 18841 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.821339 15541 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:57.803810 15762 connection.cc:256] RPC call timeout handler was delayed by -1.1484226329999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:06:57.704392 18965 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:06:57.725946 18220 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:57.729641 18824 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.715227 18624 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.750669 15639 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.833985 15641 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:06:57.834846 15644 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:06:57.836633 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 222235us
W20260709 13:06:57.837685 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 133234us
I20260709 13:06:57.819826 18847 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.847864 15642 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:06:57.849725 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 165104us
I20260709 13:06:57.853163 16328 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:06:57.870150 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.841069 15541 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:57.821847 18790 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:57.830565 18777 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:57.832120 18968 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.807348 18935 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.842978 18824 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.830356 18850 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.872629 18806 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:57.878630 18710 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:57.906558 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 50320.3us
I20260709 13:06:57.905557 18929 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:06:57.908821 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.893605 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.833694 18909 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.890312 18968 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.921990 15713 raft_consensus.cc:2368] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:57.899297 18969 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.931516 15794 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:57.923568 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.900383 18847 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:57.900534 18950 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:57.937415 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.883991 18841 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.881444 18900 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.920917 18787 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:57.944876 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:57.944905 15645 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.949097 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:57.936430 18969 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:57.956820 18969 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.958920 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:57.971508 15716 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.957505 18847 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.973722 18991 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:57.974370 18991 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.974573 18220 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:57.966154 15791 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:06:57.967887 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:57.972606 18983 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:57.972899 18943 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:57.943717 15541 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:57.941309 18972 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:57.936012 18710 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.935330 18968 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.997972 15715 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:57.919359 18806 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:57.923509 18973 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.010475 15541 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.016019 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:58.019999 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 170624us
I20260709 13:06:58.021255 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:58.007584 18710 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.031762 18916 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:58.032258 18916 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:58.033192 18710 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:58.033917 18940 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.034211 18636 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.034451 18940 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.034775 18636 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.036639 18940 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:58.037926 18979 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:58.038897 15717 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 6. Ops: []
I20260709 13:06:58.041702 15541 catalog_manager.cc:5697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 4, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 4 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:58.043254 15541 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 2 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.044725 15541 catalog_manager.cc:5697] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 4 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:58.045864 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.046412 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.046950 16328 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.004729 18971 raft_consensus.cc:2764] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:58.003835 18935 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:58.025913 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:58.049511 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:58.052475 15791 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.036995 18636 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.069015 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:58.062580 18823 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:58.070749 18806 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:58.013927 18777 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.072677 15643 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:06:58.055631 16334 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:58.069691 15722 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:58.055346 15541 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 4, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 4 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:58.043725 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:58.033079 18916 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.059281 18929 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:58.059922 18978 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:58.067267 15721 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:06:58.074071 15722 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:58.074739 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:57.923661 18892 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.081645 15791 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:06:58.083834 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62660.1us
I20260709 13:06:58.087592 16328 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:06:58.009490 18452 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:58.059348 18976 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:06:58.097577 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:58.091543 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:58.099579 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:58.100512 15713 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:58.101007 15794 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.101383 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:58.102572 15541 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:06:58.103245 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:58.059864 18981 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.073150 18972 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:58.114156 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:06:58.132004 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.123521 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:58.202250 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:58.018075 18973 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.149304 15646 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:06:58.091452 18929 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:58.117194 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:58.168079 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:58.165906 15722 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.207962 15713 raft_consensus.cc:2410] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:58.207885 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.215718 15721 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:06:58.149425 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 123580us
I20260709 13:06:58.167804 18677 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:58.210400 15638 raft_consensus.cc:2368] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:06:58.149923 18916 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.166571 18847 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:58.222146 15638 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:58.214246 15790 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:58.125463 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:58.210129 18906 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.219029 15646 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:58.168079 18806 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:58.149121 18935 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.144270 18662 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:58.219864 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 105827us
I20260709 13:06:58.231941 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.109896 18459 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.170162 15541 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 6, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 6 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.142596 18624 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:58.164932 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:06:58.245540 15529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 80845.6us
I20260709 13:06:58.220845 18677 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:58.116027 18981 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.166859 18971 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:58.224393 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 121267us
W20260709 13:06:58.235047 18975 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:06:58.168689 18980 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:06:58.213694 18997 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:58.219738 18929 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.247980 15647 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:58.220865 18990 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.216723 18969 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.236342 15722 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.264187 15541 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:06:58.279932 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.264640 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:58.283461 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:58.289405 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57378.7us
W20260709 13:06:58.289888 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50653.6us
I20260709 13:06:58.243285 18850 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.290526 18935 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.308485 18981 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:58.309103 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65854.1us
I20260709 13:06:58.287077 19010 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:06:58.309948 18823 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.310417 18823 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.310791 18823 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.311399 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:58.311619 18973 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:58.312789 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:58.312903 18997 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:06:58.313653 15647 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:58.314111 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:58.314246 18841 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.314843 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:58.314973 18980 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:58.315537 15647 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:06:58.315930 18980 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.316304 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:58.316488 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:58.233554 18847 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.236914 18806 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.325081 15646 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:58.324357 15541 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.308501 18935 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:58.361068 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:58.326148 18973 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.326296 18621 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:58.368249 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74749.4us
I20260709 13:06:58.320143 18995 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:58.374872 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 154807us
I20260709 13:06:58.377027 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.316522 18980 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.380098 18965 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.380782 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:06:58.384450 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.384738 18980 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.386505 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.387327 16327 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:58.290333 18971 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.314265 18997 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.322528 18990 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:06:58.407467 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.409653 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.410342 15791 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:06:58.392396 16326 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:58.402215 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.416819 18995 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:58.418063 18995 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.420765 18929 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.422936 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.425072 16334 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:58.375272 18621 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:06:58.531114 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.555996 15685 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.096s (SENT)
I20260709 13:06:58.446921 15792 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:06:58.599794 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 263372us
I20260709 13:06:58.605789 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.644801 15791 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:58.646338 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.644599 18990 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:58.373119 18677 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.645695 18996 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:58.673460 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.684707 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.690045 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.691742 15791 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:06:58.692582 19012 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.693626 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 634) took 1366 ms. Trace:
I20260709 13:06:58.693461 19012 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.694094 16333 rpcz_store.cc:276] 0709 13:06:57.327249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.328019 (+   770us) service_pool.cc:224] Handling call
0709 13:06:58.693400 (+1365381us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54004d3354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:58.693543 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056583424}
W20260709 13:06:58.694733 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 138793us
I20260709 13:06:58.697242 19013 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:58.697301 18841 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:58.697856 19013 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:58.699455 18678 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:58.692761 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.699862 18678 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:58.700582 15791 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:06:58.701320 19005 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:06:58.701642 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:58.702358 15791 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.701346 18678 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.702574 18897 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.703478 18678 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.690809 15639 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:58.704718 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42122 (request call id 1969) took 1117 ms. Trace:
I20260709 13:06:58.705112 15639 rpcz_store.cc:276] 0709 13:06:57.587032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.592549 (+  5517us) service_pool.cc:224] Handling call
0709 13:06:58.690698 (+1098149us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4c00048300. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad236d2a20 00007fad236e3a29 00007fad236e413f 00007fad236a82ab 00007fad236d5f3c 00007fad236d63fe 00007fad2396388b 00007fad25362495 00007fad253b330f 00007fad253fda55 00007fad2a3cdcd0
0709 13:06:58.704574 (+ 13876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43806464}
W20260709 13:06:58.706581 19006 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:58.706898 18909 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:58.708863 18991 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:58.710642 18900 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:58.710950 18965 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:58.711548 18965 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.712853 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.714022 18965 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:58.714054 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68719.4us
I20260709 13:06:58.716297 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:58.716622 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1961) took 1137 ms. Trace:
I20260709 13:06:58.717013 15645 rpcz_store.cc:276] 0709 13:06:57.579241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.612460 (+ 33219us) service_pool.cc:224] Handling call
0709 13:06:57.612798 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.956401 (+343603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.716401 (+760000us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003aff54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:58.716565 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526096768}
I20260709 13:06:58.724650 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 1977) took 1032 ms. Trace:
I20260709 13:06:58.724992 15760 leader_election.cc:400] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:58.725481 15760 leader_election.cc:403] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.728097 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.728303 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.729096 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.729276 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:58.729759 16333 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:06:58.725116 15644 rpcz_store.cc:276] 0709 13:06:57.692313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.694757 (+  2444us) service_pool.cc:224] Handling call
0709 13:06:58.724480 (+1029723us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000e79d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:58.724590 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279165184}
I20260709 13:06:58.728820 16332 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:58.730676 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1959) took 1153 ms. Trace:
I20260709 13:06:58.736974 15641 rpcz_store.cc:276] 0709 13:06:57.576858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.577174 (+   316us) service_pool.cc:224] Handling call
0709 13:06:57.578562 (+  1388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.840045 (+261483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.730453 (+890408us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54002dc154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:58.730619 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563607296}
I20260709 13:06:58.745501 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:58.772204 15716 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.000s
I20260709 13:06:58.772881 15716 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:58.687589 18996 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:58.789254 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:06:58.790542 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 71981.2us
I20260709 13:06:58.793584 15792 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.794340 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:58.797070 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.803694 16327 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.805877 18777 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:58.806944 18777 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.809820 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:58.825773 15791 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:06:58.845952 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77791.1us
I20260709 13:06:58.827922 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.847680 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.848343 16328 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.848256 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:58.830729 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:58.846899 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:58.734882 18990 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.858741 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:58.822068 18286 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.899214 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:58.827373 18850 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.848878 18900 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:58.905011 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.907653 18787 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.746423 18621 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.858920 18991 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.863441 18806 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:58.925765 18787 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.865855 18452 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:58.920401 18900 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.927755 18909 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:58.930939 18985 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.189s
I20260709 13:06:58.998786 18452 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.008422 18452 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:58.938769 18971 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:58.932260 19007 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:06:58.946020 18996 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:58.930466 18662 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.011449 18823 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.002s
I20260709 13:06:59.011982 18823 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.012024 18909 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.996196 18990 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.015763 15791 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:58.935006 18965 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.943115 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.017001 15795 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:58.942309 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:58.998266 18787 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.017807 18909 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.018085 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.018882 15795 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
W20260709 13:06:58.950158 18954 consensus_meta.cc:287] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.278s	user 0.004s	sys 0.009s
W20260709 13:06:58.947618 18824 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.035s	user 0.011s	sys 0.000s
I20260709 13:06:58.954293 18850 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:58.961889 15722 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.001s
W20260709 13:06:58.965371 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.828293 18993 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:06:58.970316 18916 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.739s	user 0.006s	sys 0.005s
I20260709 13:06:58.972431 16327 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:58.925477 18286 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:58.957470 18847 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:06:59.049407 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.926898 16328 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:58.966747 18897 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.026185 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.050980 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:58.997314 18991 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:59.048336 15722 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:59.049454 16330 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:59.052186 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2533) took 1002 ms. Trace:
I20260709 13:06:59.052580 15722 rpcz_store.cc:276] 0709 13:06:58.049775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.051749 (+  1974us) service_pool.cc:224] Handling call
0709 13:06:59.052113 (+1000364us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:59.053603 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.054011 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.062283 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:58.983768 15792 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
W20260709 13:06:59.047542 15787 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.025s	sys 0.034s
W20260709 13:06:59.071514 15787 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.026s	sys 0.035s
I20260709 13:06:58.998425 18900 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:59.077502 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.080960 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.081305 16328 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.082774 15716 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:59.019786 18621 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.093937 15714 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:06:59.095793 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.070688 18991 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:59.108183 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.072686 18909 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:59.047799 18954 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.126132 16327 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:59.071337 18897 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.080325 18824 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:59.138470 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 280387us
I20260709 13:06:59.113942 18777 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:59.140534 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 346270us
I20260709 13:06:59.083954 18993 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:59.131330 18968 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.112s	user 0.009s	sys 0.004s
I20260709 13:06:59.146994 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.154284 15721 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:06:59.140091 18823 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:59.136940 19024 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.124089 18909 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.157306 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:59.138801 18989 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:59.177507 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.182677 16327 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:59.184763 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:59.189319 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:06:59.194832 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 278048us
I20260709 13:06:59.154847 18777 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:06:59.207427 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:59.226035 19028 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.226599 19028 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:59.226986 19028 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.155680 18968 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.194854 18823 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:06:59.229905 19022 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:59.202041 18906 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.971s	user 0.011s	sys 0.001s
I20260709 13:06:59.210258 18995 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.231362 16325 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.237308 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:59.203003 19021 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:06:59.243145 19026 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:59.243692 18909 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.223346 18971 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.230584 19022 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.252107 18982 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.252923 18982 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.232762 18990 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:06:59.291582 18990 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.236218 18286 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.293375 18286 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.294299 19034 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.294994 19034 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.295970 19013 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.297256 19013 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:59.299525 18781 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.306165 16332 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.261147 19022 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.266026 18850 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.233031 18997 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:59.236438 18906 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.270483 18968 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.271471 18954 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.272094 18909 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.258285 18982 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.283313 19024 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.282998 18897 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:06:59.287531 18678 consensus_meta.cc:287] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.006s
I20260709 13:06:59.288239 18824 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.290213 18662 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6.
I20260709 13:06:59.244966 19033 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:59.317459 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 120412us
I20260709 13:06:59.328837 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:59.292224 18900 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.281529 18452 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:06:59.331674 15685 leader_election.cc:336] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.564s (SENT)
I20260709 13:06:59.325670 19024 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.335584 18990 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.337128 16334 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:59.340399 16334 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.341636 19024 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.343704 19024 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.349920 18929 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.314944 18997 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.351637 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2296) took 1412 ms. Trace:
I20260709 13:06:59.328879 18909 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.352073 15794 rpcz_store.cc:276] 0709 13:06:57.939898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.945511 (+  5613us) service_pool.cc:224] Handling call
0709 13:06:57.965523 (+ 20012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.101407 (+135884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.351371 (+1249964us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540047bdd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:59.351564 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311149824}
I20260709 13:06:59.331611 19034 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.338498 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:06:59.369364 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 132128us
I20260709 13:06:59.371551 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:59.371944 18991 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.382536 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.383496 18782 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.384111 18991 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.384222 18782 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.339233 19033 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:59.374222 16333 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.381130 18751 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.386561 18993 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.392810 15644 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:59.387802 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 198602us
W20260709 13:06:59.388788 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57140.8us
I20260709 13:06:59.395262 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:59.395885 15644 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:06:59.397231 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:06:59.399260 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:06:59.400132 15639 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:06:59.403172 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:59.403813 15644 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.409286 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.409557 15640 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:59.409835 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.410145 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:06:59.411350 15645 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.411916 15639 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:06:59.393301 18991 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.413951 16333 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:59.414398 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:59.417261 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:59.401376 18677 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.385440 18782 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.395663 19047 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:06:59.405226 18751 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.425243 16333 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:59.426466 15790 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.427389 18909 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.410930 18847 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.429193 19033 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.434120 18778 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.435070 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 1986) took 1740 ms. Trace:
I20260709 13:06:59.401523 18787 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.411141 18636 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:06:59.438090 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.441156 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:59.419004 18824 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:59.447422 15646 rpcz_store.cc:276] 0709 13:06:57.695022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.227156 (+532134us) service_pool.cc:224] Handling call
0709 13:06:58.324745 (+ 97589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.327117 (+  2372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.434797 (+1107680us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b5400345b50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:59.434985 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223771904}
I20260709 13:06:59.411065 18990 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:59.455883 15794 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:59.456027 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:59.452672 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.454483 15789 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:59.424399 18677 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.455211 18900 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.471009 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:06:59.460135 15644 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:06:59.473510 16334 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:59.419147 18980 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:59.455704 18778 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:59.475138 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.454978 18824 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.463461 19046 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:59.480643 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.465875 19033 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.462432 18678 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.447072 18997 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.476922 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.446190 19042 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.479810 15685 leader_election.cc:336] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.523s (SENT)
I20260709 13:06:59.481483 15790 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:59.475190 19039 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.483635 18929 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:59.489576 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.481519 18824 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:59.490782 15790 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:59.431877 19047 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.455963 18636 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.495594 18678 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.496825 19046 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:59.503495 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.504408 15789 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:59.493899 18778 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.511390 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.493286 18929 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:59.509922 18678 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.491209 19028 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:59.530079 15760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.019s	sys 0.043s
I20260709 13:06:59.530819 18677 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.531011 18787 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.515312 18778 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.540508 15789 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:06:59.544348 15645 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
W20260709 13:06:59.547900 18999 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.258s	user 0.004s	sys 0.013s
I20260709 13:06:59.570142 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.548051 19047 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.506269 18452 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.550297 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.576570 15791 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:59.551080 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.576757 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:59.553277 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.553663 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:59.558995 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.562028 15760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.019s	sys 0.043s
I20260709 13:06:59.563702 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.578423 15790 raft_consensus.cc:2368] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8.
W20260709 13:06:59.578366 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 853483us
I20260709 13:06:59.547219 19039 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.587177 15793 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:06:59.565796 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51380.6us
I20260709 13:06:59.552505 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:59.588219 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.490694 19042 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.579664 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:59.580919 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.590679 15787 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:06:59.554935 18847 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.565315 19046 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.598289 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.598992 15795 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:06:59.492379 18751 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.608984 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:59.609618 15716 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.609606 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:59.606725 18778 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.612334 18778 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.611757 18678 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.614063 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.604476 19046 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.614712 15714 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:06:59.616688 19046 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.620563 18980 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.623876 19034 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.624416 19034 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.624516 19012 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:59.624897 19034 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.628000 19023 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:06:59.627534 18787 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:59.630139 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 496) took 1191 ms. Trace:
I20260709 13:06:59.579299 19010 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:59.633286 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.630501 16326 rpcz_store.cc:276] 0709 13:06:58.438823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.439006 (+   183us) service_pool.cc:224] Handling call
0709 13:06:58.627958 (+188952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.744410 (+116452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.744453 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.748183 (+  3730us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.132510 (+384327us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.132560 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.132632 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.627310 (+494678us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:59.629832 (+  2522us) raft_consensus.cc:1685] finished
0709 13:06:59.629854 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.630076 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25763,"raft.queue_time_us":63758,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":137,"spinlock_wait_cycles":3764480,"thread_start_us":379690,"threads_started":1,"wal-append.queue_time_us":459383}
I20260709 13:06:59.637713 18829 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.638767 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 422) took 2108 ms. Trace:
I20260709 13:06:59.638341 19039 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.639196 15788 rpcz_store.cc:276] 0709 13:06:57.530057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.530285 (+   228us) service_pool.cc:224] Handling call
0709 13:06:57.530735 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.562235 (+ 31500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.562282 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.617640 (+ 55358us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.090061 (+472421us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.090135 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.090234 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.539085 (+1448851us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:06:59.638425 (+ 99340us) raft_consensus.cc:1685] finished
0709 13:06:59.638445 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.638674 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49062,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":38081280,"thread_start_us":409157,"threads_started":1,"wal-append.queue_time_us":544688}
I20260709 13:06:59.621165 18980 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.634182 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:06:59.650723 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.656425 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:59.666069 18969 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.667968 15719 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:59.670081 18636 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.670892 18929 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.675084 19028 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.604180 18847 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.686189 15716 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:59.697435 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.699012 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:06:59.705242 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71184.8us
I20260709 13:06:59.706830 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:06:59.710767 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.680261 19010 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:06:59.690937 19044 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.727310 15791 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:59.727741 19033 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:06:59.733549 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.738687 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:06:59.744128 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.744617 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.708356 19046 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:59.740285 15793 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:59.696172 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.751955 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:59.755697 15713 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.768249 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.768851 15791 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.769321 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.769893 15793 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:59.776674 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 80627.7us
I20260709 13:06:59.779381 19063 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.780019 19063 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.780435 19063 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.783141 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:59.748008 18950 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.789862 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:59.709019 18824 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.785058 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.753809 19046 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.767643 18677 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:59.768916 18997 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.766889 18900 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.803542 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:59.811818 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.815481 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.818266 18677 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.819808 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:59.825700 16326 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:06:59.824347 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:59.802412 18286 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.739441 19044 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.828958 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:06:59.807698 18950 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.746383 19033 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:59.833570 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89352.1us
I20260709 13:06:59.811831 18991 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.813308 19046 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:59.825567 18997 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.859323 18997 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.825224 19043 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:59.860237 19043 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:06:59.841861 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.846338 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2537) took 1795 ms. Trace:
I20260709 13:06:59.861311 19043 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.861259 15715 rpcz_store.cc:276] 0709 13:06:58.050853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.211447 (+160594us) service_pool.cc:224] Handling call
0709 13:06:58.217314 (+  5867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.321504 (+104190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.321537 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.325967 (+  4430us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.645145 (+319178us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.645207 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.726576 (+ 81369us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:06:59.846024 (+1119448us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54003bb854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:06:59.846074 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.846114 (+    40us) raft_consensus.cc:1685] finished
0709 13:06:59.846127 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.846281 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29358,"raft.queue_time_us":38245,"raft.run_cpu_time_us":1395,"raft.run_wall_time_us":391765,"spinlock_wait_cycles":174484224,"thread_start_us":270867,"threads_started":1,"wal-append.queue_time_us":438814}
I20260709 13:06:59.863140 18824 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:06:59.811681 18993 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:59.850103 18841 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:59.843065 18950 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.829311 18900 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:06:59.829751 19003 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.521s	user 0.006s	sys 0.007s
I20260709 13:06:59.844839 18985 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:59.866860 18985 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:06:59.867493 19044 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.867746 18985 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.855221 18991 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.869486 18991 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.817451 19058 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:06:59.870586 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:06:59.871601 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:06:59.873021 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:06:59.855547 18909 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:06:59.874161 19042 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.874410 18909 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.836882 19010 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:06:59.876550 18909 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.877082 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:59.877379 18909 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:59.877676 19027 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.646s	user 0.003s	sys 0.000s
I20260709 13:06:59.878465 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:06:59.879586 19061 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:06:59.879972 18847 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:06:59.880815 19062 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:06:59.880672 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.854372 18677 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:06:59.863548 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.883172 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:06:59.880033 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.886888 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.886698 19028 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:59.888706 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.888795 18989 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:59.890344 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.891408 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.892270 15714 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:59.892954 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.893038 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.893590 15714 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:06:59.894246 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.894640 15714 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.887109 18965 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:06:59.897871 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:06:59.898545 16332 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:06:59.899821 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:06:59.900491 15720 raft_consensus.cc:2368] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:06:59.895865 15721 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:59.896206 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 647) took 1168 ms. Trace:
I20260709 13:06:59.901944 16330 rpcz_store.cc:276] 0709 13:06:58.727942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.728073 (+   131us) service_pool.cc:224] Handling call
0709 13:06:59.896036 (+1167963us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54007805d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:06:59.896154 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736311680}
I20260709 13:06:59.885206 18950 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:06:59.905939 19033 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.906198 15792 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:59.906555 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.885823 18993 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.907647 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.908106 18900 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:06:59.908350 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.909905 15793 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:06:59.909994 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.910856 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.911062 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:06:59.911998 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.912549 15792 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:06:59.912459 18847 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:59.911870 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.914609 18847 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:59.908162 15794 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.903190 15791 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:06:59.921437 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:59.922451 16327 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:06:59.927874 15715 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:59.935559 15715 pending_rounds.cc:85] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:06:59.936038 15715 pending_rounds.cc:107] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:59.936398 15715 raft_consensus.cc:2889] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.921927 15713 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:59.926725 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:06:59.938817 15787 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:06:59.926077 16331 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:59.925943 15791 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:59.953609 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2308) took 1571 ms. Trace:
I20260709 13:06:59.953776 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:06:59.955320 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.957620 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:06:59.958495 16327 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:06:59.960419 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:06:59.992336 15794 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:06:59.924456 19044 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.954298 15796 rpcz_store.cc:276] 0709 13:06:58.382019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.385038 (+  3019us) service_pool.cc:224] Handling call
0709 13:06:58.385367 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.385771 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.385808 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.386313 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.925349 (+1539036us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18003df4e0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1
0709 13:06:59.925552 (+   203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.925604 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.925696 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.925777 (+    81us) raft_consensus.cc:1685] finished
0709 13:06:59.925795 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.953477 (+ 27682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6161,"raft.queue_time_us":3772,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":56002,"spinlock_wait_cycles":32334208,"thread_start_us":240398,"threads_started":1,"wal-append.queue_time_us":621677}
I20260709 13:06:59.996141 18993 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:59.982515 18997 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.006765 18993 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.004356 18621 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:00.015473 18997 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:00.022574 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 218079us
I20260709 13:06:59.997134 18973 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.996735 19044 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:06:59.982302 18900 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:00.013028 18993 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.029479 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:00.076272 15794 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.086442 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.024847 18997 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:00.091928 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 218954us
I20260709 13:07:00.093091 15688 leader_election.cc:400] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:07:00.093464 15688 leader_election.cc:403] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:07:00.025067 18892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.014s	sys 0.013s
I20260709 13:07:00.026093 18973 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:00.114830 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.026654 19058 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.117583 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:00.020167 18621 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:00.116109 18892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.019s	sys 0.015s
I20260709 13:07:00.025983 19063 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:00.035825 19034 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:00.123121 18950 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:00.190752 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.191210 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.124763 18909 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.121241 18677 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 5.
I20260709 13:07:00.169950 19058 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:00.192476 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 291960us
I20260709 13:07:00.199321 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:00.196666 18909 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:00.199985 16331 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:00.200521 18909 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.200657 19058 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:00.206934 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:00.215524 16297 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:00.217494 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:00.219954 19009 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:00.221076 18990 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.199636 18996 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.125717 19044 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:00.255255 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.223690 18929 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.207696 18892 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:07:00.225946 19010 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:00.226477 18990 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:00.231891 18916 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:00.253783 19072 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:07:00.223487 18969 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:00.275132 18916 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.264227 18929 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:00.273157 19010 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:00.286127 19071 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:07:00.290334 19074 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:07:00.224103 18973 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:00.291040 19073 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:07:00.292214 18621 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:00.314858 16326 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.300058 15791 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.301221 18286 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.317507 15791 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:00.319768 19056 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.322693 19056 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.301862 18929 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.302662 18916 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:00.325528 19056 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:00.335377 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 160972us
I20260709 13:07:00.282548 19046 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:00.336679 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:00.292212 18909 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.333846 18973 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.339986 19034 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:00.361299 15688 leader_election.cc:400] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:00.361655 15688 leader_election.cc:403] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.363220 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:00.365228 19082 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:00.350840 19043 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:00.365448 18892 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.360646 19010 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.332469 18990 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.361404 19092 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:00.377951 18993 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:00.387605 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.356447 19063 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:00.410624 19046 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:00.411441 15716 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:00.389467 19080 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:07:00.383509 19079 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:00.407013 18993 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:00.414916 18909 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:00.379937 18997 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.400095 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:00.416550 15714 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.419445 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:00.415735 18909 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:00.440614 15685 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.716s (SENT)
I20260709 13:07:00.361789 18991 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.458431 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:00.462713 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:00.463459 16329 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.431955 18990 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.474563 15718 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:00.476328 15722 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.467792 15714 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:00.486099 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 95097.6us
I20260709 13:07:00.491233 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:00.492178 15718 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.488859 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:00.503815 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:00.487771 19092 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:00.519625 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.518021 19092 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:00.530444 19092 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.531855 19092 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.532521 18929 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.535282 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:00.536048 15721 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.511018 19043 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:00.544705 15718 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:00.545898 15713 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:00.556965 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68203.5us
I20260709 13:07:00.561105 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:00.541266 19106 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.539484 18892 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
W20260709 13:07:00.570981 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.586550 18286 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:00.563251 19079 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:00.606987 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:00.611531 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.612003 18929 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:00.566104 19106 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:00.576105 19104 raft_consensus.cc:2764] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:00.585973 19084 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:00.644672 19100 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:00.646495 19106 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:00.647886 19106 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.650672 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.651423 15788 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
W20260709 13:07:00.653699 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.655844 15793 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:00.659178 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 99646.4us
I20260709 13:07:00.663139 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.663949 15790 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:00.588680 19024 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:07:00.666437 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.667001 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2055) took 1024 ms. Trace:
I20260709 13:07:00.669106 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:00.670225 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63362.9us
W20260709 13:07:00.670495 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.667410 15790 rpcz_store.cc:276] 0709 13:06:59.642981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.662893 (+1019912us) service_pool.cc:224] Handling call
0709 13:07:00.666940 (+  4047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.672037 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:00.673929 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:00.689498 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.689831 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.700598 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.738421 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.758808 18751 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.759460 18751 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.761926 18751 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:00.767784 15795 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:00.664593 18991 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:00.665962 19045 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.772258 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 101320us
I20260709 13:07:00.772768 19079 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.675734 19092 raft_consensus.cc:2764] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:00.783985 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:00.786845 15790 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:00.778779 16329 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:00.794569 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:00.795449 19104 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:00.795914 19104 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:00.796757 19104 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.778542 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.798117 15792 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:00.808001 15760 leader_election.cc:400] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:00.808495 15760 leader_election.cc:403] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:00.814208 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 204543us
I20260709 13:07:00.818934 15717 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.819852 18950 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.820762 18950 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.824919 18950 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:00.837914 15788 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:00.839047 15789 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:00.841323 18973 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.841951 18220 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:00.857163 15685 leader_election.cc:336] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.130s (SENT)
W20260709 13:07:00.899932 15685 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.139s (SENT)
I20260709 13:07:00.655112 19084 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:00.632082 19043 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:00.887259 15794 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
W20260709 13:07:00.904452 15685 leader_election.cc:336] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.168s (SENT)
W20260709 13:07:00.906232 15685 leader_election.cc:336] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.979s (SENT)
I20260709 13:07:00.909294 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:00.908857 15685 leader_election.cc:336] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.175s (SENT)
I20260709 13:07:00.911152 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:00.875310 19033 consensus_queue.cc:1059] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:00.874691 19111 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:00.827566 19045 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.918192 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:00.925722 18847 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:00.932536 15685 leader_election.cc:336] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.212s (SENT)
I20260709 13:07:00.932921 15721 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:00.933107 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:00.934845 19084 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:00.935232 18997 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:00.936537 15794 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:00.914604 19103 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.952467 15794 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:00.955260 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.957868 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.961894 19103 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.962009 19084 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.963187 19084 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:00.963027 18929 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.964248 19084 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:00.965632 19084 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.969065 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:00.969964 15794 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:00.995301 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 62790.6us
I20260709 13:07:01.002131 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.004812 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:01.010794 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:01.015102 18980 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:01.017014 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:01.006283 15685 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.216s (SENT)
I20260709 13:07:01.027590 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:01.041119 15685 leader_election.cc:336] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.238s (SENT)
I20260709 13:07:01.043532 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.273674 15790 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:01.273854 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 232755us
W20260709 13:07:01.047274 19096 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.655s	user 0.005s	sys 0.004s
I20260709 13:07:01.050328 16329 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
W20260709 13:07:01.055037 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.044836 15791 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.021612 19045 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.083420 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1551) took 1328 ms. Trace:
I20260709 13:07:01.277932 15722 rpcz_store.cc:276] 0709 13:06:59.754949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.895080 (+140131us) service_pool.cc:224] Handling call
0709 13:06:59.895340 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.477120 (+581780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.083127 (+606007us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54001e8054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:01.083348 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335435648}
I20260709 13:07:01.039448 18943 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.270769 18980 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.131880 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.204473 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.210680 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:01.282661 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.282917 15794 raft_consensus.cc:2376] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:01.042519 19111 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:01.054491 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.266564 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.047740 19034 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:01.287986 19045 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.288385 19034 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.290835 19034 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.292040 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2337) took 1446 ms. Trace:
W20260709 13:07:01.282655 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.294670 15788 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.292657 15787 rpcz_store.cc:276] 0709 13:06:59.845975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.940651 (+ 94676us) service_pool.cc:224] Handling call
0709 13:06:59.986298 (+ 45647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.176550 (+190252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.176591 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.196987 (+ 20396us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.281946 (+ 84959us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:00.281983 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.282050 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.046634 (+764584us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:01.291615 (+244981us) raft_consensus.cc:1685] finished
0709 13:07:01.291647 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.291960 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16711,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5721,"spinlock_wait_cycles":50837760,"thread_start_us":233592,"threads_started":2,"wal-append.queue_time_us":127339}
W20260709 13:07:01.274545 15685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.652s (SENT) [suppressed 39 similar messages]
I20260709 13:07:01.286000 15791 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.296088 18943 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.285907 18980 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.288755 19045 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.258570 18990 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:01.306582 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.314990 15716 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.308328 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:01.316470 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.317423 15721 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.309717 15791 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:01.319028 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 437) took 1085 ms. Trace:
I20260709 13:07:01.319532 15791 rpcz_store.cc:276] 0709 13:07:00.233650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.247640 (+ 13990us) service_pool.cc:224] Handling call
0709 13:07:00.299884 (+ 52244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.028847 (+728963us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4c003cdfc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad236d2a20 00007fad236e3a29 00007fad236a9644 00007fad236d0f2d 00007fad236d0b93 00007fad2540118b 00007fad25401cb5 00007fad253fcf30 00007fad253fe7de 00007fad25408b49 00007fad25409416
0709 13:07:01.318321 (+289474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.318939 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5567744}
W20260709 13:07:01.310374 15685 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.299s (SENT)
I20260709 13:07:01.320971 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:01.283707 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 272963us
I20260709 13:07:01.308698 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:01.323297 15720 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.313372 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.324276 15713 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.274618 19024 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.335268 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.336076 15787 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:07:01.332754 15722 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.299475 18943 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.280017 19042 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.359946 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.299774 18980 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:01.314317 19045 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.364494 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:01.380800 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.360968 15713 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: [6.9-6.9]
W20260709 13:07:01.355376 18965 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:01.368412 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:01.363392 15717 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:01.380810 15716 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.332063 19111 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:01.383234 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.391129 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.392875 15722 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:01.396536 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.398115 16331 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:01.401445 15787 raft_consensus.cc:2376] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10. Re-sending same reply.
W20260709 13:07:01.408335 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.379997 18787 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.410265 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.416083 15713 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:01.337567 18990 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.359992 19024 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.394109 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:01.435683 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.436878 15787 raft_consensus.cc:2410] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:01.379743 19042 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.440624 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:01.441670 15713 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:01.449960 15687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.040s	sys 0.092s
W20260709 13:07:01.451221 15687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.040s	sys 0.092s
W20260709 13:07:01.444132 18973 consensus_meta.cc:287] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.002s
I20260709 13:07:01.423213 18787 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.454252 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.442591 19104 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:01.462653 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.469450 19101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.068s	sys 0.114s
I20260709 13:07:01.455108 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.460340 15718 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 4: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.472261 19134 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.474071 15760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.062s	sys 0.093s
I20260709 13:07:01.474186 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.480949 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:01.485455 15760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.062s	sys 0.093s
W20260709 13:07:01.485801 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 644859us
I20260709 13:07:01.478662 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:01.475698 18929 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.024s	sys 0.046s
I20260709 13:07:01.461095 18636 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.476487 15787 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:01.476861 19101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.069s	sys 0.114s
I20260709 13:07:01.486492 15794 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:01.459512 18973 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:01.456323 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:01.487933 15720 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
W20260709 13:07:01.488847 18929 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.026s	sys 0.046s
I20260709 13:07:01.485932 15722 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:01.468868 19104 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:01.492656 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:01.502942 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.502882 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.503796 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.512112 15716 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:01.512581 15720 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:07:01.503118 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46917.7us
I20260709 13:07:01.514113 16331 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:01.514775 18841 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:01.516260 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:01.517400 18943 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:01.502490 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.518981 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:01.512099 15794 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:01.520783 15720 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:01.521662 15720 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:01.520783 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.523377 15787 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:01.527119 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.526121 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.531754 15790 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:01.532770 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.542021 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:01.544257 15718 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6. Re-sending same reply.
I20260709 13:07:01.547475 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.547610 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.382110 19131 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:07:01.545061 15720 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.519714 19138 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.551213 15720 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.551913 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.522164 18943 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:01.490792 19134 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:01.554165 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.542668 19034 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:01.562098 15685 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.596s (SENT)
I20260709 13:07:01.501968 18636 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:01.577062 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.590992 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.592284 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.592808 15716 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:07:01.593602 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.594223 15720 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:07:01.595789 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.596356 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.598313 15685 leader_election.cc:336] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.616s (SENT)
I20260709 13:07:01.598408 18636 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:01.553851 19138 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:01.599750 19138 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.601121 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.601770 15720 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:01.602908 15718 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
W20260709 13:07:01.604409 19140 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:01.590183 15790 raft_consensus.cc:2376] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
I20260709 13:07:01.613895 15722 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:01.547111 19111 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:07:01.574568 19034 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.627439 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.634657 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.635669 15718 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:01.616124 19106 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.968s	user 0.013s	sys 0.005s
I20260709 13:07:01.610790 18990 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:01.620656 15788 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:01.664033 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:01.664901 15718 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:07:01.635486 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.665972 15790 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:01.666110 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:01.589524 19105 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.048s	sys 0.089s
W20260709 13:07:01.583977 19028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.564s	user 0.006s	sys 0.023s
I20260709 13:07:01.622619 19024 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.637624 19034 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:01.655154 19135 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:07:01.623397 18829 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.673349 15685 leader_election.cc:336] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.775s (SENT)
I20260709 13:07:01.575122 19104 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:01.667938 19129 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:07:01.683758 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.669891 19105 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.049s	sys 0.089s
I20260709 13:07:01.708811 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.709712 15794 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:01.675331 19028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.693s	user 0.006s	sys 0.023s
I20260709 13:07:01.674901 19131 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.674700 19042 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.717114 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:01.715853 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 194441us
I20260709 13:07:01.727499 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:01.728452 15760 leader_election.cc:336] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.646s (SENT)
I20260709 13:07:01.728463 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.728889 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:01.694103 18787 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.675086 18990 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:01.763264 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.662871 18943 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:01.772710 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.774602 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.775228 15790 raft_consensus.cc:2376] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:01.742501 19141 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:01.763562 19042 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:01.701709 18829 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:01.788125 15685 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.888s (SENT)
I20260709 13:07:01.796067 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:01.790845 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.729846 19131 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.797421 15790 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:07:01.801476 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.796788 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 67685us
W20260709 13:07:01.802474 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 227567us
I20260709 13:07:01.796083 19141 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:01.811988 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.813424 15714 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:01.812685 15790 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:01.799445 18993 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:01.799757 19042 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:01.770191 19010 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:01.818887 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:01.823474 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:01.825484 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 55959.8us
I20260709 13:07:01.828589 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.827669 16298 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:01.834120 19143 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:01.835193 19112 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.198s	user 0.003s	sys 0.010s
W20260709 13:07:01.836836 19075 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.598s	user 0.001s	sys 0.011s
I20260709 13:07:01.843307 16298 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:01.844851 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.845515 15790 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:07:01.845810 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.853787 15685 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.558s (SENT)
I20260709 13:07:01.854274 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:01.859120 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:01.860002 18993 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.864760 19148 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:01.867269 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.867903 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.868350 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.868566 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.872882 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.884836 15793 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:01.885345 15795 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:01.885815 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.889439 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:01.876848 19009 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.880650 18829 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:01.864362 18973 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:01.884712 15789 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:01.906018 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:01.906952 15789 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:01.887653 19024 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.884554 15796 raft_consensus.cc:2376] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6. Re-sending same reply.
I20260709 13:07:01.892052 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:01.892998 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:01.893514 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.894378 19131 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:01.852870 19134 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:01.894704 19138 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:01.887080 19144 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:01.897071 19146 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:01.899394 18929 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:01.884056 19150 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:01.829413 19010 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.902590 19152 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:01.905032 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.907552 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:01.912743 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69490.2us
I20260709 13:07:01.897543 19141 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:01.885331 19148 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.925760 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:01.915879 18973 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:01.928905 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.920326 18929 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:01.931258 18929 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.931951 18973 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:01.932425 18929 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:01.934015 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.934753 19124 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:07:01.929934 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:01.937096 19158 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:07:01.938019 19148 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:01.938614 19148 consensus_queue.cc:1243] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:01.939283 19131 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:01.939687 19131 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:01.940048 19131 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.924587 19150 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:01.938124 18950 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.941788 19150 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.941922 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.942695 15792 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:07:01.912544 19042 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:01.913399 18787 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:01.984161 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.984899 15685 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.052s (SENT)
I20260709 13:07:01.924238 18847 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.009914 18847 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.010355 18847 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.997526 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:01.910594 18751 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:01.922335 19146 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:02.015439 19045 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.007s
I20260709 13:07:02.016171 19146 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:02.015990 19045 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:01.927338 19152 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.016978 19152 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.021045 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.004313 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.005973 18787 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:02.022799 19034 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.023337 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2583) took 1520 ms. Trace:
I20260709 13:07:02.023465 18787 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.023718 15714 rpcz_store.cc:276] 0709 13:07:00.503286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.503462 (+   176us) service_pool.cc:224] Handling call
0709 13:07:02.023162 (+1519700us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540026bbd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:02.023277 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3008872192}
I20260709 13:07:02.025036 19034 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.023337 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2580) took 1565 ms. Trace:
I20260709 13:07:02.026185 15715 rpcz_store.cc:276] 0709 13:07:00.457701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.458078 (+   377us) service_pool.cc:224] Handling call
0709 13:07:02.023124 (+1565046us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540017a2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:02.023258 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864534400}
I20260709 13:07:01.917395 19139 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.007117 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:02.008116 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.000149 18973 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:02.000137 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 80291.9us
I20260709 13:07:01.959013 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:02.028010 15788 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:02.028360 15685 leader_election.cc:336] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.066s (SENT)
W20260709 13:07:02.025158 19084 consensus_meta.cc:287] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.059s	user 0.011s	sys 0.006s
I20260709 13:07:02.028867 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:02.001591 19125 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.034869 15794 raft_consensus.cc:2368] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:02.035683 15787 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:07:02.005501 18990 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.029448 18973 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:02.031246 18909 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:02.050617 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 143157us
I20260709 13:07:02.038684 19139 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:02.054092 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.054323 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.054793 15646 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.055456 19139 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.056260 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.056324 15642 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:02.057121 15638 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.058279 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.058866 15643 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:02.058037 19159 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:02.038352 19163 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.031029 18829 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:07:02.045198 19101 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:02.069886 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 154325us
I20260709 13:07:02.070150 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.044566 19084 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.075687 15647 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:02.086620 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.082372 15611 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:02.097791 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.104285 16334 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:02.106480 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.111112 16332 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:02.111577 19123 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.112444 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.112555 19123 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:02.113201 15647 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:02.113446 19123 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:02.114306 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.114423 19123 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.115463 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.115656 19123 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.116549 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.118057 19167 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.118497 19167 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.118830 19167 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.120129 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:02.120867 19152 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.121906 18636 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.042429 19125 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.131400 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.132493 15715 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:02.133180 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.122774 19045 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:02.122954 19161 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:02.125102 15646 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:02.117619 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.142916 15647 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:02.131033 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.137689 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:02.139544 15643 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:02.144896 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.149778 19111 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.150134 16332 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 6: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:02.150992 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.151669 16334 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:02.151903 18787 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.154418 15645 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.145227 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:02.147775 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.144642 19173 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.148092 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.157858 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.158500 16326 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:07:02.135990 18636 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.135540 19101 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:07:02.087975 18909 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:07:02.155201 19164 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:02.080634 19084 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.077792 19163 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:02.180331 19113 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.545s	user 0.009s	sys 0.016s
I20260709 13:07:02.181329 19163 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.191082 19167 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.196610 19084 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:02.197772 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.199239 19134 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.199733 19134 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.199990 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.200868 18993 raft_consensus.cc:2764] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:02.145051 18892 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:07:02.202052 18909 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:02.202286 18892 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.202672 18909 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.202826 18892 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.203357 19126 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:02.203763 19126 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:02.204545 19126 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.205005 18892 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.080394 18973 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.205964 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.206318 18973 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.206938 15793 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:02.177800 19138 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.172514 18636 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.210783 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.211616 15789 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:02.205055 18909 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.212586 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.213155 15713 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.181806 19157 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:02.213904 19157 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:02.172142 19173 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.214789 19157 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.215869 19157 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.215955 19173 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.218003 16331 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 5.
I20260709 13:07:02.182435 16334 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:02.148669 18847 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.185804 18787 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:02.188808 19009 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.190316 19125 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:02.191053 19010 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.201643 18993 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.221730 18993 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:02.222159 19126 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.222277 18993 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.224779 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.225508 15647 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.148048 19147 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:07:02.226279 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.227357 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.230096 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.231081 18993 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.233381 18993 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.234534 15646 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.235687 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.236534 16333 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:07:02.240080 15714 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:02.217556 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.241321 15713 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:02.242168 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.243412 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.243877 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:02.244418 15793 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:07:02.244707 16326 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:07:02.245935 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:02.251264 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.160579 19111 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.257788 15611 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:02.258129 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.259409 15718 pending_rounds.cc:85] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 7
I20260709 13:07:02.268607 15718 pending_rounds.cc:107] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:02.268934 15718 raft_consensus.cc:2889] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.269434 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.258785 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.270107 15793 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:02.270427 15714 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:02.261967 15646 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:02.261899 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.266741 16327 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:02.260730 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.271713 15721 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:02.271660 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:02.272984 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.271607 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.274127 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.275596 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.276605 15714 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:02.277563 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.277900 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.277562 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.278419 15790 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:02.281342 15717 raft_consensus.cc:2368] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7.
I20260709 13:07:02.278628 15793 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:02.281764 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.282859 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.283010 15793 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:02.292330 16334 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:02.294613 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.295513 15787 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:02.297505 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.301296 16298 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:02.301373 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.305845 16333 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.306782 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.308378 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.309478 15795 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:02.310379 16298 leader_election.cc:400] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7.
I20260709 13:07:02.310768 16298 leader_election.cc:403] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.222177 18847 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:02.312197 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:02.318158 16325 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.312239 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.314776 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.319902 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.321102 15646 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.272236 19134 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:02.318890 15796 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:02.322732 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:02.281060 19125 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.292709 19010 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.159315 19131 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.293830 18787 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:02.325109 15721 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:02.334657 15646 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.313367 18980 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.318464 19163 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.349483 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.324458 19009 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.347630 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.331154 19167 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:02.375151 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.353713 15796 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:02.380352 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.381073 15794 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:02.381611 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.305473 19118 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:07:02.345726 18980 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.352341 19163 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.328975 18892 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:02.338140 19125 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.356652 18787 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:02.396232 15646 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.341048 19010 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.348665 19123 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:02.403515 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:02.449193 15796 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.388139 19174 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.392136 18980 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.432279 19044 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.431368 15641 raft_consensus.cc:2955] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:02.434230 19152 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:02.349442 19172 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:02.395208 19163 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.438791 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.438980 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.473516 15717 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.404676 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.467417 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.474336 15722 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.477401 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.478744 15638 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.462582 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "000b7a022df94c229b7580329401d5f2"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:02.483513 15643 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.483481 15646 raft_consensus.cc:606] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:02.484090 15646 raft_consensus.cc:614] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:02.468432 19151 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:07:02.485293 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 80692.9us
I20260709 13:07:02.436866 18993 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:02.487891 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.490429 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.462834 19131 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.498567 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.499392 15645 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.492507 15722 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
W20260709 13:07:02.494400 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.501950 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:02.503538 15787 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:02.506111 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.506150 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.511539 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.516978 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.518496 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.519589 15639 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.521660 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.520550 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.496693 19079 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.523187 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.533344 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.544286 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.545151 15642 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:02.496956 18993 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:02.549319 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.525374 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.553331 15722 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:02.509200 19131 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:02.554132 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.555241 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.576043 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.529404 19111 raft_consensus.cc:2764] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:02.590327 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.587880 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.534890 18677 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:02.592689 16325 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:02.593832 15645 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:02.596932 15646 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:02.548314 19079 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:02.515388 18787 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:02.626762 19181 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:07:02.629556 18929 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.001s
W20260709 13:07:02.630609 19178 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:02.619068 19079 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.632309 19182 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:02.592166 18677 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:02.634300 18677 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.635068 18636 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.636277 15647 raft_consensus.cc:2368] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:02.628734 18993 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.575178 19105 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:02.589823 19171 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:07:02.543740 19101 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:07:02.654420 19188 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:02.658682 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.668285 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.659617 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:02.670877 15721 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:02.672652 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.672778 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:02.674891 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.589025 19131 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:02.675993 15717 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
W20260709 13:07:02.647344 19024 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.003s
W20260709 13:07:02.678777 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 127223us
I20260709 13:07:02.669432 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:02.683575 15719 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:02.684322 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.683611 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:02.677922 18636 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:02.666661 19150 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.007s
I20260709 13:07:02.657841 19105 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:02.739738 19105 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.689038 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.682222 19125 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.743010 18989 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:02.742929 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54003.9us
I20260709 13:07:02.677781 19010 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.685945 19024 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.694793 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.744612 15640 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:02.745697 15645 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:07:02.746318 15645 pending_rounds.cc:85] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:02.746723 15645 pending_rounds.cc:107] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:07:02.747056 15645 raft_consensus.cc:2889] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.748805 15645 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [6.4-9.5]
I20260709 13:07:02.687069 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.682420 18980 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.700237 18677 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.690294 19128 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.751048 19128 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.752292 18677 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.752620 18980 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.753216 19128 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:02.693114 19134 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.701673 19043 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.677807 19045 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:07:02.700295 19163 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.757817 19079 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:02.759045 19163 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:02.759902 19079 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:02.703588 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.794037 15645 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:02.794178 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.795159 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.795372 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.705672 16298 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:02.796553 15645 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:02.796633 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 91070.4us
I20260709 13:07:02.797533 19163 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.798115 19163 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:02.799292 19181 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.109s	user 0.002s	sys 0.001s
I20260709 13:07:02.799021 19163 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.711890 19174 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.799391 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.800351 15720 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.716639 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.773586 19009 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7.
I20260709 13:07:02.677881 18993 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.807386 15721 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:02.808712 15721 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:02.810968 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.811589 15716 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.721864 19150 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.813880 15719 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:02.814311 15719 pending_rounds.cc:85] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 4
I20260709 13:07:02.814580 15719 pending_rounds.cc:107] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:02.814814 15719 raft_consensus.cc:2889] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.816074 16330 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:02.817591 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:02.728047 18973 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
W20260709 13:07:02.732988 19177 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:07:02.737017 19183 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:07:02.820436 15792 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:02.738114 19131 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:02.743641 18989 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:02.760015 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:02.761938 15791 raft_consensus.cc:2368] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 4. Current term is 6.
I20260709 13:07:02.765520 19167 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:02.767197 19190 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.147s	user 0.002s	sys 0.002s
W20260709 13:07:02.770080 19187 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.137s	user 0.003s	sys 0.002s
W20260709 13:07:02.771021 19157 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.002s
I20260709 13:07:02.775586 19128 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:02.775651 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:02.701958 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:02.779309 15796 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:07:02.784220 19189 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:02.787637 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.789801 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.792588 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.714123 18823 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:02.857175 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:02.919086 15719 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:07:02.858320 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.118883 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 424191us
W20260709 13:07:02.969187 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.857635 15638 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:03.118091 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 295612us
I20260709 13:07:03.120733 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:03.123239 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.822921 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:02.845381 15720 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:03.124253 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:03.124884 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:02.891784 15644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.012s	sys 0.035s
I20260709 13:07:03.125454 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:03.125970 15644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.033s	sys 0.051s
W20260709 13:07:03.126047 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.920749 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:03.126538 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:03.128643 15792 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 5: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:03.130385 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:02.853195 15716 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:03.133939 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 369) took 1081 ms. Trace:
I20260709 13:07:03.134688 15639 raft_consensus.cc:2410] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:03.123162 15788 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.130265 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.141865 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:03.142778 15790 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:03.138083 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:03.139483 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.145726 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:03.146027 15792 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.147272 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.130273 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:03.126556 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.152603 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:02.816017 19150 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:03.153575 15796 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:03.153604 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:03.157140 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:03.157599 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.160164 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:03.160830 15718 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:03.162441 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:03.162654 16297 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:03.159777 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.170557 15638 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:03.098098 18973 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.178081 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:03.178735 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.179755 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:03.179389 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:03.181080 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:03.183094 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.188472 16330 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:03.122483 18989 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.124681 19167 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:03.128041 18909 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:03.195806 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.131572 19101 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:03.164805 18678 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:07:03.194255 19010 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.194706 18973 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.137858 19043 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:03.128249 19028 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.198334 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.198585 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:03.199668 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.201493 15792 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:02.913829 19138 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.278s
I20260709 13:07:02.863377 19063 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.313s
I20260709 13:07:03.130401 18823 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:03.206872 16329 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:03.262559 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.250725 15788 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:03.225601 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:03.275719 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 418185us
W20260709 13:07:03.263309 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65061us
I20260709 13:07:03.263772 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:03.193840 18950 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.278141 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.195745 18980 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.265447 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.284260 15790 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:03.267897 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.284610 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 52463.7us
I20260709 13:07:03.267596 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.285279 15646 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:03.286454 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.287400 15646 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:03.128189 19086 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:03.267097 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.272419 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.195995 18909 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:03.051403 19105 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:03.184886 19174 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.165514 19044 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:03.134869 15644 rpcz_store.cc:276] 0709 13:07:02.052635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.052759 (+   124us) service_pool.cc:224] Handling call
0709 13:07:02.053056 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.053244 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:02.142349 (+ 89105us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.133480 (+991131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.133550 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:03.133612 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.133708 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.133876 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5603,"prepare.queue_time_us":121388,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":5715,"thread_start_us":1055750,"threads_started":2}
I20260709 13:07:03.280730 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.177476 19128 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:07:03.306183 15787 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.264135 15796 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.305655 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:03.308426 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.177271 19173 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.176753 19045 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.196717 19079 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.288203 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.328444 15638 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:03.136117 18829 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:07:03.289331 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.331413 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.290354 15792 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:03.231676 19010 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:03.295612 15714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.015s	sys 0.022s
W20260709 13:07:03.334898 15714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.016s	sys 0.022s
I20260709 13:07:03.261606 19043 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:03.296474 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.295758 15788 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:03.337808 15787 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:03.340394 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.295725 18892 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:07:03.279585 19028 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:03.303306 19191 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:07:03.264637 19101 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.324062 19173 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:03.309033 15644 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:03.353678 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:03.300182 18778 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.310287 19174 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:03.295661 18909 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.311486 19163 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.338465 19079 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:03.313159 19105 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:03.314724 15790 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:07:03.319963 15716 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:03.372932 15716 pending_rounds.cc:85] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 4
I20260709 13:07:03.373191 15716 pending_rounds.cc:107] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:03.373427 15716 raft_consensus.cc:2889] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.321022 15722 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:03.322379 15718 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:03.334728 15796 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:03.274101 19033 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:03.315083 18943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.028s
W20260709 13:07:03.309796 18993 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 13:07:03.324062 19063 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:03.299635 19134 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.299782 18980 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:03.301951 15543 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.306778 18950 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:03.271894 19193 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.341478 15640 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:03.351119 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.394253 15792 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.351150 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.354740 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.358157 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.396299 15644 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:03.396450 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.396791 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:03.397142 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.337796 19010 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.401611 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:03.387264 18943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.012s	sys 0.028s
I20260709 13:07:03.344334 19043 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:03.366046 15541 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 273) took 23405 ms (client timeout 15000 ms). Trace:
I20260709 13:07:03.312454 15795 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:03.338295 19045 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:03.353474 19101 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.417341 19045 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.356817 19173 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.351958 19086 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.388713 19163 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:03.298189 19167 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:03.426858 19163 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.427693 19167 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.388091 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:03.364106 18778 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.397549 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.397787 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.359995 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.404423 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.431744 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:03.405133 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:03.382651 19128 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:03.404246 15543 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 3, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:03.434269 15644 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:03.439134 15638 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:03.439618 15639 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [5.2-7.3]
I20260709 13:07:03.441234 15643 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:03.441844 15643 pending_rounds.cc:85] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:03.442309 15643 pending_rounds.cc:107] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:03.442728 15643 raft_consensus.cc:2889] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.385488 18636 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:03.451095 15543 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.392463 19139 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:03.448552 19079 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:03.449589 15644 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:03.452484 15792 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:03.455483 15639 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:03.456389 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 96471.5us
I20260709 13:07:03.463759 15643 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:03.464533 18993 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:03.468429 18993 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.470053 19194 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:03.470691 19194 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:03.472210 19194 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:03.476130 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:03.409767 15541 rpcz_store.cc:269] 0709 13:06:39.960944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.961133 (+   189us) service_pool.cc:224] Handling call
0709 13:07:03.365974 (+23404841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:59.273007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:59.273822 (+   815us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:59.273884 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:06:59.273907 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:59.275814 (+  1907us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:59.275910 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:59.275944 (+    34us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:06:59.277698 (+  1754us) tablet.cc:701] Row locks acquired
0709 13:06:59.305414 (+ 27716us) write_op.cc:260] PREPARE: finished
0709 13:06:59.331441 (+ 26027us) write_op.cc:270] Start()
0709 13:06:59.345314 (+ 13873us) write_op.cc:276] Timestamp: P: 1783602419324604 usec, L: 0
0709 13:06:59.345344 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:06:59.371657 (+ 26313us) log.cc:844] Serialized 7795 byte log entry
0709 13:06:59.881768 (+510111us) op_driver.cc:464] REPLICATION: finished
0709 13:07:00.247490 (+365722us) write_op.cc:301] APPLY: starting
0709 13:07:00.258110 (+ 10620us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:00.278521 (+ 20411us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:00.278711 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:00.402917 (+124206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:00.403361 (+   444us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:07:00.403412 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:00.403930 (+   518us) log.cc:844] Serialized 139 byte log entry
0709 13:07:00.404152 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.404353 (+   201us) write_op.cc:454] Released schema lock
0709 13:07:00.404435 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:00.404867 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.404899 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":777285,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":324011,"apply.run_cpu_time_us":7341,"apply.run_wall_time_us":179074,"num_ops":20,"prepare.queue_time_us":397573,"prepare.run_cpu_time_us":19622,"prepare.run_wall_time_us":158678,"raft.queue_time_us":386686,"raft.run_cpu_time_us":16698,"raft.run_wall_time_us":191595,"replication_time_us":536234,"thread_start_us":666127,"threads_started":4,"wal-append.queue_time_us":79660,"wal-append.run_cpu_time_us":75140,"wal-append.run_wall_time_us":1959870}]]}
I20260709 13:07:03.394697 19157 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:03.483541 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:03.399614 19063 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.401839 19193 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:03.485394 18973 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:03.485656 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 221987us
W20260709 13:07:03.484284 19191 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:03.500741 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:03.479290 19105 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:03.513216 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:03.515779 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.494277 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.497272 15790 raft_consensus.cc:606] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:03.516765 15790 raft_consensus.cc:614] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:03.516592 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 226565us
I20260709 13:07:03.508958 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:03.517572 16334 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:03.525038 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.527369 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:03.501160 18892 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:03.535485 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.536669 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:03.530407 15543 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 3 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 4 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.540062 15543 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:03.548447 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:03.550244 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 497) took 1292 ms. Trace:
I20260709 13:07:03.557472 15719 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:03.522930 19197 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:07:03.561425 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.550812 15713 rpcz_store.cc:276] 0709 13:07:02.258046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.258218 (+   172us) service_pool.cc:224] Handling call
0709 13:07:02.258504 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.267401 (+  8897us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:02.493149 (+225748us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.762610 (+269461us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:02.851546 (+ 88936us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.852161 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.852330 (+   169us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:02.852649 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.852854 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.852948 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.449592 (+596644us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b1800393760. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:03.549949 (+100357us) raft_consensus.cc:1685] finished
0709 13:07:03.549981 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.550150 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50697,"prepare.queue_time_us":241370,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":8600,"raft.queue_time_us":90024,"raft.run_cpu_time_us":5312,"raft.run_wall_time_us":495982,"spinlock_wait_cycles":25031808,"thread_start_us":536173,"threads_started":3,"wal-append.queue_time_us":467737}
I20260709 13:07:03.453716 19174 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.557091 18636 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:03.561321 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 229941us
I20260709 13:07:03.533295 19009 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.534772 18892 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:03.532833 19201 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.580212 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.576299 15543 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 6, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 6 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:03.563014 19105 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.557394 19134 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.584188 16327 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:03.499432 18980 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.561100 18973 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:03.533270 19150 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:03.571148 18636 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:03.596386 15543 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 8, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.499584 18950 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:03.588635 18892 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.597713 19086 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.596939 19134 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.597378 19204 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:03.624879 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44732.7us
I20260709 13:07:03.625836 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1567) took 1363 ms. Trace:
I20260709 13:07:03.627775 15790 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:03.627969 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:03.626942 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.627669 15714 rpcz_store.cc:276] 0709 13:07:02.262238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.283093 (+ 20855us) service_pool.cc:224] Handling call
0709 13:07:02.283377 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.283698 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.283724 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.718763 (+435039us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b2c000108d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:02.719298 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.335291 (+615993us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:03.335329 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.335386 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.613503 (+278117us) raft_consensus.cc:1685] finished
0709 13:07:03.613527 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.625763 (+ 12236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1215,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":17696,"spinlock_wait_cycles":21326080,"thread_start_us":615534,"threads_started":1,"wal-append.queue_time_us":672198}
I20260709 13:07:03.631665 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.630330 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:03.637279 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 77580.6us
I20260709 13:07:03.644460 19223 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.652576 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:03.647746 19101 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:03.676124 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.629587 19204 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.625399 19134 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:03.683616 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.678582 15543 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.605371 18973 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:03.680694 19199 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:07:03.622455 19201 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:03.624083 18909 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:03.750252 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.702340 19198 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:07:03.682051 19150 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.698488 19138 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:03.698168 18778 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:03.728643 19183 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:03.699326 19204 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.708442 19139 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:03.649034 19173 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:03.765784 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.756850 19163 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.757836 19206 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.765544 19138 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.771950 18787 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.879498 15792 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:03.767128 19063 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:03.770515 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 116564us
I20260709 13:07:03.769761 15543 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:07:03.774556 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 142954us
W20260709 13:07:03.925335 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.926162 15543 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 4 to 7, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 7 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.702996 18636 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.871119 19205 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.768330 19150 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.888898 19138 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.929385 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.953682 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.955056 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:03.956272 15762 leader_election.cc:400] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:03.956497 15762 leader_election.cc:403] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:07:03.948477 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.940078 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:03.964941 19210 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:07:03.966883 19228 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.981092 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:03.876380 19163 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.994841 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:03.870772 18787 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:03.964970 19101 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:03.985769 19213 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.030331 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:04.032212 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.033985 15642 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.034682 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2013) took 1120 ms. Trace:
I20260709 13:07:04.035084 15642 rpcz_store.cc:276] 0709 13:07:02.914549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.966638 (+ 52089us) service_pool.cc:224] Handling call
0709 13:07:04.033548 (+1066910us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:04.033782 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.034424 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.034624 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471296}
I20260709 13:07:04.035820 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:03.952816 19205 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.037437 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:03.997785 19209 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.988150 19086 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:07:04.025171 19217 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
W20260709 13:07:04.075927 15795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.011s
I20260709 13:07:04.033149 19206 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.084735 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:04.078639 15795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.004s	sys 0.011s
I20260709 13:07:04.008723 19225 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.091564 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1711) took 1194 ms. Trace:
W20260709 13:07:04.091740 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 135579us
I20260709 13:07:04.092522 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.007479 19214 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.036680 19063 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.088587 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2362) took 1296 ms. Trace:
I20260709 13:07:04.040761 19215 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.092026 15647 rpcz_store.cc:276] 0709 13:07:02.897478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.897692 (+   214us) service_pool.cc:224] Handling call
0709 13:07:04.084545 (+1186853us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:04.091499 (+  6954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5139712}
I20260709 13:07:04.024093 19227 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.984344 19228 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.038226 19139 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.074034 19079 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.099303 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 55323.9us
I20260709 13:07:04.101900 15795 rpcz_store.cc:276] 0709 13:07:02.792527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.430810 (+638283us) service_pool.cc:224] Handling call
0709 13:07:03.459882 (+ 29072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.460097 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:03.567393 (+107296us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.088237 (+520844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.088289 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.088330 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.088398 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.088531 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178621,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":597443,"threads_started":2}
W20260709 13:07:04.108415 19043 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.004s
I20260709 13:07:04.036487 19157 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:07:04.113011 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:04.102862 19212 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:07:04.075527 19231 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:04.099781 18973 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.104017 19101 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:04.126353 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.125268 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.162164 15645 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:04.164152 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.099293 19230 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.166711 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.167893 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:04.167893 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2012) took 1275 ms. Trace:
I20260709 13:07:04.169596 15645 rpcz_store.cc:276] 0709 13:07:02.892374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.892524 (+   150us) service_pool.cc:224] Handling call
0709 13:07:04.126188 (+1233664us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:04.167828 (+ 41640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5674752}
I20260709 13:07:04.113512 18909 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.174221 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.172899 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.130144 19225 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:04.121517 19079 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.174301 19239 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:04.183071 19228 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.182855 19239 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.169082 19213 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:07:04.188477 19219 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:07:04.196532 19150 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:04.123840 19206 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:04.198733 19241 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:04.201645 18787 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:04.205256 19167 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 13:07:04.206815 19163 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.210490 19194 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.216804 19024 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.217368 19024 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:04.179481 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:04.284847 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.289582 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.288772 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2014) took 1324 ms. Trace:
I20260709 13:07:04.177830 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:04.293398 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 115700us
I20260709 13:07:04.296290 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.298029 15641 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:04.179774 19215 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.171039 19229 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:04.290324 15640 rpcz_store.cc:276] 0709 13:07:02.964211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.445430 (+481219us) service_pool.cc:224] Handling call
0709 13:07:03.485699 (+ 40269us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:03.578542 (+ 92843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.578598 (+    56us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:03.592449 (+ 13851us) log.cc:844] Serialized 78 byte log entry
0709 13:07:03.729768 (+137319us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:03.729917 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.730066 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.218788 (+488722us) raft_consensus.cc:1685] finished
0709 13:07:04.218807 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.288693 (+ 69886us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24926,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":31495,"thread_start_us":185209,"threads_started":2,"wal-append.queue_time_us":485236}
W20260709 13:07:04.300496 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 121082us
I20260709 13:07:04.301695 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.181893 19079 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.302227 18787 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.308234 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.178387 19234 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:04.174465 19214 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:04.288587 19228 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.301962 19024 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.302646 19167 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.179647 19231 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.179695 19225 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:07:04.167971 19173 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:04.286119 18989 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.046s	user 0.012s	sys 0.001s
I20260709 13:07:04.174579 18973 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.174582 19101 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.306414 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.132458 19139 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:04.238081 19218 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:07:04.287084 19209 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:04.308756 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:07:04.290916 19033 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.900s	user 0.009s	sys 0.004s
I20260709 13:07:04.310442 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.180130 18950 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.312891 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.181160 19205 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.315377 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.121361 19043 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:04.306448 19195 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.925s	user 0.003s	sys 0.000s
I20260709 13:07:04.318827 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.299664 19239 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.300194 18909 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:04.314571 19223 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 13:07:04.307665 19215 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.316275 19079 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:04.313138 19214 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.174183 19063 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:07:04.331557 18989 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.324235 19228 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.337992 19033 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.435652 19215 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.360116 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2365) took 1566 ms. Trace:
I20260709 13:07:04.436244 15638 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:04.436946 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2017) took 1396 ms. Trace:
I20260709 13:07:04.329207 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:04.437594 19223 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.330750 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.438467 18909 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.439507 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.440703 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.440912 18909 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.441280 15643 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:04.344292 19010 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.914s	user 0.011s	sys 0.003s
I20260709 13:07:04.442255 19010 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.442487 19079 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.443773 16329 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:04.444890 19079 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.395747 19143 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:04.445812 19143 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:04.446910 19010 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.446723 19143 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.447351 18823 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.448194 19143 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.448554 18823 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.449947 15795 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.451426 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2136) took 1276 ms. Trace:
I20260709 13:07:04.451805 15795 rpcz_store.cc:276] 0709 13:07:03.175242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.114421 (+939179us) service_pool.cc:224] Handling call
0709 13:07:04.126835 (+ 12414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.450423 (+323588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.451178 (+   755us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400138dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:04.451368 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742608128}
I20260709 13:07:04.332113 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:04.333973 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:04.322992 19131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.007s	sys 0.036s
I20260709 13:07:04.337173 15642 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.322314 19167 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:04.342229 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.343019 19246 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.343247 19233 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.343621 18892 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.002s
I20260709 13:07:04.330147 19024 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.425948 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2135) took 1251 ms. Trace:
I20260709 13:07:04.437541 15638 rpcz_store.cc:276] 0709 13:07:03.040621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.439945 (+399324us) service_pool.cc:224] Handling call
0709 13:07:03.482359 (+ 42414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.435971 (+953612us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b5400408e20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad254081c0 00007fad25409231 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c
0709 13:07:04.436674 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.436890 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18916224}
I20260709 13:07:04.397861 19044 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.345958 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.453646 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2374) took 1105 ms. Trace:
W20260709 13:07:04.378605 15791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2078) took 2983 ms (client timeout 2168 ms). Trace:
W20260709 13:07:04.487553 15791 rpcz_store.cc:269] 0709 13:07:01.395306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.396061 (+   755us) service_pool.cc:224] Handling call
0709 13:07:04.378363 (+2982302us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:04.378517 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3124602624}
I20260709 13:07:04.488754 15795 rpcz_store.cc:276] 0709 13:07:03.348140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.452736 (+1104596us) service_pool.cc:224] Handling call
0709 13:07:04.453082 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.453293 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.453319 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.453365 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:04.453398 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.453458 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.453575 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.436510 15788 rpcz_store.cc:276] 0709 13:07:02.793286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.477868 (+684582us) service_pool.cc:224] Handling call
0709 13:07:03.478275 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.478773 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.478818 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.491738 (+ 12920us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.585409 (+ 93671us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.775684 (+190275us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.775886 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.775961 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.359870 (+583909us) raft_consensus.cc:1685] finished
0709 13:07:04.359892 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.360053 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101411,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":172221,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":15898,"thread_start_us":248315,"threads_started":2,"wal-append.queue_time_us":215046}
I20260709 13:07:04.466301 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2022) took 1312 ms. Trace:
I20260709 13:07:04.489981 15641 rpcz_store.cc:276] 0709 13:07:03.154377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.159424 (+  5047us) service_pool.cc:224] Handling call
0709 13:07:04.466065 (+1306641us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000e74d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:04.466223 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351871232}
I20260709 13:07:04.490705 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:04.491106 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:04.371759 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.396922 15789 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:04.390838 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.391270 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56118 (request call id 87) took 1091 ms. Trace:
W20260709 13:07:04.329101 16300 leader_election.cc:336] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.163s (SENT)
I20260709 13:07:04.493326 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.347793 15645 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10. Re-sending same reply.
W20260709 13:07:04.494305 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 165220us
I20260709 13:07:04.395324 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 457) took 1591 ms. Trace:
I20260709 13:07:04.491953 15641 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:04.496994 15714 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.498127 15718 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:04.498122 15787 rpcz_store.cc:276] 0709 13:07:03.300220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.373519 (+1073299us) service_pool.cc:224] Handling call
0709 13:07:04.391185 (+ 17666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.497008 15790 rpcz_store.cc:276] 0709 13:07:02.803834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.646217 (+842383us) service_pool.cc:224] Handling call
0709 13:07:03.646526 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.754140 (+107614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.754185 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.754238 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.754280 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.395068 (+640788us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001383d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:04.395115 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.395261 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246894464}
I20260709 13:07:04.504217 15719 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:04.505770 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:04.476922 15792 rpcz_store.cc:276] 0709 13:07:03.174932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.880687 (+705755us) service_pool.cc:224] Handling call
0709 13:07:03.881098 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.014001 (+132903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.014050 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.026649 (+ 12599us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.123670 (+ 97021us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.218018 (+ 94348us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.218335 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.218439 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.423512 (+205073us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b18003e9c20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:04.425607 (+  2095us) raft_consensus.cc:1685] finished
0709 13:07:04.425719 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.425883 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29944,"prepare.queue_time_us":96017,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2279,"raft.queue_time_us":139113,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":36476,"spinlock_wait_cycles":22984832,"thread_start_us":215363,"threads_started":2,"wal-append.queue_time_us":271107}
I20260709 13:07:04.493078 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2370) took 1179 ms. Trace:
I20260709 13:07:04.512475 15789 rpcz_store.cc:276] 0709 13:07:03.314138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.396165 (+1082027us) service_pool.cc:224] Handling call
0709 13:07:04.396504 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.492721 (+ 96217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.493004 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.514662 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:04.515708 16330 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
W20260709 13:07:04.426987 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:07:04.521222 15529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 94294.3us
I20260709 13:07:04.524577 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.526553 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.529168 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.530967 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.535562 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:04.538154 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.539064 15792 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 4.
I20260709 13:07:04.541471 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:04.542572 15792 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.548870 15713 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.549228 15718 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.550688 15720 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.553401 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:07:04.459750 19192 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.343s	user 0.003s	sys 0.002s
W20260709 13:07:04.476114 19131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.008s	sys 0.048s
I20260709 13:07:04.560464 16329 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:07:04.429489 19221 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 13:07:04.554210 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 212028us
I20260709 13:07:04.575732 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:04.354370 19235 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:07:04.362319 19204 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.003s
W20260709 13:07:04.406577 19134 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.001s
I20260709 13:07:04.557900 15796 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.583777 15643 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:04.558992 16330 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:04.551227 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:04.553699 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 63087.9us
I20260709 13:07:04.430394 19028 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.587117 16331 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:04.487169 19044 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:04.338479 18973 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.570294 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.571921 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:04.511564 19125 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.572748 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.589368 16325 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:04.405676 19118 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:04.578653 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.487363 19214 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.511765 19079 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:04.362867 19043 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.486737 19167 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.368613 19101 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.552867 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.580452 15792 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:04.463395 19234 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.585638 19223 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.512718 19009 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:04.578003 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 72388.4us
I20260709 13:07:04.589397 16326 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:04.590305 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.642575 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.433070 19213 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:04.401005 19193 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.592530 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:04.487960 19172 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.652813 16332 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:04.511471 19233 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.597376 19128 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.620733 19206 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:04.649165 19221 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:04.557475 19034 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.607672 15790 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:04.577812 18980 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.619186 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:04.593358 19134 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.635756 15638 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:04.511320 18892 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.585407 18993 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.612994 19079 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.633396 19234 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:04.588469 19225 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:04.645795 15643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:04.645749 15645 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:04.651371 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.593533 16327 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.554425 18909 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:04.592762 19033 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:04.366681 19139 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.596524 19227 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.657311 19172 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.662079 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2130) took 2272 ms. Trace:
I20260709 13:07:04.663561 16334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 678) took 1144 ms. Trace:
I20260709 13:07:04.594691 19236 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:04.594839 19118 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:04.597659 19063 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:04.739450 19215 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.381016 19138 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.739810 19236 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.741246 19236 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.739451 15794 rpcz_store.cc:276] 0709 13:07:02.389611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.389783 (+   172us) service_pool.cc:224] Handling call
0709 13:07:02.400784 (+ 11001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.467255 (+ 66471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.467283 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.483203 (+ 15920us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.686648 (+203445us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:02.686690 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.686756 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.459000 (+1772244us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:04.648631 (+189631us) raft_consensus.cc:1685] finished
0709 13:07:04.648660 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.661963 (+ 13303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36098,"raft.queue_time_us":40623,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":17667,"spinlock_wait_cycles":7418496,"thread_start_us":180475,"threads_started":1,"wal-append.queue_time_us":496260}
I20260709 13:07:04.740444 19118 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.739634 16334 rpcz_store.cc:276] 0709 13:07:03.519101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.519227 (+   126us) service_pool.cc:224] Handling call
0709 13:07:03.550220 (+ 30993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.771181 (+220961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.771215 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.772167 (+   952us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.998572 (+226405us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:03.998632 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.998735 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.663257 (+664522us) raft_consensus.cc:1685] finished
0709 13:07:04.663289 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.663472 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55840,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":13621,"thread_start_us":297491,"threads_started":2,"wal-append.queue_time_us":278026}
I20260709 13:07:04.743667 19118 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.744031 19138 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:04.686018 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 110962us
I20260709 13:07:04.749358 19063 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.759902 18636 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.690398 15789 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:04.626699 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.695969 18980 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:04.762784 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 136196us
I20260709 13:07:04.764016 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.610888 19166 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:04.605788 19125 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.764822 19206 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.765184 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.764752 19234 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.765722 19206 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.764040 18980 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.766374 19234 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.767379 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.767843 19206 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:04.768241 19238 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:04.768257 19206 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.768788 19238 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:04.694249 19044 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.769219 19157 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:07:04.770088 19044 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.768790 19206 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.593761 19204 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.771159 16329 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:04.772274 19204 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.637895 15642 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:04.772869 18989 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:04.656394 19101 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.711215 19193 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.678982 19128 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.774857 15638 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:04.776110 19128 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:04.778059 19134 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.778334 19166 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:04.778591 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.778796 19166 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:04.779745 19166 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.780894 19166 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:04.693559 19045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.021s	sys 0.035s
W20260709 13:07:04.705132 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53849.9us
W20260709 13:07:04.781905 19145 consensus_queue.cc:1175] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:04.784322 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:04.709503 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.709985 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 796) took 1987 ms. Trace:
I20260709 13:07:04.715211 18909 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.716051 19033 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:04.719151 19196 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.336s	user 0.000s	sys 0.010s
W20260709 13:07:04.724822 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.698112 18993 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.715226 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2369) took 1858 ms. Trace:
I20260709 13:07:04.769811 19238 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.799873 19138 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:04.781930 19227 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.787768 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:04.354997 19209 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.785989 16331 rpcz_store.cc:276] 0709 13:07:02.722758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.724068 (+  1310us) service_pool.cc:224] Handling call
0709 13:07:02.724482 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.593060 (+1868578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.709036 (+115976us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54007904d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:04.709912 (+   876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4283086592}
W20260709 13:07:04.840277 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 52601.5us
I20260709 13:07:04.841711 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:07:04.807300 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 232891us
I20260709 13:07:04.806938 15796 rpcz_store.cc:276] 0709 13:07:02.857226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.771677 (+914451us) service_pool.cc:224] Handling call
0709 13:07:03.771948 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.584183 (+812235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.714994 (+130811us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001f72d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:04.715161 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806939520}
I20260709 13:07:04.846644 15789 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:04.788456 19045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.367s	user 0.021s	sys 0.035s
I20260709 13:07:04.834522 19239 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.835847 19138 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:04.851281 15789 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.854430 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.778743 19134 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:07:04.711617 19225 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.666944 19213 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.861959 15790 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:04.862876 15793 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.838205 18993 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.851598 18677 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.877427 15787 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:04.849336 19205 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.849869 19215 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.803047 19063 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:07:04.880882 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:04.886180 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.886521 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.899209 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:04.899269 15646 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:04.900323 16297 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:04.914628 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.904523 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:04.920889 15788 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.905539 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:04.924717 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.928047 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:04.939090 15795 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.929191 15641 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:04.887302 19233 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:04.886719 19194 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.002s
I20260709 13:07:04.933673 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.934669 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:04.942445 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.942468 15790 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:04.869524 19206 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:04.945760 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.904028 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:04.914739 19201 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.902114 18823 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:04.926896 19202 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:04.913990 18677 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:04.865662 19239 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.986816 19202 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:04.987725 19249 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:04.987849 19202 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.989051 19239 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.952493 18980 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:04.993523 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2347) took 2204 ms. Trace:
I20260709 13:07:04.939222 15789 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:04.950388 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:04.947631 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.955595 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.961900 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:04.944223 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:04.996906 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 52784.8us
I20260709 13:07:04.996970 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.998121 15787 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:04.993961 15793 rpcz_store.cc:276] 0709 13:07:02.788671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.273104 (+484433us) service_pool.cc:224] Handling call
0709 13:07:03.273515 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.871841 (+1598326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.993271 (+121430us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400152f54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:04.993453 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3654512384}
I20260709 13:07:04.998849 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:04.999432 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.000216 15793 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:04.965818 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 461) took 1458 ms. Trace:
I20260709 13:07:05.001482 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.927940 19215 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:05.001102 15791 rpcz_store.cc:276] 0709 13:07:03.507745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.488642 (+980897us) service_pool.cc:224] Handling call
0709 13:07:04.582377 (+ 93735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.582639 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:04.602412 (+ 19773us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.946399 (+343987us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.964372 (+ 17973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.964430 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:04.965552 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.965621 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.965761 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20734,"prepare.queue_time_us":21711,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4785,"raft.queue_time_us":18588,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16175,"spinlock_wait_cycles":54264064,"thread_start_us":342468,"threads_started":1}
I20260709 13:07:04.940986 19205 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:05.009925 19128 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.009994 19205 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.012467 19205 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.948707 19256 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.013833 19204 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:05.013550 19256 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.014400 19204 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:05.015250 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:04.975649 19254 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:05.015955 15789 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:04.976347 19033 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:05.016903 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:04.935758 18943 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:07:05.018258 19079 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:04.981406 19213 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.018782 19167 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.931624 18678 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:04.985643 18823 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.020961 15647 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:07:05.022074 19172 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:05.022668 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:05.023345 19167 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:05.028914 19258 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:05.017612 15789 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:05.030679 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.031318 15789 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:05.032588 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.033293 15789 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:05.034041 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.034406 19228 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:05.034631 15789 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 4.
I20260709 13:07:05.035895 18892 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:05.036795 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.038102 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.039271 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.039894 15792 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:05.042135 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.042781 15791 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:04.986264 19143 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.004s
I20260709 13:07:04.988382 19249 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:04.955631 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:05.002545 15793 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:04.989598 19239 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.968770 15788 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:05.005046 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:04.999462 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.009150 15640 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:07:05.010715 19128 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.059010 15787 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:05.015362 19204 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:04.948519 19201 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.019819 19125 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:04.982977 19225 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:04.985131 19206 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:05.023455 15647 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:05.057355 15794 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:05.060251 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:05.088485 15791 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:05.094065 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.095420 15787 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:04.935285 19138 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.104761 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.105633 15789 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:05.114617 15641 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:05.056756 18909 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:05.115762 15644 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:05.116272 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 230377us
I20260709 13:07:05.077968 19201 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.075510 19128 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.063728 15795 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:05.100152 19193 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:05.123798 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 280890us
I20260709 13:07:05.057039 19214 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:05.125658 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 166873us
I20260709 13:07:05.127393 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:05.134268 16331 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:05.133389 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:05.075688 19239 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.140823 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:05.073639 18993 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.146221 16329 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:05.141462 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 88965.2us
I20260709 13:07:05.155061 18993 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.156358 15647 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:05.156217 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.120572 19269 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:05.134999 19138 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.161353 19043 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:05.146790 19172 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:05.177960 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:05.161590 19125 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.179291 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:05.179472 19125 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.180495 19125 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.182898 19214 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.123924 19249 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.184254 19249 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.185328 19043 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:05.185922 19266 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:05.186547 19266 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:05.187613 19266 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.188637 16329 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
W20260709 13:07:05.185921 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.189246 19236 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.214490 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:05.198335 19228 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:05.223639 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.199579 19043 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:05.172992 19269 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:05.241571 19268 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:05.249357 15644 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:05.212222 19101 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:05.260640 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:05.271938 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 379987us
W20260709 13:07:05.263221 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.264106 19239 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:05.267774 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53386.7us
I20260709 13:07:05.260553 19256 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.272739 15646 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:05.227437 19228 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:05.283545 15645 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.221530 18993 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:07:05.300700 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.307535 15688 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:05.309316 15645 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:05.310057 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 86468.2us
I20260709 13:07:05.312458 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:05.313557 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:05.318513 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.268427 19274 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.285611 19034 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.300256 19239 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.322333 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.327068 16329 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:05.323832 16334 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:05.297685 19202 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:05.319674 19167 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.297843 19205 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:05.334834 19167 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:05.335889 19194 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.333803 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 393) took 1019 ms. Trace:
I20260709 13:07:05.335816 19167 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:05.337988 19280 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:07:05.338500 19167 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.324793 18892 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:05.327913 19045 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:05.340132 19045 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:05.338759 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:05.341969 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 64655us
I20260709 13:07:05.342548 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.343410 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.344205 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.338462 19105 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.325906 19274 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.352212 19236 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:05.352885 19266 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:05.353034 19236 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.353348 19266 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.353840 19266 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.355588 19201 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.359140 19269 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.349893 19194 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:05.326731 19239 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.353418 19236 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.360427 19194 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.328014 19285 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:05.350224 19105 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:05.404269 19281 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:05.350121 18993 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.445663 19236 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.360882 19274 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.403339 19239 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:05.437036 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 138705us
I20260709 13:07:05.450656 19201 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:05.345811 19227 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:07:05.341362 19045 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.411237 19256 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.331938 19043 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.434073 19246 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.454205 19194 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.493687 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:05.537148 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2044) took 1201 ms. Trace:
I20260709 13:07:05.537971 15647 rpcz_store.cc:276] 0709 13:07:04.335651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.109964 (+774313us) service_pool.cc:224] Handling call
0709 13:07:05.110288 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.156801 (+ 46513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.536826 (+380025us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b540045f1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:05.537070 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105491712}
I20260709 13:07:05.330412 19202 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.512511 15645 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.514392 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:05.473415 19105 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:05.442696 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 140933us
I20260709 13:07:05.517802 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.518846 15643 raft_consensus.cc:606] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:05.475723 18993 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:05.521432 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 209079us
I20260709 13:07:05.514901 19118 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.562458 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.526059 15640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 387) took 1217 ms (client timeout 1550 ms). Trace:
W20260709 13:07:05.563234 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 219074us
W20260709 13:07:05.563428 15640 rpcz_store.cc:269] 0709 13:07:04.309137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.309251 (+   114us) service_pool.cc:224] Handling call
0709 13:07:05.525794 (+1216543us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54000e88d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:05.525989 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524633856}
I20260709 13:07:05.565143 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:05.566129 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:05.567505 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.568287 15720 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:05.530467 19228 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.531221 19086 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.543797 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50218.7us
I20260709 13:07:05.486635 19285 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:05.558740 15792 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.576442 15721 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:05.558380 15645 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:05.539820 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:05.569530 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.574155 15716 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:05.561869 19202 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.570094 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.583261 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:05.584429 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:05.585060 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:05.580862 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:05.585978 15647 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:05.587287 15714 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:05.588624 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.590832 15722 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:05.592087 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:05.593050 15720 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 5: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:05.594981 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:05.581596 15645 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.613013 15639 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:05.622550 15645 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.623585 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.624192 16329 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:05.622891 15639 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.595657 15721 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:05.562709 18993 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.615917 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.616204 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.626425 15720 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:05.618870 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.627521 15647 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:05.628280 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.628578 15647 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:07:05.629006 15788 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.616613 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:05.617537 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:05.619805 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61378.7us
I20260709 13:07:05.629410 15720 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.619690 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:05.630510 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:05.631634 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.560247 19225 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.620570 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:05.632723 15640 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:05.621237 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:05.621413 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.634013 15714 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:05.595364 19086 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.639101 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.523316 19256 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.650621 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.651747 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.658867 15792 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 5.
I20260709 13:07:05.620271 19267 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.542804 19246 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.687011 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:05.660724 15793 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:05.687930 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57670.3us
W20260709 13:07:05.626325 19259 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:05.661510 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.662640 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.575354 19118 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.660032 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:05.586503 19238 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.616393 18909 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:05.613142 19288 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.697531 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:05.650794 19287 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 13:07:05.626120 19269 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.637072 19228 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.693498 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.703059 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:05.701921 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.699883 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:05.701509 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.574710 18677 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.720970 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.667685 15788 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:05.725018 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:05.685752 19284 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:07:05.727769 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:05.728389 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.745271 15713 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:05.726145 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:05.745218 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43788.5us
I20260709 13:07:05.754395 16334 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 5: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:07:05.698478 19289 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
W20260709 13:07:05.706862 19283 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:07:05.702486 19286 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:07:05.703042 19297 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:07:05.760635 15638 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:07:05.737694 19249 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.553s	user 0.014s	sys 0.009s
W20260709 13:07:05.754976 19128 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.003s
I20260709 13:07:05.699184 19086 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:05.699170 19256 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:05.719776 19288 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:05.755360 19125 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.002s
I20260709 13:07:05.754380 18677 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.754595 18909 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:05.690414 19267 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.818943 18823 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.821125 19233 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:05.831378 19234 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:05.848135 19143 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.874023 18823 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.735958 19238 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.874552 18823 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:05.875739 18823 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.876679 19238 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:05.877411 18823 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.759699 19269 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.778865 19227 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:05.869359 19286 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:07:05.886703 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 127762us
I20260709 13:07:05.854303 18677 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.868963 19233 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:05.891851 19233 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:05.888412 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 257948us
I20260709 13:07:05.893278 19233 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:05.894372 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 304758us
I20260709 13:07:05.895398 15793 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:05.895756 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:05.894012 19086 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:05.856501 19288 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:05.900141 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 150431us
I20260709 13:07:05.857381 19125 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.864315 19009 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.903715 15714 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
W20260709 13:07:05.903661 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 178786us
I20260709 13:07:05.763588 19285 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.908309 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:05.917812 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:05.931351 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:05.851550 19128 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:05.938033 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:05.940640 15722 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:05.905884 19173 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.963667 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:05.930461 19293 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.968122 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.935155 19086 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.970829 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:05.936919 19143 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.934170 19238 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.936360 19234 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:05.975873 15789 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:05.986260 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:05.959797 19173 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.960186 19101 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.991698 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:05.993640 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:05.996315 15718 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:05.964857 19296 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.972430 19043 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.985828 19225 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.998162 19173 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.997774 19246 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.001547 19193 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.995035 19305 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.000685 19118 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:06.034643 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 124065us
I20260709 13:07:05.966706 18909 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:05.994459 19308 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:05.988090 19238 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.013419 19304 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:05.979298 19293 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.023744 19306 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:06.032882 18892 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:06.010660 19101 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:06.074630 19302 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:07:06.076174 19307 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:06.077988 19269 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:06.078858 19301 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:07:06.079928 19300 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:07:06.080529 19238 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.071516 19306 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.083465 19306 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.086206 19125 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.027024 18980 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:06.050518 19313 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.025290 19009 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:06.025178 19315 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:07:06.072144 19239 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.005s
I20260709 13:07:06.119287 19318 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:06.151110 19288 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.010011 19296 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:06.099157 19274 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.010s
I20260709 13:07:06.093506 18892 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:06.066702 19304 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:06.169800 19236 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.654s	user 0.018s	sys 0.001s
I20260709 13:07:06.164145 19267 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.149833 19239 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.181845 19239 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.104322 19313 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.166894 19274 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:06.187137 19266 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.005s
I20260709 13:07:06.201447 19266 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:06.186349 19312 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:07:06.205240 19266 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:06.194940 19194 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.000s
W20260709 13:07:06.195262 19202 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.006s
I20260709 13:07:06.206308 19194 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.195031 19296 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.195835 19293 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.184017 19236 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.193073 19304 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.209611 19194 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.202695 19274 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.210863 19236 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.197712 19313 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.210711 19288 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.258591 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45878 (request call id 21) took 1818 ms. Trace:
I20260709 13:07:06.264859 15643 rpcz_store.cc:276] 0709 13:07:04.431518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.645636 (+214118us) service_pool.cc:224] Handling call
0709 13:07:06.249107 (+1603471us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540019c154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25400853 00007fad2a3ce60a 00007fad239547d4 00007fad23954762 00007fad23954691 00007fad2395460c 00007fad239538c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:06.249424 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879611136}
I20260709 13:07:06.269415 15716 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:06.302119 19315 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:06.201879 19173 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.298573 19194 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.318729 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:06.318665 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.319614 19194 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.206817 19202 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:06.282398 16300 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.550s (SENT)
I20260709 13:07:06.316793 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:06.322896 16329 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:06.316916 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.324064 16326 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:06.186834 19128 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:05.336597 15642 rpcz_store.cc:276] 0709 13:07:04.314262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.773375 (+459113us) service_pool.cc:224] Handling call
0709 13:07:04.773682 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.773908 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:05.059099 (+285191us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.333347 (+274248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.333416 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:05.333480 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.333566 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.333708 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101385,"prepare.queue_time_us":9785,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"thread_start_us":457166,"threads_started":2,"wal-append.queue_time_us":272061}
W20260709 13:07:06.348135 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.326649 16331 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:06.344559 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1723) took 1535 ms. Trace:
I20260709 13:07:06.348088 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 396) took 2032 ms. Trace:
I20260709 13:07:06.341534 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:06.325676 16300 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.175s (SENT) [suppressed 47 similar messages]
I20260709 13:07:06.340973 19173 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.351073 19202 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.384750 15638 rpcz_store.cc:276] 0709 13:07:04.315187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.776606 (+461419us) service_pool.cc:224] Handling call
0709 13:07:05.534135 (+757529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.773988 (+239853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.288727 (+514739us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000e88d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:06.347677 (+ 58950us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54000e88d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:06.347915 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261147904}
I20260709 13:07:06.331564 19101 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.402460 15719 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:06.402115 18678 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:06.327160 19318 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.386965 19315 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.158449 19009 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.329119 18892 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.430385 19315 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.434711 19313 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.435561 19313 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.438926 19318 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.447049 18943 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:06.455605 19304 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.458689 19045 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.459755 19045 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.462347 19256 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.463011 19318 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.463312 19256 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.464360 19313 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.464960 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:06.466061 15716 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.426757 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:06.474462 15719 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:06.460214 19225 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.468434 15760 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:06.470464 19306 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.456858 19304 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.494920 19304 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.468094 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.402136 19288 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:06.500955 19280 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:07:06.501699 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2047) took 2165 ms. Trace:
I20260709 13:07:06.502275 15641 rpcz_store.cc:276] 0709 13:07:04.336389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.115835 (+779446us) service_pool.cc:224] Handling call
0709 13:07:05.119833 (+  3998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.438763 (+318930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.438808 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.439460 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.664602 (+225142us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:05.696395 (+ 31793us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.478818 (+782423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.501025 (+ 22207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.501134 (+   109us) raft_consensus.cc:1685] finished
0709 13:07:06.501160 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.501437 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":971280,"prepare.queue_time_us":33287,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":1066740,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":11867,"thread_start_us":258768,"threads_started":2,"wal-append.queue_time_us":328256}
I20260709 13:07:06.504035 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1728) took 1012 ms. Trace:
I20260709 13:07:06.510103 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:06.511291 15796 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.512727 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.513849 15643 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:06.514287 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.515364 15638 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:06.515966 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:06.504860 19225 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:06.424559 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 98949.3us
I20260709 13:07:06.529954 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1724) took 1040 ms. Trace:
W20260709 13:07:06.530179 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.530534 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.530447 15645 rpcz_store.cc:276] 0709 13:07:05.489520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.512095 (+ 22575us) service_pool.cc:224] Handling call
0709 13:07:05.512399 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.526381 (+1013982us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:06.529266 (+  2885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.529337 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.529400 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.529584 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.529778 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600620,"raft.queue_time_us":696009,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":58808,"threads_started":1}
I20260709 13:07:06.530019 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.540985 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.525045 19274 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.375612 15644 rpcz_store.cc:276] 0709 13:07:04.808622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.267949 (+459327us) service_pool.cc:224] Handling call
0709 13:07:05.268351 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.336532 (+ 68181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.336560 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.337061 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.598400 (+261339us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:05.638264 (+ 39864us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.343055 (+704791us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b18003135a0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:06.343644 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.343847 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.343947 (+   100us) raft_consensus.cc:1685] finished
0709 13:07:06.344067 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.344282 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120354,"prepare.queue_time_us":40007,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3020,"raft.queue_time_us":68332,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":17397504,"thread_start_us":260939,"threads_started":1,"wal-append.queue_time_us":368665}
I20260709 13:07:06.545804 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.554075 19306 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.558079 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:06.548218 15792 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:06.557402 19306 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.538262 19256 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.562906 15638 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:06.563233 18677 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.007s
I20260709 13:07:06.530217 19285 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.567070 15718 raft_consensus.cc:2410] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:06.539224 19304 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.504510 15639 rpcz_store.cc:276] 0709 13:07:05.491238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.627542 (+136304us) service_pool.cc:224] Handling call
0709 13:07:05.627845 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.687917 (+ 60072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.687962 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.702188 (+ 14226us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.879778 (+177590us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.884185 (+  4407us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.503445 (+619260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.503562 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.503628 (+    66us) raft_consensus.cc:1685] finished
0709 13:07:06.503645 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.503849 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1273826,"prepare.queue_time_us":4465,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":622907,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":6248,"thread_start_us":237442,"threads_started":2,"wal-append.queue_time_us":464041}
I20260709 13:07:06.571786 19045 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:06.578205 19213 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:06.579296 19245 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.575392 19313 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:06.564829 19288 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.585036 16329 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.585415 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:06.594084 15717 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:06.587781 19304 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:06.601684 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 806623us
I20260709 13:07:06.597245 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.602864 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.581729 15794 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:06.593210 15715 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:06.608217 15795 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:06.592077 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:06.609380 19304 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.609930 15795 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:06.612349 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56118 (request call id 88) took 1681 ms. Trace:
I20260709 13:07:06.612753 15787 rpcz_store.cc:276] 0709 13:07:04.931287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.096272 (+164985us) service_pool.cc:224] Handling call
0709 13:07:06.611846 (+1515574us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540c735 00007fad254049fa 00007fad2a3cc4c9 00007fad23948c54 00007fad23948be2 00007fad23948b11 00007fad23948a8c 00007fad23947d42 00007fad2374148c 00007fad237408c6
0709 13:07:06.612143 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997682432}
W20260709 13:07:06.590902 19331 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:06.623463 15718 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.587384 19225 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.630080 15719 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:06.618801 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 150678us
W20260709 13:07:06.618937 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:06.591728 19285 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.593989 19274 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.591459 19313 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:06.612138 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:06.633569 15716 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:06.641899 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.648283 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.657456 15796 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:06.631989 19304 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.580080 19245 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.577248 18677 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.643335 19313 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.664896 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:06.668047 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:06.665968 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:06.673791 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:06.677245 15638 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.671191 19304 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:06.677601 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63134us
W20260709 13:07:06.679420 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 84177.1us
I20260709 13:07:06.679780 19304 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.672940 15795 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:06.682188 19236 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.682662 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:06.683842 18636 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.684149 19157 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.684650 18636 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.684929 19157 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:06.688843 19288 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.691422 19245 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.694882 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:06.696434 15796 raft_consensus.cc:2410] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:06.707590 15717 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.682687 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.685570 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:06.725250 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.682674 19236 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.727440 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.727653 16332 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:06.705935 18892 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.743444 15794 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.745441 16331 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:06.733873 19236 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.750910 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:06.752569 19215 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.759479 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.744904 19238 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.753278 19335 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.760623 19238 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.761096 19335 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.761982 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.754987 18636 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.753363 19139 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:06.768415 15714 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.739642 19334 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.769208 19334 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.770640 19209 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:06.771530 19334 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.772125 19334 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:06.772962 19334 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:06.754108 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:06.773663 18636 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:06.774315 15795 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.774811 18677 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.774948 19274 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.775175 19209 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.775705 19209 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:06.775897 19105 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.200s	user 0.007s	sys 0.017s
I20260709 13:07:06.776376 19105 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.777521 15715 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:06.738109 19285 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.758451 19157 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.778508 19157 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.780205 19332 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:06.781147 19157 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.763281 19335 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.781841 19105 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.767974 19139 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:06.753974 15716 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:06.785138 19139 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:06.746555 15641 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:06.777073 19209 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.781625 18678 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.777661 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:06.793655 15796 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:06.794212 16329 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:06.797856 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:06.799861 19138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.036s	sys 0.042s
W20260709 13:07:06.800279 19138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.352s	user 0.036s	sys 0.043s
W20260709 13:07:06.801303 18823 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.912s	user 0.008s	sys 0.013s
I20260709 13:07:06.804138 15714 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:06.806849 15794 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:07:06.808183 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 126625us
I20260709 13:07:06.762981 19238 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.773322 19334 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:06.823305 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.793305 18678 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:06.825687 15638 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:06.830353 15716 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:06.831429 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.832331 15713 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:06.833184 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:06.834136 19209 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.833863 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:06.838570 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 153133us
I20260709 13:07:06.791141 18892 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:06.843626 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 136510us
W20260709 13:07:06.862013 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 113771us
I20260709 13:07:06.865309 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:06.852134 15714 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:06.866627 18993 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.077s	user 0.009s	sys 0.011s
I20260709 13:07:06.875331 19318 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:06.876323 19334 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:06.879316 19339 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.248s	user 0.002s	sys 0.000s
I20260709 13:07:06.882081 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.853847 19315 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.904070 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.867918 18823 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.910383 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.926394 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.929037 19334 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.930004 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.930703 15716 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:06.931501 19313 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.925992 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.870750 19225 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.934973 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.935519 16329 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:06.906972 19245 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:06.907749 18823 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.934441 15713 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:06.943631 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.944777 19245 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.888556 19304 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:06.946120 15795 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:06.947180 19245 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.907245 19315 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:06.952629 15714 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:06.958564 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:06.960397 15721 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:06.961604 19225 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.964633 19225 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:06.952343 19315 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:06.969241 19343 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:06.970163 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:06.971626 15787 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:06.906782 18993 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:06.932885 19318 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:06.948727 18823 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.974411 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:06.978379 15720 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:06.971120 19139 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.985433 19194 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:06.990391 19318 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.001001 15721 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:07.007313 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:07.009665 19045 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.010493 19045 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:07.009698 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:06.997529 19139 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.020104 19139 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.022406 18993 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.023422 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:07.015002 19256 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:07:07.011274 19045 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:07.025485 19298 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.022511 19139 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.026508 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:07.031467 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:07.032526 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.035699 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.034025 18993 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.040493 18993 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:07.040879 18993 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.041885 19236 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:07.045626 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43640.8us
I20260709 13:07:07.045511 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.038820 19256 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:07.047386 19238 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.050326 19045 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:07.058712 19045 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.059134 19045 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.047890 19236 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.054737 19256 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.054781 19238 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.069154 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.059150 19227 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.012462 18678 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.067493 19139 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.075769 19256 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.077826 19238 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.079468 19227 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.100025 19313 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:07.108178 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83422us
I20260709 13:07:07.075448 18823 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.104689 19227 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.101152 19296 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:07.107106 19139 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:07.113802 19298 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:07.134112 15791 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:07.122347 19138 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.127069 19213 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:07:07.142277 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:07.146631 19225 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.153450 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:07.154981 19285 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:07.155313 19139 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.119477 19296 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.156829 18892 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.121541 19313 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.172580 19313 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:07.163589 15714 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:07.164203 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.167650 19225 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:07.170178 19138 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.183640 19138 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.178444 19313 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.169024 19213 consensus_queue.cc:1243] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:07.157675 19318 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:07:07.205276 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 142852us
I20260709 13:07:07.227011 19296 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.211840 19298 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.236096 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.245813 19238 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.196782 19304 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.243849 19209 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.249493 19304 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.206319 19285 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:07.250903 19285 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:07.251243 19285 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:07.252192 19304 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.252103 19285 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.252972 19304 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.260133 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 106788us
I20260709 13:07:07.272778 18823 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.273689 19225 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.275657 18993 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.254690 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:07.197713 19138 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:07.233127 19227 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.253551 19285 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.299234 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:07.299935 16331 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.279739 19238 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.257108 19350 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.307165 15795 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.288923 18823 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.253615 19304 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.318256 18636 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.322484 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.318526 19338 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:07.323336 19225 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.318801 19213 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:07.323668 19338 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.324402 19213 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.318271 15791 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.322551 18993 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.326197 19201 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:07.326979 19338 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.327045 19213 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.308336 19138 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.328616 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:07.330482 19138 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.333956 15796 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.323338 18636 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.333972 18823 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.337146 18636 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.243801 19315 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.347915 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.284780 19209 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.359419 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.360404 15641 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:07.361625 18678 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.365922 19354 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:07.322340 19324 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:07:07.368024 19227 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.369081 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.369782 15796 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:07.370733 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.371309 15796 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:07.345762 18823 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.372154 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.376374 15793 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:07:07.388441 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.390319 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:07.391001 15722 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.393913 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.403264 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:07.352228 15720 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:07.403919 15714 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.406858 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.415196 19045 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.418203 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.418571 19045 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.418864 15794 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.421218 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.422260 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.422601 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.423424 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.423833 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.424492 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.425076 15789 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.424903 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:07.422286 19009 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:07.426852 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:07.427487 16332 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.428768 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.424986 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.432220 15794 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:07.434190 15792 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:07.440620 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.441361 15641 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.456292 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:07.454432 15760 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.467851 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:07.469519 16331 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:07.471705 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:07.472301 15713 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.472290 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.475683 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.476701 15639 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:07.478615 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.479429 15638 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:07:07.482621 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 131907us
I20260709 13:07:07.487236 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.489454 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.499532 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.410151 19202 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:07:07.500284 15644 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:07.468917 18823 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:07.502930 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:07.503441 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.516516 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.517287 15640 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:07.517391 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.518929 15788 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:07.519335 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.520181 15788 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:07.521368 15788 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:07.521580 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.522392 15716 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:07.525874 19323 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:07.526691 19323 consensus_queue.cc:1243] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:07.527488 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.529270 15790 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:07.512126 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.530397 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.532625 15792 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:07.531064 15643 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:07.536778 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:07.537261 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.537663 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:07.538695 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:07.539757 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 53923.6us
I20260709 13:07:07.541149 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:07.544445 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.536684 19139 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.546324 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.972s (SENT)
I20260709 13:07:07.547091 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:07.548622 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.559491 16332 raft_consensus.cc:2410] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:07.561075 15718 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.555671 15794 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:07.563634 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.564175 15714 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:07.534284 19304 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.546525 18892 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:07.543011 19357 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.562155 15719 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.569070 15790 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:07.569252 15716 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.569890 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.565379 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.550778 18823 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:07.578317 15722 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:07.579946 15717 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:07.583858 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.587448 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:07.590153 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 43944.5us
I20260709 13:07:07.551121 19256 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.566102 18943 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.601505 19209 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.591127 19354 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.602092 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.602564 19354 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:07.603048 15718 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:07.603626 19354 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.604920 19354 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.605979 19304 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.606633 19304 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.609083 19304 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.582306 19045 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.611400 19045 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:07.612329 19045 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.563251 19139 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.613956 15642 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:07.615384 19139 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.599716 19313 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.617887 19313 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.596350 19238 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.619961 19256 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.619881 19238 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.575896 18993 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:07:07.627856 18823 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.630054 18943 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.609371 15789 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:07.632751 18943 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.635179 19238 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.636080 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.637462 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.597158 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.638306 15715 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:07.684592 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.778446 15639 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:07.647758 15713 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
W20260709 13:07:07.756817 19369 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:07.776314 19304 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.780535 19304 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:07.781525 19304 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:07.782436 19363 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:07:07.776712 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 181858us
I20260709 13:07:07.582764 19357 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.787477 19238 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.788120 19238 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.789410 19357 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:07.585206 18892 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:07.706125 18993 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:07.719799 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:07.591377 19315 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:07.742978 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:07.790532 19238 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.791822 16329 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.649554 15641 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:07.705839 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:07.779543 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.637462 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.772825 15759 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:07.696363 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 104374us
I20260709 13:07:07.800428 15639 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:07.798066 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.801981 15714 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: [7.8-7.8]
I20260709 13:07:07.801883 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.808939 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:07.813992 19362 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:07:07.814500 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.813810 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:07.816972 19256 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:07.815130 15643 raft_consensus.cc:2376] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:07.822222 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.825165 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.829993 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.832078 19079 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.234s
I20260709 13:07:07.832914 19202 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.833621 19079 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.811465 19357 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.824424 19313 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.828529 18993 raft_consensus.cc:2764] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:07.852735 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 260290us
I20260709 13:07:07.855484 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.860277 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:07.861140 15713 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.861636 15641 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:07.862789 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.863497 15639 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
W20260709 13:07:07.854456 19285 consensus_meta.cc:287] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
I20260709 13:07:07.862133 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.857263 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:07.870579 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.867633 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.843050 19357 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.790676 18892 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.872846 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:07.876749 15714 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:07.878149 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.879865 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:07.880731 15722 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:07.833634 19202 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:07.886638 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 66669.9us
I20260709 13:07:07.887138 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.888422 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.893610 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.897840 16329 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:07.900312 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:07.901424 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 87725.4us
I20260709 13:07:07.872314 19357 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.903498 15713 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:07.904948 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.900774 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.905194 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:07.872331 19256 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:07.905728 15643 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:07.908179 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.907007 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:07.914330 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:07.916731 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.919373 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.920029 15642 raft_consensus.cc:2376] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:07.921011 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.930505 19374 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:07.931186 19374 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.931589 19374 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.931732 19105 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:07.932204 19105 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:07.934047 19370 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:07.934530 19370 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.934914 19370 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.909301 19304 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:07.936811 19304 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.939374 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:07.936328 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.950924 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 50249.5us
W20260709 13:07:07.951879 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46777.5us
I20260709 13:07:07.917555 15646 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:07.953773 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:07.955530 15688 leader_election.cc:336] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.624s (SENT)
I20260709 13:07:07.956141 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:07.961325 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.964876 19285 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.953464 18636 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:07.966174 18636 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:07.968451 18636 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:07.969941 19285 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.971668 19105 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:07.974229 19377 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.974824 19377 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.975271 19377 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.990275 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.992231 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:07.993433 15641 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:07.995694 15639 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:07.906641 19313 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:07.988152 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:08.010154 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:07.973486 19105 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.014550 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:08.007057 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 149890us
I20260709 13:07:08.014400 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.015188 15643 raft_consensus.cc:2376] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9. Re-sending same reply.
I20260709 13:07:08.016162 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.019079 15642 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:08.038677 15646 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:08.050179 15641 raft_consensus.cc:1813] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Handling vote request from an unknown peer 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:08.050918 15641 raft_consensus.cc:2410] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:07:08.010222 19225 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
I20260709 13:07:07.964443 19227 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:08.069404 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 166761us
I20260709 13:07:08.072700 19304 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:08.073506 19304 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:08.078096 19350 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:08.078873 19350 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:08.087009 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 43822.2us
W20260709 13:07:08.090044 19372 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:07:08.097618 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:08.023499 18943 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.126128 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:08.181143 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:08.182451 15639 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:08.187372 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 116814us
I20260709 13:07:08.227658 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:08.125679 19227 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:08.303411 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 115078us
I20260709 13:07:08.151278 18943 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.326673 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:08.222011 19378 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:08.335884 15720 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:08.337543 15718 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:08.349311 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:08.359588 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.360394 15640 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:08.362532 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.363348 15642 raft_consensus.cc:2410] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:08.364123 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.364646 15642 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:08.365994 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:08.366482 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:08.366736 15717 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:08.367029 15646 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.370680 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.372474 15639 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:08.207743 19256 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.376358 19379 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:08.361344 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.377957 19225 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:08.379348 15642 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:08.379724 15639 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:08.247561 19350 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:08.326925 19236 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:08.387333 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.382735 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:08.387125 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 333566us
I20260709 13:07:08.390506 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:08.394754 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:08.395787 15720 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:08.328649 19304 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:08.397706 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:08.380960 19380 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:08.398444 15718 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:08.399866 18636 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.400400 18636 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.402283 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:08.402607 18636 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:08.399887 19227 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:08.342360 18993 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.412160 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:08.413924 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.414103 19138 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.398464 19304 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.414575 19138 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.414984 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:08.415148 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:08.415711 15644 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.416141 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.416680 19138 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:08.416745 15642 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:08.418419 15640 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:08.418781 19354 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.813s	user 0.003s	sys 0.008s
I20260709 13:07:08.420011 16325 raft_consensus.cc:2410] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:08.421459 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.422495 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:08.423207 15639 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:08.424319 15639 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:08.402966 16326 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:08.428484 15646 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:08.431011 15642 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:08.431490 15642 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:08.398495 19225 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:08.439462 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:08.430308 19209 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.461637 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:08.437299 19370 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.006s
I20260709 13:07:08.480394 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:08.483492 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.438874 18993 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:08.460915 19313 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:08.462033 19202 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:08.463354 19225 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:08.473999 19045 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.507441 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.495570 18943 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:08.559648 15639 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:08.506475 19236 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:08.522570 19225 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.524379 19045 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.557096 19379 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.557304 15642 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:08.639439 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 172038us
I20260709 13:07:08.506093 19209 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:08.490998 19370 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:08.616348 19363 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:08.542433 19202 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:07:08.598351 18943 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.705307 15642 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.597203 19378 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:08.720817 19378 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:08.725955 19384 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:07:08.730041 15644 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:08.596735 18993 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:08.642974 19045 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.736672 18823 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.709780 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:08.734229 19236 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.743391 18823 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.748623 15642 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:08.712421 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 211601us
W20260709 13:07:08.646109 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 212756us
I20260709 13:07:08.814111 19256 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:08.814253 18943 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:08.850661 18943 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.853267 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2093) took 1218 ms. Trace:
I20260709 13:07:08.853713 18943 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:08.837194 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 375586us
I20260709 13:07:08.858371 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:08.863593 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.175s (SENT)
I20260709 13:07:08.854095 19256 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:08.881408 19256 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:08.882396 19256 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:08.883126 19256 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:08.853729 15642 rpcz_store.cc:276] 0709 13:07:07.634754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.417547 (+782793us) service_pool.cc:224] Handling call
0709 13:07:08.425504 (+  7957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.852890 (+427386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.853154 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.888765 15642 pending_rounds.cc:85] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 8
I20260709 13:07:08.897946 15642 pending_rounds.cc:107] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:07:08.907788 15642 raft_consensus.cc:2889] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:08.824349 19357 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.864s	user 0.005s	sys 0.005s
W20260709 13:07:08.837518 19377 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.862s	user 0.012s	sys 0.000s
W20260709 13:07:08.841135 19374 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.002s
I20260709 13:07:08.976358 19357 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.976575 19374 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:08.955296 19385 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:08.963127 19403 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.838398 18993 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:09.332527 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.915072 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 260284us
W20260709 13:07:09.041927 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 190843us
W20260709 13:07:09.338543 19045 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
W20260709 13:07:09.359925 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 921462us
I20260709 13:07:09.360509 19045 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:09.025066 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.016s
W20260709 13:07:09.380827 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.005s	sys 0.025s
W20260709 13:07:09.381258 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 990739us
I20260709 13:07:08.978547 19357 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:08.976382 19377 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:09.009454 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2096) took 1373 ms. Trace:
I20260709 13:07:09.399441 15639 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:09.406433 15639 pending_rounds.cc:85] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:09.406807 15639 pending_rounds.cc:107] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:09.407143 15639 raft_consensus.cc:2889] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.978535 19374 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:09.405453 15640 rpcz_store.cc:276] 0709 13:07:07.635643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.419131 (+783488us) service_pool.cc:224] Handling call
0709 13:07:08.419421 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.423656 (+  4235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.423683 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.424190 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.578017 (+153827us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.578073 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.578167 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.009118 (+430951us) raft_consensus.cc:1685] finished
0709 13:07:09.009150 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.009365 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3863,"raft.queue_time_us":4939,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4117,"thread_start_us":153370,"threads_started":1,"wal-append.queue_time_us":566488}
I20260709 13:07:08.987353 19209 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:09.096622 19225 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:09.386969 19385 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:09.505892 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 642281us
W20260709 13:07:09.506173 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 121792us
W20260709 13:07:09.495607 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 390624us
W20260709 13:07:09.420704 19379 consensus_meta.cc:287] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.005s
I20260709 13:07:09.070030 19202 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:09.420938 19403 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:09.580945 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:09.518672 19236 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.816881 19378 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.502413 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 406) took 1651 ms. Trace:
I20260709 13:07:09.846328 15639 rpcz_store.cc:276] 0709 13:07:07.851146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.565937 (+714791us) service_pool.cc:224] Handling call
0709 13:07:09.398965 (+833028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.502089 (+103124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.502337 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.836673 15643 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.679919 19395 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:09.609321 15685 connection.cc:256] RPC call timeout handler was delayed by -1.3333538800000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:07:09.850208 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.499524 19045 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:09.851086 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 992702us
I20260709 13:07:09.850046 19395 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:09.857476 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 418) took 1419 ms. Trace:
I20260709 13:07:09.494839 19377 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:09.680096 19416 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:09.861320 19400 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:09.862725 19400 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:09.861364 19416 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:09.865976 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.843890 19378 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:09.870980 19409 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.878294 19409 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:09.879618 19374 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:09.880537 19409 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:09.880245 19374 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:09.836819 19236 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:09.481370 19256 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:09.864675 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:09.876631 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2402) took 2511 ms. Trace:
I20260709 13:07:09.877388 19424 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.881690 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 419) took 1422 ms. Trace:
I20260709 13:07:09.886061 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.039924 15794 raft_consensus.cc:1217] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-8.6]   Dedup: 5.4->[6.5-8.6]
W20260709 13:07:10.041923 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1754) took 2024 ms (client timeout 1782 ms). Trace:
I20260709 13:07:09.941164 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:09.885646 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:09.960074 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:09.952011 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.080174 15643 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:09.855762 19379 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:10.080791 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 230364us
W20260709 13:07:10.084970 15638 rpcz_store.cc:269] 0709 13:07:08.017499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.023213 (+2005714us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:10.041823 (+ 18610us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:07:10.052320 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 193781us
I20260709 13:07:10.081313 15795 raft_consensus.cc:2368] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9.
W20260709 13:07:10.082000 15643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1755) took 1751 ms (client timeout 2234 ms). Trace:
I20260709 13:07:10.086148 15794 pending_rounds.cc:85] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 4
W20260709 13:07:10.092038 15643 rpcz_store.cc:269] 0709 13:07:08.331090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.580659 (+1249569us) service_pool.cc:224] Handling call
0709 13:07:10.081929 (+501270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.092514 15794 pending_rounds.cc:107] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:10.081348 15641 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.092988 15794 raft_consensus.cc:2889] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.611037 18823 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.048982 15639 rpcz_store.cc:276] 0709 13:07:08.459835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.847762 (+1387927us) service_pool.cc:224] Handling call
0709 13:07:09.881107 (+ 33345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.881319 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.881346 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.881400 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.881434 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.881488 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.881619 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.858884 15640 rpcz_store.cc:276] 0709 13:07:08.437808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.846047 (+1408239us) service_pool.cc:224] Handling call
0709 13:07:09.846468 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.857028 (+ 10560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.857064 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.857132 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:09.857201 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.857274 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.857414 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.865360 19400 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:09.853487 19395 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:09.940780 19422 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.933171 19381 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.853695 19385 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:09.884548 19236 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:09.528558 19370 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.039812 19416 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.103797 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.046159 15796 rpcz_store.cc:276] 0709 13:07:07.365028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.373079 (+  8051us) service_pool.cc:224] Handling call
0709 13:07:07.373377 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.390924 (+ 17547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.390973 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.392627 (+  1654us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.377551 (+984924us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18003d2400. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:08.519124 (+141573us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.564587 (+ 45463us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.564925 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.565008 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.876310 (+1311302us) raft_consensus.cc:1685] finished
0709 13:07:09.876415 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.876536 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51484,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":60179,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":61867,"spinlock_wait_cycles":4164864,"thread_start_us":141357,"threads_started":1,"wal-append.queue_time_us":2481739}
I20260709 13:07:09.883137 19374 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:09.949927 19410 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.884562 19411 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:09.886065 19404 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:10.107877 19395 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:09.914067 19045 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:09.884121 19377 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:09.955152 19409 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:09.938102 19419 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:09.855439 19202 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.099171 19256 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.051066 19313 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:09.940114 19393 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 13:07:10.103575 19400 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:10.080687 19424 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.125108 19417 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.109758 19422 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.125310 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.125500 19374 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.125993 19410 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:09.881994 19357 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.148362 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 763554us
I20260709 13:07:10.174362 15641 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:07:10.192771 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 92989us
W20260709 13:07:10.177541 19350 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.436s	user 0.020s	sys 0.054s
I20260709 13:07:10.127285 19411 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.208508 15643 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:10.209398 16300 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.048s (SENT)
W20260709 13:07:10.236931 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.236820 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:10.210708 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 85493.4us
I20260709 13:07:10.210803 19256 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.180681 19045 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.198655 19403 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.212900 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.214094 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:10.214762 19421 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:07:10.215785 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 407) took 2356 ms (client timeout 2232 ms). Trace:
W20260709 13:07:10.248190 15641 rpcz_store.cc:269] 0709 13:07:07.858959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.959723 (+2100764us) service_pool.cc:224] Handling call
0709 13:07:10.215714 (+255991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.218858 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:10.208252 19350 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.477s	user 0.021s	sys 0.055s
I20260709 13:07:10.219591 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.251667 16331 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:10.223196 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56118 (request call id 93) took 1304 ms. Trace:
I20260709 13:07:10.226222 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 404) took 2405 ms. Trace:
I20260709 13:07:10.226382 19428 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:10.228783 15688 connection.cc:256] RPC call timeout handler was delayed by -1.601030919999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260709 13:07:10.205349 19418 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:10.211593 19410 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.257124 19418 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.259737 19418 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.242069 19357 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.260002 19385 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.186805 19404 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.260843 19428 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.261801 19357 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.262494 19404 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.195664 19377 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.263170 19428 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.263559 19411 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.264636 19377 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.265199 19378 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.235675 19417 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.268332 19417 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.203503 19313 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.270714 19313 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.112075 19381 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.191978 19419 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.273029 19419 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.273070 19381 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.219033 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1623) took 1890 ms. Trace:
I20260709 13:07:10.178879 19395 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.192237 19409 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:10.280865 15688 connection.cc:256] RPC call timeout handler was delayed by -1.526330919999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:07:10.252552 15791 rpcz_store.cc:276] 0709 13:07:08.919268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.919390 (+   122us) service_pool.cc:224] Handling call
0709 13:07:10.222952 (+1303562us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540c735 00007fad254049fa 00007fad2a3cc4c9 00007fad23948c54 00007fad23948be2 00007fad23948b11 00007fad23948a8c 00007fad23947d42 00007fad2374148c 00007fad237408c6
0709 13:07:10.223124 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546182400}
I20260709 13:07:10.253262 15646 rpcz_store.cc:276] 0709 13:07:07.820574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.433368 (+612794us) service_pool.cc:224] Handling call
0709 13:07:08.433767 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.026858 (+593091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.026907 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.111145 (+ 84238us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.610831 (+499686us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.610894 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.225800 (+614906us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400267fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:10.225847 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.225892 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:10.225905 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.226146 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80381,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":701699328,"thread_start_us":422514,"threads_started":2,"wal-append.queue_time_us":589613}
I20260709 13:07:10.256505 19045 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.274152 15722 rpcz_store.cc:276] 0709 13:07:08.328662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.328781 (+   119us) service_pool.cc:224] Handling call
0709 13:07:08.341631 (+ 12850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.412037 (+ 70406us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:08.499285 (+ 87248us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.862011 (+362726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.862088 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:08.862155 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.218797 (+1356642us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54001a7cd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:10.218844 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.218959 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187984,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":32725,"raft.queue_time_us":138587,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7594,"spinlock_wait_cycles":161344896,"thread_start_us":449274,"threads_started":2}
I20260709 13:07:10.293207 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.294009 15791 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:10.295070 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.295780 15791 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:10.296833 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.234591 19400 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:10.308182 15688 connection.cc:256] RPC call timeout handler was delayed by -1.464784492999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:07:10.308648 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.308946 15688 connection.cc:256] RPC call timeout handler was delayed by -1.4584844930000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 13:07:10.286192 19378 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:10.310184 19378 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.311896 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:10.312584 19378 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.312988 19409 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.313174 19378 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:10.313318 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.313629 19378 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.314003 19202 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.314064 19378 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:10.317889 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 108512us
W20260709 13:07:10.309288 15688 connection.cc:256] RPC call timeout handler was delayed by -1.4048309199999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 13:07:10.319285 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3945844929999112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:07:10.318089 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 516) took 1344 ms. Trace:
I20260709 13:07:10.330268 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:10.332196 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.334097 15791 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:10.319739 15790 rpcz_store.cc:276] 0709 13:07:08.973452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.974200 (+   748us) service_pool.cc:224] Handling call
0709 13:07:09.398207 (+424007us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.873071 (+474864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.873102 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.874124 (+  1022us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.188174 (+314050us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.188214 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.188280 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.317816 (+129536us) raft_consensus.cc:1685] finished
0709 13:07:10.317841 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.317983 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474300,"raft.queue_time_us":476013,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":313636,"threads_started":1,"wal-append.queue_time_us":435262}
I20260709 13:07:10.347007 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.351222 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.352624 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.354000 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:10.369812 15688 connection.cc:256] RPC call timeout handler was delayed by -1.361284492999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:07:10.370501 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3580309200000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 13:07:10.343114 19400 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.340991 19202 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:10.381888 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3328309199999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 13:07:10.384464 19424 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.385720 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.386296 15792 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:10.388618 16329 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:10.398312 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:10.391463 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3270844929999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:07:10.400220 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:10.400903 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3193309199999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:07:10.401242 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3112309199999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 13:07:10.401504 15688 connection.cc:256] RPC call timeout handler was delayed by -1.2577844929999173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:07:10.402457 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.403213 15791 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:10.403368 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.403987 16332 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:10.404204 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.404758 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.405454 15795 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:10.405375 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.406028 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.406241 15796 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:10.406112 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.404950 15790 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:10.408185 19429 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.409382 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.410027 19395 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.412818 19422 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.414067 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1626) took 1992 ms. Trace:
I20260709 13:07:10.390676 19298 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:10.414448 15717 rpcz_store.cc:276] 0709 13:07:08.421335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.425298 (+  3963us) service_pool.cc:224] Handling call
0709 13:07:08.435823 (+ 10525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.471766 (+ 35943us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:08.471810 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.519708 (+ 47898us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.224819 (+1705111us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b1800304de0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:10.228829 (+  4010us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:10.275644 (+ 46815us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:10.275717 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.275985 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.413856 (+137871us) raft_consensus.cc:1685] finished
0709 13:07:10.413877 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.414008 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158591,"raft.run_cpu_time_us":61670,"raft.run_wall_time_us":1630417,"spinlock_wait_cycles":8466176,"thread_start_us":26795,"threads_started":1,"wal-append.queue_time_us":1786970}
I20260709 13:07:10.410128 19429 raft_consensus.cc:2764] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:10.416150 19225 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.418007 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.418521 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 421) took 1958 ms. Trace:
I20260709 13:07:10.418804 19225 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.419302 19225 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:10.418946 15643 rpcz_store.cc:276] 0709 13:07:08.460550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.103986 (+1643436us) service_pool.cc:224] Handling call
0709 13:07:10.206351 (+102365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.236537 (+ 30186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.418304 (+181767us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002dbc50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:10.418457 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234598656}
I20260709 13:07:10.419875 19225 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.422101 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.424995 19424 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:10.425909 19045 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.426398 19045 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.426798 19045 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:10.426896 16325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 822) took 2719 ms (client timeout 1849 ms). Trace:
W20260709 13:07:10.427405 16325 rpcz_store.cc:269] 0709 13:07:07.707198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.707391 (+   193us) service_pool.cc:224] Handling call
0709 13:07:10.426518 (+2719127us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400505d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:10.426767 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445780352}
I20260709 13:07:10.430685 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 412) took 2011 ms. Trace:
I20260709 13:07:10.433981 19432 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.434528 19432 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.437814 19393 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:10.438634 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1389844929999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 13:07:10.439924 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 413) took 2020 ms. Trace:
W20260709 13:07:10.438448 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 232453us
I20260709 13:07:10.442757 16327 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:10.443179 16327 pending_rounds.cc:85] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 8
I20260709 13:07:10.443424 16327 pending_rounds.cc:107] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:10.443660 16327 raft_consensus.cc:2889] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:10.471144 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53179.2us
I20260709 13:07:10.472579 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.399178 19256 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.474179 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.474534 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2067) took 2919 ms. Trace:
I20260709 13:07:10.475277 19410 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:10.475991 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 416) took 2055 ms. Trace:
I20260709 13:07:10.477169 19410 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:10.477979 18636 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.481591 18636 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:10.482216 19408 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:10.478341 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.482656 19408 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:10.482743 19410 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:10.391382 19202 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:10.483211 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3504971569999498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:07:10.479420 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.483490 19202 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:10.483702 15610 connection.cc:256] RPC call timeout handler was delayed by -1.1992971570000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:07:10.484138 19402 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.484552 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:10.484660 19402 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.486214 16333 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:10.476399 15642 rpcz_store.cc:276] 0709 13:07:08.420879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.888107 (+467228us) service_pool.cc:224] Handling call
0709 13:07:08.888492 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.894222 (+1005730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.894273 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:10.064949 (+170676us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.200945 (+135996us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:10.229234 (+ 28289us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.475426 (+246192us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.475657 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.475738 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.475782 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:10.475795 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.475933 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":702083,"prepare.queue_time_us":37738,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":45,"raft.queue_time_us":801764,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"thread_start_us":93968,"threads_started":1,"wal-append.queue_time_us":217024}
I20260709 13:07:10.481312 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.440326 15647 rpcz_store.cc:276] 0709 13:07:08.419965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.811406 (+391441us) service_pool.cc:224] Handling call
0709 13:07:08.839645 (+ 28239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.849843 (+1010198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.849877 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.850387 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.163491 (+313104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.189136 (+ 25645us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.433669 (+244533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.439636 (+  5967us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.439716 (+    80us) raft_consensus.cc:1685] finished
0709 13:07:10.439733 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.439864 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1194761,"prepare.queue_time_us":26784,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":1191902,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":312681,"threads_started":1,"wal-append.queue_time_us":391955}
I20260709 13:07:10.438267 19393 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:10.480821 19381 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:10.474984 15645 rpcz_store.cc:276] 0709 13:07:07.554810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.938493 (+383683us) service_pool.cc:224] Handling call
0709 13:07:07.955415 (+ 16922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.970626 (+ 15211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:08.021309 (+ 50683us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.776771 (+755462us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.831830 (+ 55059us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.847857 (+1016027us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:09.911356 (+ 63499us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b5400270720. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537bdbe 00007fad25386930 00007fad253868d8 00007fad25386858 00007fad25386813 00007fad25385a9c 00007fad2b271626 00007fad2b26bdd8 00007fad253c27cb 00007fad253c52c0
0709 13:07:10.205009 (+293653us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.442445 (+237436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.442538 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.474281 (+ 31743us) raft_consensus.cc:1685] finished
0709 13:07:10.474302 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.474449 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372146,"prepare.queue_time_us":238971,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":103,"raft.queue_time_us":590963,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":3765,"spinlock_wait_cycles":2119792512,"thread_start_us":916146,"threads_started":3,"wal-append.queue_time_us":488768}
I20260709 13:07:10.431154 15644 rpcz_store.cc:276] 0709 13:07:08.419658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.735575 (+315917us) service_pool.cc:224] Handling call
0709 13:07:08.735997 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.344081 (+608084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.344111 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.397246 (+ 53135us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.843634 (+446388us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:09.998683 (+155049us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.999119 (+   436us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.222245 (+223126us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b180031bb20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:10.430153 (+207908us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b180031bb20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:10.430385 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.430457 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.430494 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:10.430507 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.430629 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26551,"prepare.queue_time_us":173930,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":574346,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":296,"spinlock_wait_cycles":17848448,"thread_start_us":236412,"threads_started":1,"wal-append.queue_time_us":452636}
I20260709 13:07:10.473831 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.486822 18943 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.491425 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.491338 18636 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:10.483192 19410 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:10.496706 19402 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.496891 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 827) took 2113 ms. Trace:
I20260709 13:07:10.483651 19408 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.491706 18993 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:10.497128 19410 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.498018 19424 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:10.498276 18993 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.498569 19424 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.498749 19410 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.500402 19424 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.497274 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.501873 16332 raft_consensus.cc:2410] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:10.501543 19402 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.502562 19402 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.502705 19393 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.503234 19256 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.503093 19402 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.490423 19381 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:10.505606 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0259309199999507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2459s for a response
W20260709 13:07:10.507279 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0165844929999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:07:10.493614 16325 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:10.514659 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:10.515552 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:10.516335 15720 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.518697 19236 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.519474 19236 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.522069 19395 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:10.522840 19395 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.528429 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.529289 16332 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:10.531319 19236 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.533569 19395 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.497351 16327 rpcz_store.cc:276] 0709 13:07:08.383811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.383937 (+   126us) service_pool.cc:224] Handling call
0709 13:07:10.439133 (+2055196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.444125 (+  4992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.496660 (+ 52535us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400505d50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:10.496811 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4691305728}
I20260709 13:07:10.504045 19381 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.537832 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:10.542554 15713 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:10.538991 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:10.543819 15718 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:10.545923 16330 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:10.548657 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:10.548972 15717 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:10.500402 18993 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.551029 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:10.552222 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 74542.7us
I20260709 13:07:10.555989 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:10.556586 15714 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.557189 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.558166 15721 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:10.513536 19424 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:10.560181 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.512780 19394 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.562273 15717 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:10.563194 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:10.564561 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:10.563213 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.569324 19448 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:10.569940 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.571604 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:10.572254 15722 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.582849 15721 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:10.583222 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.583802 15789 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:10.583997 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:10.586249 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:10.594029 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:10.569809 19448 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.598171 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:10.596666 15720 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:10.564595 19408 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.562297 18943 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:10.597922 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:10.606175 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:10.598954 15717 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
W20260709 13:07:10.648190 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:10.785188 15529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 137072us
I20260709 13:07:10.793452 15714 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:10.795198 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:10.798863 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.809258 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.809952 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.851976 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:10.795193 15543 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 149) took 24654 ms (client timeout 15000 ms). Trace:
W20260709 13:07:10.858232 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58410.2us
I20260709 13:07:10.566136 19424 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:10.892702 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 299379us
I20260709 13:07:10.893646 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.897774 19432 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.899232 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:10.899984 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.901897 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:10.902776 16329 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:10.906376 19442 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.324s	user 0.000s	sys 0.000s
I20260709 13:07:10.800499 19045 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:10.912568 19045 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:10.582432 19394 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:10.915380 19394 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:10.920552 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.925171 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.938757 19395 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.939810 19394 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.940928 19402 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:10.602250 19448 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.954635 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:10.956295 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:07:10.949810 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 72424.5us
I20260709 13:07:10.958575 16329 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:10.967100 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.963452 16333 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:10.963474 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 471093us
I20260709 13:07:10.976291 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.977931 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:10.605887 19444 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.299s
I20260709 13:07:10.861939 18943 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.989770 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:10.999680 15787 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:11.000932 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:11.002014 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:11.005142 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:11.021595 15722 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:11.023403 15793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 509) took 2906 ms (client timeout 2077 ms). Trace:
W20260709 13:07:11.024253 15793 rpcz_store.cc:269] 0709 13:07:08.097186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.097328 (+   142us) service_pool.cc:224] Handling call
0709 13:07:10.999078 (+2901750us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54001f9ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:11.003600 (+  4522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5258482944}
I20260709 13:07:11.025909 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:10.984949 18993 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:11.030862 19400 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 13:07:11.031010 19256 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.011080 19445 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:11.031546 19256 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:11.031719 19445 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.032119 19445 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.032526 19256 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.017481 19045 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:11.010962 18943 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.034554 18943 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.037966 19443 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.986109 19394 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:11.053246 19378 consensus_meta.cc:287] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.000s
W20260709 13:07:11.054056 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 95591.6us
I20260709 13:07:11.067601 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:10.985983 19402 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:11.009048 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 422807us
I20260709 13:07:11.072906 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:11.062414 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50030.5us
I20260709 13:07:11.080220 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:10.950313 19202 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.025959 19395 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.082892 15610 leader_election.cc:400] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9.
I20260709 13:07:11.085371 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.083860 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.079946 19443 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:10.853551 15543 rpcz_store.cc:269] 0709 13:06:45.852457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.874072 (+ 21615us) service_pool.cc:224] Handling call
0709 13:07:10.501695 (+24627623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:04.341092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:04.356764 (+ 15672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:04.356802 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:04.356819 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:04.357914 (+  1095us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:04.357978 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:04.358011 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:04.358968 (+   957us) tablet.cc:701] Row locks acquired
0709 13:07:04.358990 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:04.359153 (+   163us) write_op.cc:270] Start()
0709 13:07:04.359289 (+   136us) write_op.cc:276] Timestamp: P: 1783602424359089 usec, L: 0
0709 13:07:04.359313 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:04.367623 (+  8310us) log.cc:844] Serialized 3920 byte log entry
0709 13:07:05.023396 (+655773us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b1800310480. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:05.231555 (+208159us) op_driver.cc:464] REPLICATION: finished
0709 13:07:05.352229 (+120674us) write_op.cc:301] APPLY: starting
0709 13:07:05.352332 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:05.352600 (+   268us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:05.352624 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:05.528773 (+176149us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:05.529171 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:05.529242 (+    71us) write_op.cc:312] APPLY: finished
0709 13:07:05.529620 (+   378us) log.cc:844] Serialized 77 byte log entry
0709 13:07:05.530581 (+   961us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:05.530747 (+   166us) write_op.cc:454] Released schema lock
0709 13:07:05.530815 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:05.533475 (+  2660us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:05.533518 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":381688,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":112786,"apply.run_cpu_time_us":8219,"apply.run_wall_time_us":181237,"num_ops":10,"prepare.queue_time_us":237307,"prepare.run_cpu_time_us":81560,"prepare.run_wall_time_us":365258,"raft.queue_time_us":173014,"raft.run_cpu_time_us":22010,"raft.run_wall_time_us":120080,"replication_time_us":863830,"spinlock_wait_cycles":42944128,"thread_start_us":694366,"threads_started":4,"wal-append.queue_time_us":415462,"wal-append.run_cpu_time_us":14212,"wal-append.run_wall_time_us":1543262}]]}
I20260709 13:07:11.075590 19236 raft_consensus.cc:2764] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:11.072463 19402 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:11.107975 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.108815 15718 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:11.085400 15610 leader_election.cc:403] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.118984 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.119730 15720 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:11.120177 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.104197 19394 raft_consensus.cc:2764] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:11.073004 19378 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.109220 19402 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.122525 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.114379 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.128654 15713 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:11.124302 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:11.134049 15717 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:11.088013 19225 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.000s
I20260709 13:07:11.136425 15718 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:11.150378 15722 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:11.150458 15613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.066s	sys 0.170s
W20260709 13:07:11.151465 15613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.066s	sys 0.171s
W20260709 13:07:11.145149 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 154118us
W20260709 13:07:11.151940 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.153014 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 81829.1us
W20260709 13:07:11.143066 15762 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.034s	sys 0.030s
W20260709 13:07:11.160657 15762 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.035s	sys 0.030s
W20260709 13:07:11.161062 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 665619us
I20260709 13:07:11.167260 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.168097 15643 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:11.169934 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.171974 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.142966 19393 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.142700 19443 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.175776 15641 pending_rounds.cc:85] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:11.207175 15641 pending_rounds.cc:107] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:11.207360 15641 raft_consensus.cc:2889] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.157526 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:11.172830 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:11.177275 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.215883 15640 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.177647 19202 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:11.177981 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.178578 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.190021 19424 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:11.190719 19444 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:11.192483 19378 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:11.142970 19225 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.225570 19225 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:11.141449 18943 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.227605 18943 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:11.193884 15638 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:11.229445 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:11.220642 19408 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.005s
I20260709 13:07:11.230039 15638 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:11.230074 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.230983 15646 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:11.154807 19447 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:11.199400 19449 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.206631 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:11.217103 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59665.8us
I20260709 13:07:11.218818 15644 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:11.219911 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.205885 19445 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.236806 15639 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.239081 19445 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:11.219776 19045 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:11.220213 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.222357 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.240314 19045 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.243330 19045 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:11.222438 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63484.6us
I20260709 13:07:11.223042 19424 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.225881 19204 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:11.233930 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 228853us
I20260709 13:07:11.234510 15640 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:11.246034 15688 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:11.250644 19204 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:11.257730 19204 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.264643 19402 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.267309 19238 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:11.268114 19238 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.269487 15790 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:11.247812 19449 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.271379 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.272903 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.273480 15796 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:07:11.278420 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:11.278872 19381 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.723s	user 0.003s	sys 0.008s
I20260709 13:07:11.279940 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.279537 19381 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.281157 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.281811 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:11.282852 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:11.283351 15790 raft_consensus.cc:2376] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:11.283629 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.281811 19204 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.285112 15788 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:11.285563 15639 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:11.293596 15791 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:11.287894 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.295331 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.296011 15638 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:11.296900 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.297163 19204 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:11.288353 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.298043 15644 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:11.299032 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.299957 15638 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:11.300287 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:11.294597 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.301697 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.302081 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:11.302716 15793 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.302707 15646 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:11.304423 15643 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:11.304886 15643 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:11.306123 15643 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.307817 15643 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.308692 15793 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:11.310791 19296 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:11.311193 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.311760 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:11.391325 15760 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.514s (SENT) [suppressed 41 similar messages]
W20260709 13:07:11.447440 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 56165.1us
I20260709 13:07:11.385152 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.453826 15646 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:11.448140 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 508) took 3351 ms. Trace:
W20260709 13:07:11.445555 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61330us
I20260709 13:07:11.457422 15787 rpcz_store.cc:276] 0709 13:07:08.096714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.097680 (+   966us) service_pool.cc:224] Handling call
0709 13:07:08.316630 (+218950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.976662 (+2660032us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5400215820. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad254081c0 00007fad25409231 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c
0709 13:07:11.024008 (+ 47346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.447813 (+423805us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400215820. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ddc0 00007fad25409a02 00007fad25405dd6 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:11.448077 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114117120}
I20260709 13:07:11.312119 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.459085 15793 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:11.455258 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:11.446667 15788 raft_consensus.cc:2410] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:11.471839 15643 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:11.472940 15643 pending_rounds.cc:85] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 5
I20260709 13:07:11.473366 15643 pending_rounds.cc:107] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:11.384517 19395 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:07:11.474319 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.475378 15792 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:11.247351 19424 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:11.477156 15715 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:11.469460 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.483302 15643 raft_consensus.cc:2889] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.476274 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:11.490016 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.490152 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.494498 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.494788 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.495146 15722 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:11.495642 15793 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:11.494525 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.498078 15788 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 5.
I20260709 13:07:11.493623 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.499387 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.500627 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:11.501408 15717 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.400836 19402 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:11.348299 19393 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:11.478006 19449 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:11.487264 19225 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.504034 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.502408 15644 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:11.513393 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:11.495922 19424 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.510931 15639 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:11.503031 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:11.511435 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.384049 19378 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
W20260709 13:07:11.507223 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 382955us
I20260709 13:07:11.446810 19448 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.515419 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.502916 19045 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.475217 19394 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:11.475026 19285 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:07:11.527629 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:11.530763 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:11.532409 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:11.532788 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:11.514899 19225 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.520679 15793 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:11.513161 19256 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:11.504860 19296 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:11.520716 15646 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:11.536341 15647 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:11.539431 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:11.530926 19238 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:11.532452 19451 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.542275 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.537567 19256 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.544852 19256 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.545434 19456 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.535972 19225 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:11.536478 19432 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.587980 19432 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:11.536234 19402 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.519950 19454 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:11.537264 19296 consensus_queue.cc:1243] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:11.512495 19393 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.546070 19456 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.537866 19449 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.515085 19450 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:11.589638 19400 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.606961 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.589968 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.588446 19432 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.585377 19447 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:07:11.621534 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 128005us
W20260709 13:07:11.621718 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 140354us
I20260709 13:07:11.595803 19456 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.622313 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:11.626632 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.627491 15638 raft_consensus.cc:2376] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:11.627938 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.640650 15715 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:11.648731 19138 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:11.659164 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.612888 19400 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.663421 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.665485 15793 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.667073 15716 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:11.629611 19238 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.664405 15715 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:11.605134 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a882c727204be4b66080704cceb833"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "c1927141dc2540dab644a00fd6843fc6"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:11.668404 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.668928 15646 raft_consensus.cc:606] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Received request to transfer leadership to TS c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:11.669064 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46841.3us
I20260709 13:07:11.669344 15646 raft_consensus.cc:614] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:11.670652 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:11.674330 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 88411.9us
I20260709 13:07:11.685153 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.688268 15717 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:11.689867 19454 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.704144 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.704874 15638 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:11.706954 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.677166 19238 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:11.708029 19458 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:07:11.722612 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.701581 19454 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:11.697465 19323 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:11.732264 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.733502 15793 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:11.730296 19454 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.734534 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:11.743017 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.746168 15638 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:11.747573 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.753597 15638 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11. Re-sending same reply.
I20260709 13:07:11.755028 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.756543 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.757570 15638 raft_consensus.cc:2368] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
I20260709 13:07:11.759001 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.761233 15638 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:11.763281 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.752300 19454 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.767755 19454 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:11.774669 16300 leader_election.cc:336] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.889s (SENT)
I20260709 13:07:11.798219 15638 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:11.799759 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.800696 15645 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:11.801836 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.802520 15641 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:11.717736 19470 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:11.804283 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.804899 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.806401 15641 raft_consensus.cc:2368] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
I20260709 13:07:11.806576 15713 raft_consensus.cc:2410] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:07:11.805024 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 119949us
I20260709 13:07:11.732281 19463 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:11.807556 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.809073 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.809302 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.809477 15639 raft_consensus.cc:2376] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11. Re-sending same reply.
I20260709 13:07:11.809954 15788 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:11.810570 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.810637 15762 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:11.811246 15639 raft_consensus.cc:2376] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9. Re-sending same reply.
I20260709 13:07:11.812232 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.812970 15639 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:11.814108 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.814755 15639 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:11.815655 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.816732 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.817343 15639 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:11.818363 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.819454 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:11.819869 15641 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:11.820523 15788 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:11.821229 15641 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:11.802436 19238 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:11.823858 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.825088 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:11.830282 19443 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:07:11.830781 19443 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9.
I20260709 13:07:11.835561 15642 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:11.835774 19424 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:11.837190 15717 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:11.821573 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:11.838029 15788 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.842219 15789 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:07:11.845585 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.848189 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.849551 19469 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.850076 19469 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.850466 19408 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:11.850879 19408 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:11.852110 19463 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:11.853252 19463 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.855296 19451 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:11.859234 19455 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:07:11.850484 19469 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.866302 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:11.868686 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.864324 15788 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:11.874079 15787 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:11.876323 15639 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:11.878545 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:07:11.880733 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:11.882633 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:11.804899 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:11.888959 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:11.889236 15638 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
W20260709 13:07:11.888568 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 78008.9us
I20260709 13:07:11.890215 15788 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:11.892241 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:11.893471 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.898064 16325 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:11.899411 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:11.900498 15722 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:11.895243 19238 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.901557 19238 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:11.902053 19238 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.915863 15718 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:11.884066 19451 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:11.888087 19045 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.924678 19424 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:11.932857 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:11.937006 15787 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:11.937053 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.937772 15721 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:11.922873 19454 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.904721 19400 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:11.955857 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.960729 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.961555 15721 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:11.932706 19256 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.954160 19429 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.943077 19209 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:11.982048 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.988004 15721 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
W20260709 13:07:11.991147 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 97737.3us
I20260709 13:07:11.996763 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:11.999747 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:11.950757 19225 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.944736 19456 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:11.983417 19445 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.004737 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:11.972024 19470 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:11.990296 19429 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:12.012027 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.014339 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.014810 15638 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:11.991828 19402 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.017648 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.015926 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.016764 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.019359 15639 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:07:12.020097 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 125683us
I20260709 13:07:12.022497 15644 raft_consensus.cc:2368] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:12.024349 15795 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:12.013047 19445 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.985167 19432 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.017549 19429 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.014441 19480 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.027511 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.046866 15713 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:12.002514 19463 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:12.015728 19454 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:12.038288 15640 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:12.014602 19227 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:12.041366 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.052547 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.044070 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.048862 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.055033 15647 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:12.040836 19445 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.060535 15793 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.063540 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.065258 15722 raft_consensus.cc:2410] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:12.076751 15721 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:12.046303 19480 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:12.086402 19471 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:07:12.002931 19451 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.091090 19469 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:12.097929 15688 connection.cc:256] RPC call timeout handler was delayed by -1.707598399999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:07:12.110327 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6859983999999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:07:12.110785 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6832983999998987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:07:12.111224 15688 leader_election.cc:336] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.558s (SENT)
I20260709 13:07:12.084812 19480 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.132741 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:12.134953 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6562983999999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:07:12.157136 15688 leader_election.cc:336] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.792s (SENT)
I20260709 13:07:12.158481 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:12.093077 19202 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:07:12.171010 15688 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.871s (SENT)
I20260709 13:07:12.160018 16325 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.160782 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:12.174757 16330 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:12.171451 15688 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:12.172830 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 88479.4us
I20260709 13:07:12.181005 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:12.169648 19256 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:12.184355 19477 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:12.154747 19394 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:12.185842 19394 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.184405 19424 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:12.121755 19485 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:07:12.134824 19422 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:12.136111 19378 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:12.074815 19470 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.181386 19225 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:12.246413 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51317.4us
I20260709 13:07:12.259406 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.202315 19456 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:12.243029 19432 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:12.268105 16298 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.235785 19469 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:12.289121 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 133979us
I20260709 13:07:12.240657 19445 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.311061 19492 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:12.312078 19492 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:12.312430 19492 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:12.313222 19445 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:12.291384 19453 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.288126 19488 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.290971 19227 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:12.316004 19448 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:12.331229 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.310320 19378 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:12.337488 19394 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.338400 19449 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.338831 19449 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:12.339689 19449 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.340749 19449 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.354187 15721 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:12.356065 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.356146 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:12.358268 19400 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.358785 19400 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.359108 19408 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.360179 19408 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.360268 19432 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:12.361115 19400 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:12.360885 19432 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.360194 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.364658 15714 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.364960 19238 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.371325 15720 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:12.374071 15714 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:12.376236 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:12.379029 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:12.380358 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.382216 15714 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.378506 19296 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.403172 19296 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:12.403671 19296 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.389528 15640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1776) took 1136 ms (client timeout 1514 ms). Trace:
W20260709 13:07:12.405993 15640 rpcz_store.cc:269] 0709 13:07:11.253263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.257279 (+  4016us) service_pool.cc:224] Handling call
0709 13:07:11.866120 (+608841us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:12.389290 (+523170us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400120cd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:12.389415 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380456960}
I20260709 13:07:12.398931 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1763) took 1232 ms. Trace:
I20260709 13:07:12.407022 15642 rpcz_store.cc:276] 0709 13:07:11.166103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.166239 (+   136us) service_pool.cc:224] Handling call
0709 13:07:12.398769 (+1232530us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54001beed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:12.398872 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379563776}
I20260709 13:07:12.408507 19393 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:12.410120 19489 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:12.411077 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.412261 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:12.413255 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.414755 19296 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.416942 18943 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.417372 18943 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:12.417369 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.418001 18943 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.418941 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.419992 19444 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.421860 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:12.422058 19393 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.422942 19393 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:12.423910 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:12.424314 19393 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.426542 19493 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:12.426904 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:12.427111 19493 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.427997 19493 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.432083 15716 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.434123 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.434767 15716 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:12.436492 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1777) took 1150 ms. Trace:
I20260709 13:07:12.436867 15645 rpcz_store.cc:276] 0709 13:07:11.286173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.289298 (+  3125us) service_pool.cc:224] Handling call
0709 13:07:11.798808 (+509510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.801094 (+  2286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.436304 (+635210us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002684d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:12.436439 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171124096}
I20260709 13:07:12.437322 19381 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:12.313268 19492 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.422036 19448 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.441222 19492 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.425958 19432 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:12.444460 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.448876 19227 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:12.440285 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.452344 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.453711 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:12.454727 15795 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:12.455448 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.455736 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:12.456125 15641 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
W20260709 13:07:12.456692 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.457669 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.458513 15641 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:12.458848 15796 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:12.457731 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.459224 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:12.459446 15645 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:12.459671 15795 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.459798 15788 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:12.460765 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.460996 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:12.461403 15645 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:12.462531 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:12.462694 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:12.462738 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.463280 15788 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10.
I20260709 13:07:12.463531 15645 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:12.465329 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.466502 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.467825 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.468386 15641 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:12.463296 15787 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.469471 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:12.470249 15641 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:12.471323 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.471814 15641 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.477474 15645 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:12.393541 19429 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.480939 19429 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:12.481297 15787 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:12.482511 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:12.483178 15788 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:12.485628 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:12.330142 19488 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:12.487061 19488 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.489439 19491 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:12.369567 19238 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:12.495808 15640 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:12.454389 19480 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.497639 15640 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:12.499302 19480 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:12.500195 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:12.501097 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.504243 15641 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:12.501288 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.429016 18943 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.510564 18943 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:12.512727 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.513236 15641 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.514830 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:12.517356 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 346346us
W20260709 13:07:12.517983 15688 leader_election.cc:336] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.936s (SENT)
I20260709 13:07:12.518738 16300 leader_election.cc:400] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
I20260709 13:07:12.519142 16300 leader_election.cc:403] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.518464 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:12.523391 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:12.525497 15787 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.531402 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:12.533574 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6382609679999405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2397s for a response
W20260709 13:07:12.534188 15688 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.080s (SENT)
I20260709 13:07:12.534456 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.535068 15641 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.535808 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.536373 15642 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.536715 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.537303 15638 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:12.537299 15639 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.537949 15714 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:12.541926 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:12.543857 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:12.539393 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.552902 15641 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:12.555243 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.556035 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.556784 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.557204 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:12.557345 15640 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.558805 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:12.556491 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.561164 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.520419 19448 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:12.564103 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 185131us
I20260709 13:07:12.522091 19453 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.566824 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:12.520614 19202 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.568331 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.568485 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:12.566470 15688 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.191s (SENT)
I20260709 13:07:12.522284 19438 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
I20260709 13:07:12.578390 15641 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.592851 19462 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.574038 18823 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:12.590435 19454 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.580816 15640 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:12.516624 19429 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:12.574501 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:12.607272 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:12.597520 19202 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:12.597792 19478 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.599092 15542 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.612998 15640 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:12.601663 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:12.601732 15641 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:12.592519 19469 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:12.605108 15638 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:12.593622 15644 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:12.606104 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.563155 19408 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.522487 19323 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:07:12.556443 19484 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.545930 19474 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.627210 15642 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:12.627892 15639 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:12.614359 15641 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.646878 15641 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.575393 19492 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:12.603511 19448 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:12.520071 19296 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:12.605891 19453 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:12.574646 19400 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.605698 19424 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.522745 19491 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:07:12.611624 19393 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.538336 19449 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:12.655388 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49382.7us
I20260709 13:07:12.650954 19408 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:12.651976 18823 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:12.679241 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 74781.6us
I20260709 13:07:12.610183 19202 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.616122 19478 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:12.660557 19227 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.661613 15641 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:12.666296 19453 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.607362 19378 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:07:12.615428 19298 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:12.654453 15542 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:12.633455 19394 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:12.675595 19448 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.654850 19454 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:12.700806 19378 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:12.701254 19378 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:12.701407 19454 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.703193 19378 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.678849 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.692123 15641 pending_rounds.cc:85] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:12.706528 15641 pending_rounds.cc:107] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:12.706888 15641 raft_consensus.cc:2889] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.644161 19487 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:12.671249 19296 raft_consensus.cc:2764] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:12.691869 19495 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:07:12.745898 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 212455us
W20260709 13:07:12.747087 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68349.4us
I20260709 13:07:12.692723 19478 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:12.747704 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 140496us
I20260709 13:07:12.724677 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.726192 15716 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:12.677456 19449 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.721215 19487 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:12.757541 19438 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:12.761464 19393 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.759676 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:12.775493 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:12.757627 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 191169us
I20260709 13:07:12.764027 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 432) took 1139 ms. Trace:
W20260709 13:07:12.776352 15688 leader_election.cc:336] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.194s (SENT)
I20260709 13:07:12.776842 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:12.704519 19378 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.776279 15643 rpcz_store.cc:276] 0709 13:07:11.624225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.828882 (+204657us) service_pool.cc:224] Handling call
0709 13:07:11.829222 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.829606 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.829643 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.400970 (+571327us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b2c000014c8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:12.401383 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.629345 (+227962us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.725479 (+ 96134us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.751301 (+ 25822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.751409 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.751463 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:12.763840 (+ 12377us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.763968 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53860,"raft.queue_time_us":28728,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2007,"spinlock_wait_cycles":15372672,"thread_start_us":288470,"threads_started":2,"wal-append.queue_time_us":259759}
I20260709 13:07:12.698698 19424 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.791571 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.792550 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.721899 19227 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:12.752986 19444 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.807193 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:12.764961 19429 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:12.811069 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:12.774124 19487 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.814539 15685 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:12.778940 19449 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.773869 19438 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:12.799769 15542 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: config changed from index 6 to 8, term changed from 4 to 10, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to <none>, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:12.791157 19296 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.805512 19463 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:12.810601 19498 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:12.808760 19394 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.805399 19381 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:12.780200 19491 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:07:12.812724 19424 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:12.859081 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 82751.9us
I20260709 13:07:12.873796 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.874783 15720 raft_consensus.cc:2368] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:12.876428 15721 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:12.805150 19484 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:07:12.803215 19238 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:07:12.888235 15542 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 7, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 7 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:12.894723 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.889284 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.900925 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.883862 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.822424 19296 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:12.822383 19485 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:12.858932 19429 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:12.905534 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.903924 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.916209 15714 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:07:12.916447 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 393094us
I20260709 13:07:12.917415 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:12.907140 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 147762us
I20260709 13:07:12.908078 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.897924 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.920888 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:12.921514 15720 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:12.902571 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 139795us
I20260709 13:07:12.903173 15721 raft_consensus.cc:2376] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9. Re-sending same reply.
I20260709 13:07:12.811022 19408 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:12.891425 19509 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:12.908923 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.929468 15718 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.905916 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.864183 19422 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:12.911826 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:12.904083 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 103124us
I20260709 13:07:12.820204 19447 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:07:12.903349 19508 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.904129 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:12.893679 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.870317 19463 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:12.922899 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.923786 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:12.924973 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.933302 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.857064 19393 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:07:12.932006 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.940007 15715 raft_consensus.cc:2376] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10. Re-sending same reply.
I20260709 13:07:12.945084 19448 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:12.945673 19448 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:12.946722 19463 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.948119 19448 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:12.949373 15721 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:12.950003 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:12.951220 15713 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:12.951550 15713 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:12.952632 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 138145us
I20260709 13:07:12.820927 18823 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.910390 19296 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:12.954594 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.953490 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:12.925113 19424 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.905341 19394 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.929167 19443 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.928530 19324 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.965611 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:12.903463 19381 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:12.952270 15713 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.953358 19508 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:13.006201 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.006188 15713 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.962634 19424 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:12.967360 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:12.939221 19492 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:12.899472 19507 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:07:12.983251 15542 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 8, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 8 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:12.913311 19227 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:12.966452 19394 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:12.981320 19443 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.016222 15643 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:12.972965 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48092us
I20260709 13:07:12.986773 19519 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:13.045157 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77864.9us
I20260709 13:07:12.925396 19438 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:13.065160 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 106265us
I20260709 13:07:12.924309 19485 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.023079 19424 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.055830 15542 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 6, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 6 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.034353 19394 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.046607 19443 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.062446 19381 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:13.063828 19504 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:07:12.953727 19422 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.066568 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:13.048878 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:13.013130 19508 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.091439 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:13.092481 15760 leader_election.cc:336] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.514s (SENT)
I20260709 13:07:13.035486 19518 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:12.982787 19448 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:13.097608 19448 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.098142 19448 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.098364 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:13.014955 19522 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.079496 15713 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:13.102572 15713 pending_rounds.cc:85] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 5
I20260709 13:07:13.102833 15713 pending_rounds.cc:107] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:13.050910 19432 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:13.048377 19519 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.073173 19502 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:07:13.096542 16327 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:13.096875 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48097us
I20260709 13:07:13.114763 15610 leader_election.cc:400] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10.
I20260709 13:07:13.115182 15610 leader_election.cc:403] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.103116 15713 raft_consensus.cc:2889] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:13.108557 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 151504us
I20260709 13:07:13.117321 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:13.116935 15542 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.118463 15542 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 6, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 6 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.110054 19432 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:13.103081 19493 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.005s
I20260709 13:07:13.050931 19429 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:13.191313 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.110756 19393 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.111033 19522 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.205613 15542 catalog_manager.cc:5697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.121331 19519 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.127533 19432 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.220671 19529 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.221182 19529 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.221520 19529 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.126153 19515 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10.
I20260709 13:07:13.223407 19517 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.212991 19393 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.225869 19393 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.226794 19485 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:13.228235 19530 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.228574 15718 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:13.228965 19530 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:13.214416 19453 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:07:13.229838 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:13.230086 19453 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.230639 15645 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:13.232371 19453 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:13.212406 19488 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.004s
I20260709 13:07:13.217053 15542 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 9, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 9 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:07:13.252933 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 135651us
I20260709 13:07:13.264957 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:13.265713 15719 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:13.233053 19202 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.001s
I20260709 13:07:13.141299 19493 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.271004 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:13.278880 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:13.271827 19523 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:07:13.280035 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:13.130590 19492 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.280550 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:13.280189 15542 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 8, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 8 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.291898 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:13.286088 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:13.285929 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:13.286936 15641 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.294176 15639 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:13.295373 15717 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:13.296446 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 195981us
I20260709 13:07:13.298977 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:13.259045 19530 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:13.269680 19478 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.302762 15790 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.288239 19517 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.306630 15790 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:13.311124 19451 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.311863 19451 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.315490 19451 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.315698 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:13.316473 19528 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.317512 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:13.327131 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.346103 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:13.346396 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:13.261725 19488 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.278409 19202 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.347743 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:13.353470 15643 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.351675 15542 catalog_manager.cc:5697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 6, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 6 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.347782 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:13.348727 15793 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:13.303572 19531 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.347570 15787 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.289947 19449 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:13.350193 19523 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:13.309451 19517 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.420187 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 140219us
I20260709 13:07:13.431314 16334 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.459892 19493 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.433048 19517 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.419855 19537 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.470026 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:13.479992 19538 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:13.490796 19394 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.537299 15643 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:13.543452 15542 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 7, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.545610 15542 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 5, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.466252 19296 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.475065 19537 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:13.554827 19394 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.554751 19202 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:13.556061 19449 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.601073 19537 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:13.560837 19487 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.000s
I20260709 13:07:13.601974 19487 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.602489 19296 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.603191 15716 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.562559 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:13.604496 19534 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:07:13.565068 19535 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:07:13.564353 19432 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:13.606338 19497 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.963s	user 0.004s	sys 0.002s
I20260709 13:07:13.604550 19487 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:13.569033 19378 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.000s
I20260709 13:07:13.570201 19488 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.553586 19522 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.610917 19432 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:13.579478 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:13.543681 19478 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:13.600349 16327 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:13.405175 19531 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.607920 15642 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:13.609443 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.540930 19323 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.574486 15542 catalog_manager.cc:5697] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.614398 15722 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:13.621501 15722 pending_rounds.cc:85] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 5
I20260709 13:07:13.621784 15722 pending_rounds.cc:107] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:13.622047 15722 raft_consensus.cc:2889] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.622630 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:13.624866 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:13.612922 19448 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:07:13.628166 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:13.630362 15643 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.636988 15542 catalog_manager.cc:5697] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.632462 19487 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.642495 15542 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:13.640689 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:13.651515 15643 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:13.637344 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:13.653879 15647 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.632951 19488 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.620675 19323 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:13.628899 19432 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.653437 19408 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.635155 19202 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:13.656015 15542 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:13.711179 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 412110us
I20260709 13:07:13.713100 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:13.658030 19529 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.658520 19501 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:13.720911 16298 leader_election.cc:336] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.766s (SENT)
I20260709 13:07:13.722239 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:13.636055 19448 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:13.732419 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 91867.2us
I20260709 13:07:13.720006 19324 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.734462 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:13.738943 19542 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:07:13.738370 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:13.744124 19543 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:07:13.748772 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.730276 19532 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:13.738674 19424 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:07:13.752266 19424 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.753320 15713 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.714713 19408 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.760789 15714 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.761289 15721 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:13.733237 19501 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:13.757272 19508 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.004s
I20260709 13:07:13.736419 19324 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:13.773257 15715 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:13.751150 19488 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:13.762317 19381 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:13.775667 19443 consensus_meta.cc:287] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.006s
I20260709 13:07:13.776461 19424 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.879179 18943 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:13.879798 18943 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:13.882362 19552 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:07:13.855484 19408 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.779168 19449 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:13.785554 19381 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.824344 19531 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.895291 15647 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:13.847905 19324 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.777423 19508 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.869953 19529 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:13.852958 19422 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.785934 19488 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:13.854595 19548 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:07:13.825615 19500 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.116s	user 0.009s	sys 0.013s
W20260709 13:07:13.789790 19519 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:07:13.916015 19456 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.915890 19519 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.916613 19456 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.919001 19519 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.814131 19501 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.920611 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1656) took 1018 ms. Trace:
I20260709 13:07:13.920989 15717 rpcz_store.cc:276] 0709 13:07:12.902386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.907804 (+  5418us) service_pool.cc:224] Handling call
0709 13:07:13.920428 (+1012624us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540017a2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:13.920555 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860781952}
W20260709 13:07:13.923760 19550 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:07:13.867162 15790 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.925439 15790 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.927378 16325 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.928130 19408 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.928527 19408 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:13.930306 19517 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.932514 19517 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:13.776080 19532 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:13.929322 19408 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.770655 19537 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.792541 19443 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:13.750978 19323 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.880993 18943 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:14.008069 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.914816 19488 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:13.935513 15641 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.780822 19400 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:14.011240 19537 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:13.957861 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 139392us
I20260709 13:07:14.014194 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:14.015239 19532 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:14.015813 19532 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:14.005470 15720 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:14.007172 15643 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.016412 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:14.014124 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:14.278398 15760 leader_election.cc:336] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.742s (SENT)
I20260709 13:07:14.278990 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:14.283099 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:14.069685 19238 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:14.286964 19238 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.198704 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1668) took 1282 ms. Trace:
I20260709 13:07:14.290294 15722 rpcz_store.cc:276] 0709 13:07:12.915939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.967303 (+ 51364us) service_pool.cc:224] Handling call
0709 13:07:12.967579 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.622559 (+654980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.198386 (+575827us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400438d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:14.198623 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486609280}
I20260709 13:07:14.030795 15790 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:14.276575 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2753) took 1014 ms. Trace:
I20260709 13:07:14.278522 16325 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
W20260709 13:07:14.039407 16298 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.694s (SENT)
W20260709 13:07:14.293853 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 254473us
I20260709 13:07:14.295871 15790 pending_rounds.cc:85] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 4
I20260709 13:07:14.296386 15790 pending_rounds.cc:107] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 13:07:14.085655 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.296739 15790 raft_consensus.cc:2889] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.302517 19238 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:14.292223 15713 rpcz_store.cc:276] 0709 13:07:13.262637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.262747 (+   110us) service_pool.cc:224] Handling call
0709 13:07:13.262963 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.753669 (+490706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.934089 (+180420us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540017bbd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:14.276511 (+342422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127267072}
W20260709 13:07:14.306546 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.306727 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.194396 19489 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.394s	user 0.010s	sys 0.023s
W20260709 13:07:14.180485 19487 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.004s
I20260709 13:07:13.984926 19429 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.004464 19519 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:14.291694 19496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.001s	sys 0.010s
W20260709 13:07:14.319628 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 303286us
I20260709 13:07:14.295594 19448 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:14.275997 18943 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:14.322810 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.324059 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.291402 19408 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.304142 19323 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.177887 19508 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:14.290128 19474 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:14.320449 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.307394 19324 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.016686 19480 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:14.310070 18823 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.309633 19432 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:14.326710 19519 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:14.321722 19487 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.320981 19444 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.329284 19496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.001s	sys 0.010s
I20260709 13:07:14.325906 19451 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:14.370563 18823 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.315917 19514 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:14.337630 19474 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:14.327867 19517 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:14.339212 19463 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:14.016714 19532 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.371588 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:14.321619 19429 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.363235 19443 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:14.368423 19456 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:14.409878 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:14.376286 19381 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:14.371537 19451 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.363847 19480 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.368417 19432 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.374852 19444 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.408552 19449 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:14.434314 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 107199us
W20260709 13:07:14.442417 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.434839 19045 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:14.440543 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1807) took 1841 ms. Trace:
I20260709 13:07:14.439142 19393 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.464475 19393 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.465072 15643 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:14.466317 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:14.466814 19393 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:14.434166 19456 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.468786 19429 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:14.468876 19451 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:14.470983 19432 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:14.473773 19444 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:14.395741 19463 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.474676 19557 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.475235 19557 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.476202 19463 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:14.436023 18823 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:14.497229 19565 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:14.497371 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:14.497967 19429 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:14.499774 19568 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:14.441111 19555 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:14.394356 19517 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.461349 15638 rpcz_store.cc:276] 0709 13:07:12.599299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.614465 (+ 15166us) service_pool.cc:224] Handling call
0709 13:07:12.614826 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.615076 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:12.753509 (+138433us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.746458 (+992949us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180033c640. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:14.071488 (+325030us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.440019 (+368531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.440102 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.440177 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.440281 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.440464 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293458,"prepare.queue_time_us":201628,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":310280,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":29851,"spinlock_wait_cycles":23634176,"thread_start_us":540232,"threads_started":4}
W20260709 13:07:14.506909 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 82248us
I20260709 13:07:14.514101 19514 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.516386 19514 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.516615 19238 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:14.514150 19555 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.479655 19571 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.522049 19565 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:14.441947 19227 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:07:14.501932 19496 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:14.543251 15643 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:14.508170 19443 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:14.463308 19449 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.508888 19557 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:14.562260 19567 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:07:14.459138 19519 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.496419 19045 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.508464 19429 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.507217 18823 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.598675 19438 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.601230 19449 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:14.601517 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2755) took 1338 ms. Trace:
I20260709 13:07:14.602237 18823 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:14.601912 15716 rpcz_store.cc:276] 0709 13:07:13.263239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.263368 (+   129us) service_pool.cc:224] Handling call
0709 13:07:13.263688 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.603637 (+339949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.601279 (+997642us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540017b1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:14.601459 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780318976}
I20260709 13:07:14.603030 19480 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:14.603276 19429 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:14.608023 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 99344.9us
I20260709 13:07:14.588204 19569 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.590716 19238 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.622350 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:14.624344 16330 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:14.624554 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:14.625344 15641 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.625459 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:14.626893 16327 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:14.627388 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:14.632177 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:14.629416 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:14.610050 19575 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:14.609517 19408 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.556424 19496 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.609351 19324 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:14.652518 15641 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:14.652508 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:14.653887 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.654997 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:14.657610 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:14.626494 19569 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:14.658797 15790 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 6.
I20260709 13:07:14.668576 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:14.669610 16298 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.687s (SENT)
I20260709 13:07:14.669700 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:14.670276 16298 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:14.638625 19575 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:14.635002 19449 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:14.648890 19563 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:14.662726 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:14.676659 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:14.677217 15641 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:14.677341 15640 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:14.678103 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:14.680202 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:14.681607 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:14.683645 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:14.685201 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:14.635814 19238 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:14.736579 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61062.5us
I20260709 13:07:14.649588 19408 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:14.743749 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:14.746058 19045 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:14.650315 19324 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.676076 19449 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:15.059135 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:15.187347 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:14.920634 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:14.854555 16328 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:14.928503 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.674515 19546 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.188740 16332 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:14.679791 19323 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:15.159132 15642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.007s
W20260709 13:07:15.200708 15642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.000s	sys 0.012s
W20260709 13:07:14.831313 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.993074 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.160653 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 305318us
I20260709 13:07:14.747785 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:15.191020 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:15.205233 15790 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.685456 19480 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.256325 16325 raft_consensus.cc:2410] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:15.258191 15643 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:14.744398 18823 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:14.826769 19443 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.967811 19581 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:07:14.847590 19579 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:14.736461 19514 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:14.848256 19577 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:07:15.282476 15760 leader_election.cc:336] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.507s (SENT)
I20260709 13:07:15.282914 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:15.212172 19202 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.284284 19324 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:15.200899 19546 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.192214 19238 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:14.847929 19569 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:15.271603 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:15.272886 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1811) took 1339 ms. Trace:
I20260709 13:07:15.322618 15645 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
W20260709 13:07:15.323218 15645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1817) took 1388 ms (client timeout 1840 ms). Trace:
I20260709 13:07:15.322520 15647 rpcz_store.cc:276] 0709 13:07:13.933138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.950414 (+ 17276us) service_pool.cc:224] Handling call
0709 13:07:14.589420 (+639006us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:14.589687 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.604220 (+ 14533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.604251 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.604678 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.677114 (+ 72436us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.677184 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.677262 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.272583 (+595321us) raft_consensus.cc:1685] finished
0709 13:07:15.272602 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.272826 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14029,"raft.queue_time_us":14942,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5327,"spinlock_wait_cycles":4823936,"thread_start_us":72161,"threads_started":1,"wal-append.queue_time_us":666462}
W20260709 13:07:15.323743 15645 rpcz_store.cc:269] 0709 13:07:13.935056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.985424 (+ 50368us) service_pool.cc:224] Handling call
0709 13:07:15.271443 (+1286019us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:15.323159 (+ 51716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5187968}
I20260709 13:07:15.054442 19453 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.192508 19449 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.273710 15638 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:15.191849 19478 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.326408 19478 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:15.326956 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2761) took 1584 ms. Trace:
I20260709 13:07:15.197691 19565 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.938247 19574 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.850455 19517 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:15.192405 19496 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:15.283955 19202 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:14.826431 19576 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:15.284960 19546 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.294106 15790 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:15.275112 18823 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.324863 15646 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:15.355527 19578 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.769s	user 0.005s	sys 0.015s
I20260709 13:07:15.357769 19400 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.358300 19400 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.360391 19400 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:15.360877 19400 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.360734 19474 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:15.345650 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.362815 19474 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.363588 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:15.365366 19520 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.261807 19480 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.374660 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:15.375298 15715 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.859233 19587 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.452s
I20260709 13:07:15.276561 19443 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:15.356818 18823 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:15.336988 19539 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:14.848817 19575 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:15.337992 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 1.90864e+06us
I20260709 13:07:15.382814 19570 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:15.383419 19570 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:15.341511 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.342779 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 1.62962e+06us
W20260709 13:07:15.342983 19584 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.510s	user 0.000s	sys 0.020s
I20260709 13:07:15.343315 19492 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.343806 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:15.344548 19488 consensus_queue.cc:1175] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c1927141dc2540dab644a00fd6843fc6" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 10 index: 9 } }
I20260709 13:07:15.391176 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:15.444862 15789 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.345636 19529 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:15.347513 19478 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:15.349047 19517 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.333825 19574 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.281284 19579 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.350796 19408 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:15.353353 19448 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.355639 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1814) took 1421 ms. Trace:
I20260709 13:07:15.361799 19565 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.335407 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:15.327400 15720 rpcz_store.cc:276] 0709 13:07:13.742886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.743024 (+   138us) service_pool.cc:224] Handling call
0709 13:07:13.743348 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.308120 (+564772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.326728 (+1018608us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54003868d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:15.326896 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600028928}
I20260709 13:07:15.367237 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:15.367534 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:15.365962 19520 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:15.375860 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:15.376387 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:15.377414 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:15.336453 19528 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:15.377501 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1813) took 1443 ms. Trace:
I20260709 13:07:15.382890 19443 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:15.339540 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.384285 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.340180 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:15.386629 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:15.386385 19570 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.333647 19576 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.387045 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:15.361515 19400 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.555143 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:15.485245 15793 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:15.441668 19536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.040s	user 0.014s	sys 0.008s
I20260709 13:07:15.573805 15795 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.330510 19453 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:15.436568 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 223412us
I20260709 13:07:15.574873 19529 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:15.575995 15718 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:15.573028 15642 rpcz_store.cc:276] 0709 13:07:13.933804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.936874 (+  3070us) service_pool.cc:224] Handling call
0709 13:07:13.937280 (+   406us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:14.321459 (+384179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.321490 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:14.328666 (+  7176us) log.cc:844] Serialized 78 byte log entry
0709 13:07:14.434060 (+105394us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:15.201476 (+767416us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.375980 (+174504us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.377056 (+  1076us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.377228 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.377293 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.377325 (+    32us) raft_consensus.cc:1685] finished
0709 13:07:15.377336 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.377451 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336144,"prepare.queue_time_us":76297,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":9603,"raft.queue_time_us":473739,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":5261,"thread_start_us":932893,"threads_started":3,"wal-append.queue_time_us":176019}
I20260709 13:07:15.357303 19546 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:15.479403 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:15.579721 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:15.585522 15787 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:15.574460 15719 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:15.577266 19448 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:15.445648 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 54547.5us
I20260709 13:07:15.514297 15789 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
W20260709 13:07:15.529778 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 144955us
I20260709 13:07:15.591895 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 552) took 1036 ms. Trace:
I20260709 13:07:15.574714 15646 rpcz_store.cc:276] 0709 13:07:13.934148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.985498 (+ 51350us) service_pool.cc:224] Handling call
0709 13:07:15.322159 (+1336661us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:15.322361 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.355362 (+ 33001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.355565 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11271424}
I20260709 13:07:15.496497 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:15.601126 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:15.569895 19577 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:07:15.607853 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:15.609820 16330 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:15.580821 15790 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:15.608796 15793 rpcz_store.cc:276] 0709 13:07:14.555275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.555449 (+   174us) service_pool.cc:224] Handling call
0709 13:07:15.484887 (+929438us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:15.485068 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.591498 (+106430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.591820 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6172416}
I20260709 13:07:15.571632 19569 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.621157 15759 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:15.463646 19596 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.577701 19529 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:15.455075 19551 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:15.584949 19539 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.690258 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:15.596979 19478 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:15.586242 19493 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:15.483062 19555 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:16.100335 15715 consensus_meta.cc:287] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 13:07:16.122634 15715 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
W20260709 13:07:15.762718 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.585536 19492 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.074985 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.114671 19533 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.016s
W20260709 13:07:16.062696 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 454880us
I20260709 13:07:16.126698 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:15.954913 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.579167 19576 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:15.911738 15610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.020s	sys 0.049s
W20260709 13:07:15.905896 15613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.022s	sys 0.052s
W20260709 13:07:16.136652 15610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.021s	sys 0.062s
I20260709 13:07:15.701973 19603 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.475s
I20260709 13:07:15.464061 19202 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:15.573371 19528 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:15.902056 15643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.027s
W20260709 13:07:15.721437 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.954849 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.739431 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:15.918049 16327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.016s	sys 0.019s
W20260709 13:07:16.146597 16327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.018s	sys 0.033s
W20260709 13:07:15.890089 15760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.017s
I20260709 13:07:16.147184 15641 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:16.126196 19533 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.005s	sys 0.016s
W20260709 13:07:15.922446 15612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.011s	sys 0.025s
I20260709 13:07:15.678577 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:15.579358 19536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.226s	user 0.014s	sys 0.008s
I20260709 13:07:15.640272 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:15.466531 19480 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:16.108191 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 336901us
I20260709 13:07:15.624976 19570 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:15.990969 19577 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:07:16.161885 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:15.639360 19530 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.609480 19443 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:16.065755 15795 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:16.148048 19528 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.162979 19574 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:15.679925 19565 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:15.744717 19453 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:15.677848 19522 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.175784 19488 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:15.738328 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 553) took 1162 ms. Trace:
I20260709 13:07:16.120419 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2470) took 1172 ms. Trace:
I20260709 13:07:16.181957 15793 rpcz_store.cc:276] 0709 13:07:14.948190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.689902 (+741712us) service_pool.cc:224] Handling call
0709 13:07:16.120352 (+430450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.181900 15794 rpcz_store.cc:276] 0709 13:07:14.576238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.576487 (+   249us) service_pool.cc:224] Handling call
0709 13:07:15.737300 (+1160813us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:15.737589 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.737866 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.737908 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.737969 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:15.738026 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.738104 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.738244 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5294848}
I20260709 13:07:16.183329 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.183530 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:16.183938 15793 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:16.184019 15794 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.185002 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:16.185992 15793 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.175889 19532 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.186637 19576 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.186818 19532 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.188935 19576 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.189051 19532 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.176682 19565 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.098809 19296 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:16.139982 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.142402 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.192341 15638 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:07:16.137012 15613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.027s	sys 0.062s
W20260709 13:07:16.147418 15760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.025s	sys 0.024s
W20260709 13:07:16.198276 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 915723us
W20260709 13:07:16.199465 15760 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.750s (SENT)
W20260709 13:07:16.200599 15760 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.775s (SENT)
I20260709 13:07:16.200809 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2456) took 1522 ms. Trace:
W20260709 13:07:15.894281 15611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.028s
W20260709 13:07:16.201992 15611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.009s	sys 0.043s
I20260709 13:07:16.189848 19565 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.099987 19579 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:16.148561 15612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.015s	sys 0.038s
I20260709 13:07:16.148963 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2465) took 1399 ms. Trace:
I20260709 13:07:16.203873 15787 rpcz_store.cc:276] 0709 13:07:14.749623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.609142 (+859519us) service_pool.cc:224] Handling call
0709 13:07:16.148918 (+539776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.153765 19603 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:16.156832 15791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 550) took 1638 ms (client timeout 1957 ms). Trace:
W20260709 13:07:16.145139 15643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.014s	sys 0.038s
I20260709 13:07:16.158434 19202 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:16.159088 19609 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:16.160184 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:16.129910 19600 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.728284 19449 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.155536 19604 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.122206 19596 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.162673 15644 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:16.143853 19551 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.170442 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2466) took 1402 ms. Trace:
I20260709 13:07:15.889456 19381 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.123875 19478 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.127435 19539 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.156311 19520 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.130836 19492 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:15.589521 19517 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.123693 19493 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:16.176599 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 527062us
I20260709 13:07:16.179342 19522 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:16.157824 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.254020 15640 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:16.237106 15795 rpcz_store.cc:276] 0709 13:07:14.768397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.495555 (+727158us) service_pool.cc:224] Handling call
0709 13:07:16.170373 (+674818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.201429 15789 rpcz_store.cc:276] 0709 13:07:14.678601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.683411 (+  4810us) service_pool.cc:224] Handling call
0709 13:07:16.200557 (+1517146us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54001f77d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.200724 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748697472}
I20260709 13:07:16.255127 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.255798 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:16.209442 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.215183 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.205164 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.205315 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.214988 19603 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:16.208076 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.217615 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:16.201647 15760 leader_election.cc:336] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.850s (SENT)
I20260709 13:07:16.209867 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.257381 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:16.262549 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 111114us
I20260709 13:07:16.262480 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:16.263056 15789 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.218914 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.264016 15717 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:16.215186 15791 rpcz_store.cc:269] 0709 13:07:14.514838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.514965 (+   127us) service_pool.cc:224] Handling call
0709 13:07:15.739229 (+1224264us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:16.152993 (+413764us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8801024}
I20260709 13:07:16.216655 19607 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.219887 16330 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:16.204764 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.229147 15794 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:16.230463 15646 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:16.171867 19443 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.170713 19530 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.231701 15793 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:16.271538 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:16.272192 19443 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.272634 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.273066 19530 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.273851 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.232074 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.274895 15719 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:16.235730 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.239034 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.240516 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.241261 19610 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:16.242201 19596 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.237027 19551 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:16.243840 19606 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:16.240528 19608 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.247751 19408 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:16.248631 19579 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.249861 19604 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.220319 19598 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.252250 19449 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.232718 19600 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:16.231690 19569 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:07:16.258967 15641 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:16.205811 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.261129 15722 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:16.230412 19609 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.230053 19574 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.277398 15644 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:16.278168 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:16.278090 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.278875 15787 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.279034 15716 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:16.276298 15721 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:16.274526 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2461) took 1594 ms. Trace:
I20260709 13:07:16.274544 15794 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.298771 15645 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:16.258939 19522 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.230556 19296 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.264127 19532 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.264771 19381 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.265586 15638 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:16.408882 16298 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.547s (SENT) [suppressed 22 similar messages]
I20260709 13:07:16.445971 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 458) took 1802 ms. Trace:
I20260709 13:07:16.446480 15640 rpcz_store.cc:276] 0709 13:07:14.643419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.684851 (+ 41432us) service_pool.cc:224] Handling call
0709 13:07:16.445699 (+1760848us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002675d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.445902 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3605419264}
I20260709 13:07:16.447131 19480 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:16.452176 15718 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:16.453351 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2458) took 1774 ms. Trace:
I20260709 13:07:16.453836 15794 rpcz_store.cc:276] 0709 13:07:14.679166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.274142 (+1594976us) service_pool.cc:224] Handling call
0709 13:07:16.274392 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.453110 (+178718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.453297 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.310264 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.447933 15639 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:16.449589 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.450222 15715 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.306231 19596 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.450675 15793 rpcz_store.cc:276] 0709 13:07:14.680003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.273593 (+1593590us) service_pool.cc:224] Handling call
0709 13:07:16.274476 (+   883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.341866 15791 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.458458 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2459) took 1779 ms. Trace:
W20260709 13:07:16.458875 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 212031us
I20260709 13:07:16.459138 15791 rpcz_store.cc:276] 0709 13:07:14.679431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.302723 (+1623292us) service_pool.cc:224] Handling call
0709 13:07:16.341570 (+ 38847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.458093 (+116523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.458359 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.451386 15795 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:16.455314 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.460060 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 333415us
I20260709 13:07:16.461443 15720 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:16.461432 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:16.382375 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 551) took 1840 ms. Trace:
W20260709 13:07:16.448108 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 246477us
I20260709 13:07:16.467268 15789 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:16.464588 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:16.468848 19480 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.342411 19560 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.475056 15789 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.471686 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:16.471236 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.475750 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2471) took 1288 ms. Trace:
I20260709 13:07:16.477144 15789 rpcz_store.cc:276] 0709 13:07:15.187410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.474616 (+1287206us) service_pool.cc:224] Handling call
0709 13:07:16.474906 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.475471 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.475672 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.423575 19606 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.473814 15791 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:16.474412 15715 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:16.486001 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2467) took 1666 ms. Trace:
I20260709 13:07:16.486435 15791 rpcz_store.cc:276] 0709 13:07:14.819719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.460181 (+1640462us) service_pool.cc:224] Handling call
0709 13:07:16.473502 (+ 13321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.485767 (+ 12265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.485952 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.479034 15794 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.311981 19551 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.451870 19493 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.470289 19545 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.483577 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:16.466950 15792 rpcz_store.cc:276] 0709 13:07:14.542092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.542338 (+   246us) service_pool.cc:224] Handling call
0709 13:07:16.381650 (+1839312us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:16.381870 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.382051 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.382074 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.382112 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:16.382144 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.382196 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.382316 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5850880}
I20260709 13:07:16.487731 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2460) took 1808 ms. Trace:
I20260709 13:07:16.500813 15794 rpcz_store.cc:276] 0709 13:07:14.679708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.461896 (+1782188us) service_pool.cc:224] Handling call
0709 13:07:16.478807 (+ 16911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.487491 (+  8684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.487680 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.501948 15791 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:16.491739 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2462) took 1809 ms. Trace:
I20260709 13:07:16.504163 15793 rpcz_store.cc:276] 0709 13:07:14.682664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.464934 (+1782270us) service_pool.cc:224] Handling call
0709 13:07:16.491222 (+ 26288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.491435 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.491460 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.491503 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.491538 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.491589 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.491686 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.503862 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:16.482035 15787 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:16.495616 15788 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:07:16.492338 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.494596 19408 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:16.506707 19529 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:16.462203 19574 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.542608 15718 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:16.544126 19574 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.277796 19607 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.476786 19615 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.544911 19615 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.545368 19615 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.546242 19607 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.547055 19622 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.547528 19622 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.547899 19622 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.548343 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.474871 19560 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:16.499944 19545 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.550648 19545 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.550477 19560 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.551863 19560 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.508855 19408 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.554313 19533 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:16.555078 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.555480 19408 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.513041 15794 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:16.513844 19517 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:16.514688 19616 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:16.456667 19532 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.516553 19600 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.465188 19596 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.516798 19565 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.505363 19610 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:16.522014 19539 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.465047 19608 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.495039 19606 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.469444 19480 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.524019 15793 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:16.424046 19603 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.530305 19528 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.497154 19520 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:16.496860 19530 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.531746 19492 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.537513 15790 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:16.538226 19478 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:16.539211 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.555533 19609 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.496838 15795 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:16.542133 19381 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.457095 19598 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.512187 15792 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [6.4-9.5]
I20260709 13:07:16.593896 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.562928 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:16.563630 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.594564 15793 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:16.564354 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:16.591867 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 857) took 1922 ms. Trace:
I20260709 13:07:16.472100 19579 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:16.566828 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.598766 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.602258 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.585034 19530 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:16.572613 19533 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:16.579026 19565 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.570034 19569 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.539563 19296 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.594605 16330 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:16.614815 19480 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:16.586866 19517 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.615341 19517 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:16.615484 19576 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.615918 19576 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:16.595813 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:16.616294 19606 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.616516 16334 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.616204 19517 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.616684 19576 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.618325 19576 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.589944 19623 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.614071 19598 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.614393 19569 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.621662 19532 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.596939 19621 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:16.621542 19522 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.646524 19533 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.601222 19520 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:16.622453 19400 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.626266 19448 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.618374 19608 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.647831 19520 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:16.648929 19520 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.650225 19520 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.611389 19530 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.623034 19546 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.655218 19519 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.655896 19449 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.658259 19449 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:16.658860 19579 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.659353 19449 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.660689 19449 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.661154 19603 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.661613 19569 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:16.665804 19528 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.656039 19575 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.659933 19596 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.673908 19522 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.659922 19615 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.678584 19530 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.679092 19615 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.680121 19604 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.680807 19530 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:16.670784 19623 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.689181 19623 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:16.689280 19622 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.691439 19622 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:16.726594 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 255225us
I20260709 13:07:16.729883 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:16.734359 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 259037us
I20260709 13:07:16.570137 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.737789 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1829) took 1549 ms. Trace:
I20260709 13:07:16.738479 15643 rpcz_store.cc:276] 0709 13:07:15.188088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.324846 (+136758us) service_pool.cc:224] Handling call
0709 13:07:15.330159 (+  5313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.217912 (+887753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.217942 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.230383 (+ 12441us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.478157 (+247774us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:16.478193 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.478262 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.737159 (+258897us) raft_consensus.cc:1685] finished
0709 13:07:16.737198 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.737549 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22640,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":1069066,"threads_started":2,"wal-append.queue_time_us":326936}
I20260709 13:07:16.739967 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:16.740839 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.569156 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:16.742353 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:16.742826 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.743306 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 174142us
I20260709 13:07:16.736760 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.744271 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.745852 15722 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:16.747013 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.747727 15714 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:16.748946 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.749172 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.589843 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.750990 15715 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:16.751251 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.751977 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.752535 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.749356 15719 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:16.756913 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.733448 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:16.758369 15647 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:07:16.587594 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:16.760552 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 172848us
I20260709 13:07:16.762705 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1818) took 2827 ms. Trace:
W20260709 13:07:16.763264 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.557271 15760 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.841s (SENT)
I20260709 13:07:16.608228 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.764801 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:16.765431 15792 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:16.753562 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.766753 15715 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.767423 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 210146us
I20260709 13:07:16.767933 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.769481 15792 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:16.770817 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.763290 15639 rpcz_store.cc:276] 0709 13:07:13.935361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.986896 (+ 51535us) service_pool.cc:224] Handling call
0709 13:07:15.270694 (+1283798us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:16.447748 (+1177054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.455975 (+  8227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.762058 (+306083us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002675d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.762436 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736382592}
I20260709 13:07:16.771493 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.772387 15791 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:16.772477 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:16.773530 15792 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:16.609380 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:16.777463 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.777817 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:16.779188 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.576148 15794 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 13:07:16.780380 16332 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:16.781320 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2225) took 1163 ms. Trace:
I20260709 13:07:16.595953 16327 rpcz_store.cc:276] 0709 13:07:14.665929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.666213 (+   284us) service_pool.cc:224] Handling call
0709 13:07:15.376544 (+710331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.376775 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:16.147090 (+770315us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.286419 (+139329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.286480 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:16.286539 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.286610 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.587817 (+301207us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54002dee50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.587923 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":207572,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":405,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":1632621824,"thread_start_us":898153,"threads_started":2,"wal-append.queue_time_us":216022}
W20260709 13:07:16.781682 15788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 555) took 2177 ms (client timeout 1753 ms). Trace:
I20260709 13:07:16.592406 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:16.782356 15788 rpcz_store.cc:269] 0709 13:07:14.604376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.604558 (+   182us) service_pool.cc:224] Handling call
0709 13:07:15.375733 (+771175us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:16.781141 (+1405408us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b5400271fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.781408 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024651904}
I20260709 13:07:16.783674 15795 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:16.785640 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2227) took 1166 ms. Trace:
I20260709 13:07:16.787808 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:16.786890 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2768) took 1421 ms. Trace:
I20260709 13:07:16.800066 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.800401 15716 rpcz_store.cc:276] 0709 13:07:15.364868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.367330 (+  2462us) service_pool.cc:224] Handling call
0709 13:07:16.786440 (+1419110us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540017acd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.786644 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607347584}
I20260709 13:07:16.800984 15644 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:16.802917 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.804869 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:16.793789 15760 leader_election.cc:336] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.002s (SENT)
I20260709 13:07:16.798939 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2232) took 1177 ms. Trace:
I20260709 13:07:16.805980 15639 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:16.805922 15787 rpcz_store.cc:276] 0709 13:07:15.621081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.204568 (+583487us) service_pool.cc:224] Handling call
0709 13:07:16.798321 (+593753us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54004222d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.798575 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37679872}
W20260709 13:07:16.807593 15760 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.066s (SENT)
I20260709 13:07:16.786289 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:16.815742 15793 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:16.786031 15795 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:16.789568 16297 connection.cc:256] RPC call timeout handler was delayed by -1.6255585150000798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:07:16.791043 15790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2464) took 2049 ms (client timeout 2155 ms). Trace:
I20260709 13:07:16.868099 19408 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:16.869423 19443 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.801003 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.873179 19227 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.874384 19448 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.799564 15788 rpcz_store.cc:276] 0709 13:07:15.618882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.783784 (+1164902us) service_pool.cc:224] Handling call
0709 13:07:16.784471 (+   687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.785109 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.785153 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.785244 (+    91us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:16.785302 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.785385 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.785534 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.804883 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.787022 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:16.773954 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.798183 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:16.875909 19449 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:16.798424 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.788239 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:16.815582 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:16.835647 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.876149 19463 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:16.781829 15794 rpcz_store.cc:276] 0709 13:07:15.618155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.557022 (+938867us) service_pool.cc:224] Handling call
0709 13:07:16.575907 (+ 18885us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:16.780449 (+204542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.781022 (+   573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.877594 19474 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.878576 19517 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.850234 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 93562.1us
I20260709 13:07:16.846210 19400 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:16.882220 15722 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:16.886701 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2226) took 1265 ms. Trace:
I20260709 13:07:16.887928 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:16.887826 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2236) took 1260 ms. Trace:
W20260709 13:07:16.896009 16297 connection.cc:256] RPC call timeout handler was delayed by -1.1015024109999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260709 13:07:16.895627 15793 rpcz_store.cc:276] 0709 13:07:15.618533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.779191 (+1160658us) service_pool.cc:224] Handling call
0709 13:07:16.786569 (+  7378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.883588 (+ 97019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.883819 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.902271 15645 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:16.904414 19546 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.905061 19574 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.905228 19546 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.906481 15643 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:16.907828 19530 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.908046 19596 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.908631 19530 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:16.911013 19604 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.908612 19546 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:16.912014 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.892953 19529 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:16.905810 19574 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:16.915184 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2770) took 1548 ms. Trace:
W20260709 13:07:16.930763 16297 connection.cc:256] RPC call timeout handler was delayed by -1.014202411000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
I20260709 13:07:16.915235 19449 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:16.910379 19619 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.918087 19443 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.919210 19576 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.923305 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.926810 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.910521 19530 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.909229 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:16.908713 19596 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:16.888326 19448 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.897684 15795 rpcz_store.cc:276] 0709 13:07:15.624357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.784779 (+1160422us) service_pool.cc:224] Handling call
0709 13:07:16.785414 (+   635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.883114 (+ 97700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.884447 (+  1333us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:16.882699 15790 rpcz_store.cc:269] 0709 13:07:14.741934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.639901 (+897967us) service_pool.cc:224] Handling call
0709 13:07:16.790395 (+1150494us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400271ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:16.790710 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878995200}
I20260709 13:07:16.936483 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.938398 15611 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.934160 15716 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:16.937996 15715 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:16.942704 19238 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.943197 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:16.943248 19238 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.944058 19238 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.944478 19620 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.946286 19636 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:16.947688 19608 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.948282 19608 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.948798 19608 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.936779 19619 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:16.955749 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 169746us
I20260709 13:07:16.940424 19596 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.936507 19576 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.933984 19574 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.957872 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.941425 19448 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.957697 15791 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:16.964732 15792 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.963001 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.945369 19620 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.963248 15722 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:16.965826 15715 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8. Re-sending same reply.
I20260709 13:07:16.964110 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:16.969185 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 171266us
I20260709 13:07:16.970713 19623 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:16.992353 15717 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:16.971377 19045 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.996294 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:16.978008 19408 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:17.000222 15759 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:17.000744 19408 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:16.978955 15719 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:16.964954 19610 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:17.002221 19610 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.002744 19610 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.003014 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.004141 19480 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:17.004415 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.004585 19480 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:17.005012 19480 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.979398 19555 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.979875 19603 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.006821 19408 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.007205 19545 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.006830 19555 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:17.008617 19555 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.946997 19636 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.985880 15720 raft_consensus.cc:2376] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10. Re-sending same reply.
I20260709 13:07:17.012421 19636 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.013408 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.005574 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.015116 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:16.964777 19227 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.017696 16325 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.023070 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:17.024051 16328 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:17.025684 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:17.026767 16329 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:17.018250 19620 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.027837 19583 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:16.980340 16334 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:16.971627 19449 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:16.931859 15713 rpcz_store.cc:276] 0709 13:07:15.366606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.366740 (+   134us) service_pool.cc:224] Handling call
0709 13:07:15.367040 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.367380 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:15.398655 (+ 31275us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.643420 (+244765us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.741699 (+ 98279us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:16.794426 (+1052727us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b2c000108d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:16.795286 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.795558 (+   272us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:16.795631 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.795727 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.914760 (+119033us) raft_consensus.cc:1685] finished
0709 13:07:16.914785 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.914996 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12661,"prepare.queue_time_us":712790,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":13215,"raft.run_cpu_time_us":3591,"raft.run_wall_time_us":416166,"spinlock_wait_cycles":86843136,"thread_start_us":246198,"threads_started":2,"wal-append.queue_time_us":769402}
I20260709 13:07:17.036115 16331 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:17.037133 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.038147 15713 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:07:16.985525 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76452.1us
I20260709 13:07:16.992656 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.039412 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.040102 15713 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:17.039939 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:17.041201 19400 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.970559 19529 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.042246 15722 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:16.992795 19623 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:16.993433 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:17.042676 15722 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:16.993065 19463 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:16.963559 19576 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.996837 19443 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:16.972318 19579 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:17.020398 16325 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:17.046285 19579 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:16.997995 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:16.999292 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:17.007310 19603 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.048259 15719 raft_consensus.cc:2368] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:16.960844 19619 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.049453 15759 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:17.051056 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:17.047549 19579 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.051785 16330 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:17.051440 15722 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.053831 19569 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:17.054329 15722 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.054680 19569 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:17.020426 19227 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.997905 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.056007 19569 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.056346 19227 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.057880 19636 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:17.058655 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:17.059059 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:17.061015 19533 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.061880 19533 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.058593 19636 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.063331 19533 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.016023 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:17.081135 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 59483.2us
I20260709 13:07:17.041576 15713 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.082684 15713 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.083875 15719 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.084216 15717 raft_consensus.cc:2410] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:07:17.085073 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.090536 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50781us
I20260709 13:07:17.096107 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2472) took 1882 ms. Trace:
I20260709 13:07:17.096596 15789 rpcz_store.cc:276] 0709 13:07:15.206769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.477947 (+1271178us) service_pool.cc:224] Handling call
0709 13:07:16.478401 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.482412 (+  4011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.482445 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.497458 (+ 15013us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.985783 (+488325us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.985851 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.985956 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.081615 (+ 95659us) raft_consensus.cc:1685] finished
0709 13:07:17.081642 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.088837 (+  7195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7726,"raft.queue_time_us":8177,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4161,"thread_start_us":386927,"threads_started":1,"wal-append.queue_time_us":524871}
I20260709 13:07:17.100628 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:17.102298 16298 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.618s (SENT)
I20260709 13:07:17.101584 15720 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:17.097870 19620 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:17.108320 19621 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.108814 19621 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.109172 19621 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.109441 19238 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.111904 19238 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:17.061162 19603 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.124806 15719 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:17.131283 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:17.093812 19545 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.131385 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.140008 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.149092 15716 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.146149 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:17.155956 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.159291 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.143366 19604 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.168114 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.166214 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.167510 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.166929 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.173867 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.175892 15715 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:17.174177 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.166102 15713 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:17.176520 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 62675us
I20260709 13:07:17.176301 15715 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.179994 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:17.180526 19570 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:17.159101 19238 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.181677 19238 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.169446 19443 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:17.183081 19443 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:17.183867 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.184190 19443 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.181164 16330 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:17.185961 19400 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:17.184772 15717 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:17.186705 19400 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.187551 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.184046 19238 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:17.190066 15789 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.190918 15717 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:07:17.179803 15545 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 2 to 5, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 5 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:17.198519 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.203191 15794 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:17.207576 15714 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:17.203250 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97985.2us
I20260709 13:07:17.209327 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:17.209853 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.212168 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 59627.2us
I20260709 13:07:17.216566 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.217638 15722 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:17.222306 15720 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:17.221226 19520 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.003s
I20260709 13:07:17.227540 15716 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:17.227842 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:17.228870 19551 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.726s	user 0.014s	sys 0.000s
I20260709 13:07:17.229282 19545 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:17.230121 16298 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.753s (SENT)
I20260709 13:07:17.231809 19596 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.233834 19546 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:17.236143 19514 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:17.234076 15713 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.236608 19514 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:17.238005 19514 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.239600 19514 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.208510 19636 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.242043 15715 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.242450 19448 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.243355 15715 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.243249 19608 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.245137 19448 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.248226 19608 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:17.251535 19644 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:17.252023 15713 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:17.254326 19623 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.220585 15719 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:17.267599 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:17.267710 19555 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.268715 16330 raft_consensus.cc:2368] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:17.269923 19623 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.271134 15759 leader_election.cc:400] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
I20260709 13:07:17.271628 15759 leader_election.cc:403] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:17.272468 19517 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.273044 19517 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:17.265759 19570 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:17.274124 19570 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.274075 19517 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.276904 19238 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:17.277320 19238 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:17.278209 19238 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.265437 19603 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:07:17.279913 19238 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.280572 19539 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:17.280927 19539 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.281911 19539 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.281720 15720 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:17.285429 15720 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.290517 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:17.292657 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.294060 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:17.295182 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:17.302150 19624 raft_consensus.cc:2764] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:17.303470 19624 raft_consensus.cc:2764] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:17.229410 19551 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:17.306524 19575 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.010s
I20260709 13:07:17.306605 15721 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.307749 19551 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.297528 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:17.321272 15796 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:17.284312 19539 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.344280 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46865.2us
W20260709 13:07:17.348062 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 170883us
I20260709 13:07:17.260206 19574 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.349205 15715 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:17.351085 15715 pending_rounds.cc:85] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 4
I20260709 13:07:17.321483 19555 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.394078 15545 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.362390 19599 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.372153 15716 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.378463 19400 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.379522 19619 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.380949 19596 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.382191 15720 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.382632 19519 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:17.384831 19574 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.379565 19570 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8.
W20260709 13:07:17.387627 15542 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 274) took 19027 ms (client timeout 15000 ms). Trace:
I20260709 13:07:17.391873 19576 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.392750 19227 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:17.364312 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.346232 19604 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:17.349566 19575 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.358913 15715 pending_rounds.cc:107] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:17.397548 15545 catalog_manager.cc:5697] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 4, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 4 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:17.428647 15715 raft_consensus.cc:2889] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.421883 19519 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:17.430850 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.435304 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:17.418893 19610 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.464850 15720 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.462502 15545 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 4 to 5, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 5 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.429903 19519 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:17.427834 19575 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:17.468693 19619 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.470551 16297 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:17.479159 15545 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 1 to 3, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 3 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:07:17.481082 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.481308 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.483943 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:17.486280 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:17.480934 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.488435 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:17.493770 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:17.494580 15639 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.420414 15542 rpcz_store.cc:269] 0709 13:06:58.365298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.380887 (+ 15589us) service_pool.cc:224] Handling call
0709 13:07:17.387259 (+19006372us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:14.282518 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:14.283199 (+   681us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:14.283238 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:14.283250 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:14.284469 (+  1219us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:14.284548 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:14.284565 (+    17us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:07:14.285535 (+   970us) tablet.cc:701] Row locks acquired
0709 13:07:14.285576 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:07:14.285708 (+   132us) write_op.cc:270] Start()
0709 13:07:14.285979 (+   271us) write_op.cc:276] Timestamp: P: 1783602434285655 usec, L: 0
0709 13:07:14.286004 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:14.286783 (+   779us) log.cc:844] Serialized 7033 byte log entry
0709 13:07:15.111867 (+825084us) op_driver.cc:464] REPLICATION: finished
0709 13:07:15.319936 (+208069us) write_op.cc:301] APPLY: starting
0709 13:07:15.320069 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:15.320657 (+   588us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:15.320826 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:15.381276 (+ 60450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:15.381786 (+   510us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:07:15.381836 (+    50us) write_op.cc:312] APPLY: finished
0709 13:07:15.382267 (+   431us) log.cc:844] Serialized 125 byte log entry
0709 13:07:15.383230 (+   963us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:15.383406 (+   176us) write_op.cc:454] Released schema lock
0709 13:07:15.383480 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:15.463963 (+ 80483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:15.463995 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":183091,"apply.run_cpu_time_us":5550,"apply.run_wall_time_us":68821,"num_ops":18,"prepare.queue_time_us":407746,"prepare.run_cpu_time_us":44615,"prepare.run_wall_time_us":89960,"raft.queue_time_us":446961,"raft.run_cpu_time_us":73718,"raft.run_wall_time_us":235522,"replication_time_us":785836,"thread_start_us":513488,"threads_started":4,"wal-append.queue_time_us":140884,"wal-append.run_cpu_time_us":26686,"wal-append.run_wall_time_us":1966264}]]}
I20260709 13:07:17.488502 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.501691 15716 raft_consensus.cc:2393] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:17.502313 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68884.9us
I20260709 13:07:17.505187 19400 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.506445 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.507117 15719 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:17.507997 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.508831 15713 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:17.508399 19519 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.511368 15643 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:17.512290 15721 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 6: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:17.417892 19599 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.497219 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:17.515746 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:17.517015 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69986.2us
I20260709 13:07:17.481896 19575 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.484684 19574 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.522454 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.523355 15719 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:17.434115 19604 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.524348 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.526100 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.524574 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.548709 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.551396 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:17.553792 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 197200us
I20260709 13:07:17.555271 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.555984 15719 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.524220 19545 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.561304 15716 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:17.525312 19574 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.560276 15796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 556) took 2946 ms (client timeout 1850 ms). Trace:
I20260709 13:07:17.564394 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:17.491473 19621 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.569347 15722 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:17.565976 15796 rpcz_store.cc:269] 0709 13:07:14.613540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.613792 (+   252us) service_pool.cc:224] Handling call
0709 13:07:15.340031 (+726239us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:17.547627 (+2207596us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:17.560155 (+ 12528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3974868608}
I20260709 13:07:17.520543 19514 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:07:17.571470 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.550490 19227 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.579522 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.580219 15721 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:17.560591 19619 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.563509 19569 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.595669 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.601046 15716 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:17.567901 19574 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:17.605441 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 108332us
I20260709 13:07:17.574717 19519 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:17.610756 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 112075us
I20260709 13:07:17.597725 19619 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.620900 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.621690 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.602568 19596 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.599468 19546 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:07:17.640542 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 179197us
I20260709 13:07:17.623934 19619 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.628556 19596 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.636173 19480 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.631s	user 0.015s	sys 0.002s
W20260709 13:07:17.667130 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.669124 15639 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:17.633993 19576 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:17.681645 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.687674 15715 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:17.667150 19596 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.701578 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 68366.3us
I20260709 13:07:17.698773 15721 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:17.705509 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 235138us
W20260709 13:07:17.705875 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.706395 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.678293 19610 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:17.677588 19517 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:17.715044 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.673401 19480 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.754181 19621 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.741869 19662 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:07:17.755573 19662 consensus_queue.cc:1059] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:17.759928 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:17.762189 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65274.5us
I20260709 13:07:17.763052 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:17.763399 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:17.764407 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:17.765223 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:17.770404 19648 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:17.772135 15719 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:17.773049 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.773279 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.774430 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.774984 15714 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.775804 19599 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.776635 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.774462 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.777874 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.778635 15717 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:17.778898 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.779389 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.779953 15717 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:17.780366 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.782776 19608 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:17.783228 19608 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.783597 19608 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:17.784358 19650 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:17.785486 19579 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:17.786855 19646 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.426s	user 0.001s	sys 0.002s
I20260709 13:07:17.789247 19636 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:17.789896 19636 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.792521 15713 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:17.794240 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.795126 15713 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:17.795960 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.796974 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:17.801415 19560 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:17.801988 19560 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:17.803037 19560 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.804163 19560 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.785612 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 575) took 1238 ms. Trace:
I20260709 13:07:17.809063 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:17.779965 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:17.812875 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:17.709424 19659 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.814046 15719 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:17.797546 15713 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:17.811604 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 136452us
I20260709 13:07:17.807925 15718 rpcz_store.cc:276] 0709 13:07:16.547436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.548022 (+   586us) service_pool.cc:224] Handling call
0709 13:07:17.785258 (+1237236us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400119ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:17.785446 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096904960}
I20260709 13:07:17.679857 19545 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:17.742738 19604 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:17.851814 15643 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 13:07:17.852995 15639 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:07:17.858192 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 92542us
I20260709 13:07:17.824383 19610 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:17.879832 19610 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.880589 19659 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:17.884335 19663 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.884968 19663 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:17.828787 19599 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:17.894976 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.891009 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 82032.5us
I20260709 13:07:17.881197 19659 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:17.905270 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 45738.6us
I20260709 13:07:17.924085 15714 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:17.926620 19551 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:17.927776 19551 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:17.928216 19551 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:17.931404 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:17.932286 15796 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:17.933336 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:17.934752 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:17.858506 19408 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:17.938072 19408 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.935768 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.940315 15792 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:17.937354 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.935691 19663 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.936691 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:17.937114 19651 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.826586 19517 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:17.989228 15713 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:17.990109 15794 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:07:17.990952 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.995663 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53054.8us
I20260709 13:07:17.999332 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:17.994146 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:18.004347 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 261775us
I20260709 13:07:17.937280 19575 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:18.010897 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.929307 19551 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:18.022323 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.021944 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.031993 15639 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:18.042486 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.044414 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:18.028064 19663 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.023490 19636 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.099848 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.100834 16330 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.071267 16332 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.073515 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:18.084120 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.092442 19449 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.070387 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:18.106052 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.113664 15714 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:18.009568 19608 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.112247 16325 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:18.096752 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.120108 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.038585 19610 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:18.038726 19539 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:18.131959 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.133244 15644 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:18.132853 19449 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:18.133914 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.134886 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.135329 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:18.135669 19608 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.133860 15714 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:18.136615 15641 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:18.136857 15713 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:18.137221 15713 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:18.137794 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.138607 16334 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:18.139091 16331 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
W20260709 13:07:18.143263 19574 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.004s
I20260709 13:07:18.143792 19574 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:18.149607 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.150254 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 145236us
W20260709 13:07:18.159658 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.161077 15643 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:18.154636 16329 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:18.168730 15639 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:18.097301 19529 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:18.184027 15720 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 13:07:18.194789 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.202251 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.202404 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:18.203055 15643 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:18.196933 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 227662us
I20260709 13:07:18.202344 15720 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:18.210645 15722 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:18.211385 19683 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.211990 19683 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:18.214752 15688 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.672s (SENT)
I20260709 13:07:18.215260 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:18.215998 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.216439 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:18.218755 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:18.219671 15791 raft_consensus.cc:606] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:18.220151 15791 raft_consensus.cc:614] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.202700 19636 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.222493 19636 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:18.224948 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:18.202913 19621 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:07:18.226152 15791 raft_consensus.cc:606] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:18.226697 15791 raft_consensus.cc:614] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.162972 19539 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.231141 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:18.232128 15791 raft_consensus.cc:606] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:07:18.232667 15791 raft_consensus.cc:614] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.233978 15713 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.236739 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:18.237684 15791 raft_consensus.cc:606] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:18.246766 15639 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:07:18.250000 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.256263 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.241257 15717 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:18.264014 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:18.249145 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.248291 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.266803 15639 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.157913 19480 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:18.173530 19551 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:18.273721 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 236181us
I20260709 13:07:18.276029 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.277503 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.188402 19519 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.187829 19529 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:18.281687 16327 raft_consensus.cc:2410] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:18.286178 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.296098 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.298491 15640 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [6.4-9.5]
I20260709 13:07:18.261343 19621 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:18.299407 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.299981 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:18.300776 15644 raft_consensus.cc:2368] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:07:18.302052 16329 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.302150 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.302969 15639 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.277549 19604 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.285845 19608 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.288393 19574 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.293046 19529 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.328675 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.279654 19668 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:07:18.308926 19636 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:18.295635 19599 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:18.338392 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.333833 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.353355 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:18.322480 19604 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:18.353837 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 59531.9us
I20260709 13:07:18.355412 15640 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.326998 19517 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:18.371603 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.374322 19449 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:18.371661 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.376319 16328 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.322769 19480 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:18.386122 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:18.387140 15720 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:18.327615 19400 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:18.383424 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.384974 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.385193 16297 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:18.390946 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:18.382639 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.352413 19574 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.332043 19680 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.325479 19608 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.337854 19659 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:18.405153 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:18.408721 16334 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.355381 19636 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.411322 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:18.412853 15717 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.417366 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:18.418507 15715 raft_consensus.cc:2368] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9.
I20260709 13:07:18.393669 19555 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:18.352267 19576 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:07:18.421654 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 102284us
I20260709 13:07:18.422080 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:18.426198 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.434151 15640 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.437657 15639 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:18.429327 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:18.430495 16328 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:18.332149 19667 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:07:18.393078 19683 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.440593 16326 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:18.458642 16330 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:18.444686 16332 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:18.461710 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 242545us
I20260709 13:07:18.463450 16298 leader_election.cc:400] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9.
I20260709 13:07:18.463743 16298 leader_election.cc:403] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:18.411973 19636 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:18.464756 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 79664us
I20260709 13:07:18.406029 19680 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.469359 15717 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:18.465008 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.469594 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.469607 16325 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:18.472194 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 65302us
I20260709 13:07:18.402926 19684 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:07:18.442116 19662 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.419561 19400 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:18.465348 19659 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:18.487257 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.534261 19659 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:18.534047 19662 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:18.535274 16334 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:18.536674 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.460072 19619 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.000s
I20260709 13:07:18.473140 19636 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.574662 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:18.463238 19596 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.006s
W20260709 13:07:18.534530 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.585508 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.580745 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 217017us
I20260709 13:07:18.471935 19680 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.515131 19443 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.567423 19652 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:18.468200 19555 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:18.471927 19546 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9.
W20260709 13:07:18.593875 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.535416 19659 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:18.563925 19599 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:18.602569 19408 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:18.637945 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:18.591758 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.432085 19574 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.641924 19676 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:18.642935 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.645853 15715 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:18.573956 19619 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.649641 19620 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:18.668267 16329 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:18.662869 15715 pending_rounds.cc:85] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 4
I20260709 13:07:18.670799 15715 pending_rounds.cc:107] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:18.671079 15715 raft_consensus.cc:2889] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:18.671869 15643 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:18.664017 15642 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.662535 15639 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:18.672914 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 136705us
W20260709 13:07:18.681301 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.611169 16297 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:18.564069 19604 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.588752 19596 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.725700 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.658237 19443 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:18.578517 19682 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
W20260709 13:07:18.737310 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 224196us
I20260709 13:07:18.738868 19400 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:18.741027 19685 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
W20260709 13:07:18.742803 19688 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:07:18.742657 19529 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.745270 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.745092 19555 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:18.746076 19529 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.746572 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.747802 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.748495 15642 raft_consensus.cc:2368] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
W20260709 13:07:18.748914 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 160819us
I20260709 13:07:18.593559 19696 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:07:18.760964 15647 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.763664 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1850) took 1004 ms. Trace:
I20260709 13:07:18.764087 15647 rpcz_store.cc:276] 0709 13:07:17.758984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.764836 (+  5852us) service_pool.cc:224] Handling call
0709 13:07:18.763429 (+998593us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54001beed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:18.763597 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2282632576}
I20260709 13:07:18.766812 19608 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.763911 19596 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.767952 15640 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:18.768738 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:18.771066 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.770994 15643 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:18.773217 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.772143 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:18.779269 15639 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:18.780350 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.804666 15647 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:18.807435 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.773689 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:18.808552 15642 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.810079 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:18.815660 15534 maintenance_manager.cc:419] P 309d6534a0164bf3ab5f6a8a7f6a5a65: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033392
I20260709 13:07:18.816993 19684 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.817564 19684 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:18.817848 19697 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:18.818017 19684 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.819139 16297 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:18.714578 19676 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:18.823722 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.824609 15643 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:18.807363 19560 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.003s	user 0.016s	sys 0.000s
I20260709 13:07:18.822644 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.836030 15641 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.837697 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:18.837368 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 402427us
I20260709 13:07:18.839015 15639 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.842206 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.842816 16331 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:18.822480 19676 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:18.773412 19599 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:18.843003 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:18.854482 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.855708 15639 raft_consensus.cc:2368] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
W20260709 13:07:18.860230 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.830185 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.863211 15647 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.864434 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:18.875370 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.878376 15647 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:18.880059 15647 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:18.881687 15647 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:18.883143 15647 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.884557 15647 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:18.892746 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.894618 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:18.895991 15640 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:18.855434 19676 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.857709 19682 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.906536 15643 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:18.912856 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:18.908241 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:18.875707 19636 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.146574 15791 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:19.146898 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:19.153918 15790 raft_consensus.cc:1813] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Handling vote request from an unknown peer 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:19.016337 15642 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:19.010041 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:19.156073 15639 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:19.010434 19663 consensus_meta.cc:287] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.002s
W20260709 13:07:18.963569 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.176891 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.155649 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.167758 15642 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.154839 15787 raft_consensus.cc:2376] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:19.171196 15794 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:19.173941 15790 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:19.146929 19687 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
W20260709 13:07:18.955713 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.179782 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.180455 15638 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.005s
I20260709 13:07:19.181674 15643 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:18.955550 19689 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 13:07:19.147941 19701 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.182300 15638 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:19.182045 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.915282 19675 raft_consensus.cc:2764] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:19.010818 19708 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.189133 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.009104 19706 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:19.136579 19443 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:19.193051 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.093945 19574 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:19.191668 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.144178 19529 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.191994 15638 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:19.006564 19704 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:19.051631 19619 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:19.200927 15640 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:19.202678 15643 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:19.194756 19663 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.006397 19711 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:19.201120 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:19.006142 19698 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.449s
I20260709 13:07:19.213411 15647 raft_consensus.cc:1813] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Handling vote request from an unknown peer 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:19.227892 15647 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:19.188043 19668 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.199811 19700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.006s
W20260709 13:07:19.146277 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:19.224941 15642 raft_consensus.cc:2376] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:19.167536 19682 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:19.230370 19663 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.239019 19682 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.240612 19663 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:19.241840 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.225646 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 406598us
I20260709 13:07:19.233825 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:19.231096 15529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 101797us
I20260709 13:07:19.233806 19714 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.203894 19706 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:19.237752 19695 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 13:07:19.237901 19704 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.238579 15642 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:07:19.230221 19700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.009s	sys 0.006s
I20260709 13:07:19.210544 19683 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.245152 15643 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:19.251541 15644 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 13:07:19.252978 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.255895 15644 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:19.256768 15638 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:19.242444 19713 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:19.260618 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:19.265336 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:19.257576 19691 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 13:07:19.301646 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.272886 15643 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
W20260709 13:07:19.296622 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 397234us
I20260709 13:07:19.304826 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.305701 15638 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:19.223662 19529 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.309360 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.310213 15642 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:19.217548 19708 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.308575 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:19.315109 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 133622us
I20260709 13:07:19.317560 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.326514 15647 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:19.263797 19711 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:19.248270 19668 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:19.328078 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 195711us
I20260709 13:07:19.269426 19551 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:19.269256 19713 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:19.395375 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.397038 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 599) took 1575 ms. Trace:
I20260709 13:07:19.304144 19619 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:19.254741 19714 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.263921 19683 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:19.370103 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.397606 15719 rpcz_store.cc:276] 0709 13:07:17.821276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.973257 (+151981us) service_pool.cc:224] Handling call
0709 13:07:17.995859 (+ 22602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.265440 (+269581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.265489 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.283179 (+ 17690us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.422203 (+139024us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.422239 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.422299 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.396770 (+974471us) raft_consensus.cc:1685] finished
0709 13:07:19.396790 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.396965 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8867,"raft.queue_time_us":27360,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1603,"thread_start_us":363736,"threads_started":2,"wal-append.queue_time_us":233213}
I20260709 13:07:19.340777 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:19.314873 19651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.278s	user 0.009s	sys 0.012s
I20260709 13:07:19.494921 15642 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:19.494540 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 163380us
I20260709 13:07:19.500550 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.525363 15638 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
W20260709 13:07:19.492079 19721 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:07:19.532708 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:19.510905 19651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.009s	sys 0.013s
I20260709 13:07:19.541987 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:19.492260 19701 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:19.492583 19720 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:19.300513 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet b106b4017dc84b21a7c6f58814593886 with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:53344
W20260709 13:07:19.560155 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.547335 15638 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:19.523331 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 214817us
W20260709 13:07:19.566771 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.402765 19551 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.542728 19729 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.584095 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:19.499557 19619 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.581169 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:19.544588 19692 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:19.604163 15792 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:19.545859 19723 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:19.547435 19651 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:19.604193 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.610298 15795 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:19.611248 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:19.613556 19710 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
I20260709 13:07:19.614085 15791 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:19.623207 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.585179 19719 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:19.625038 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.665861 15641 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.004s
I20260709 13:07:19.682902 15641 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:07:19.682927 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.683593 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2152) took 1436 ms. Trace:
W20260709 13:07:19.684108 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.624626 15788 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:19.691666 15791 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.693717 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.694752 15638 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:19.684319 15641 rpcz_store.cc:276] 0709 13:07:18.247080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.822326 (+575246us) service_pool.cc:224] Handling call
0709 13:07:19.683529 (+861203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.618773 19698 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.695492 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:19.695870 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.703917 15641 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:19.698228 19726 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.699838 19662 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:19.711615 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:19.545149 19713 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.714859 15793 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 13:07:19.542330 19706 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:19.717561 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 99213.6us
W20260709 13:07:19.723042 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.670806 19719 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:19.727979 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:19.569674 19720 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.720307 15638 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:19.726305 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:19.732637 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:19.733513 15719 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:19.707403 19698 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.624359 19692 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.740824 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:19.748876 15720 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:07:19.719094 19716 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.465s	user 0.001s	sys 0.000s
I20260709 13:07:19.737660 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.753021 15638 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:19.754501 15638 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.743412 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:19.757148 16326 raft_consensus.cc:1813] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Handling vote request from an unknown peer 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:19.758725 16326 raft_consensus.cc:2410] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:07:19.738943 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 69314.6us
W20260709 13:07:19.746474 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.750156 16333 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:19.750914 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:19.607370 19729 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.759634 16332 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:19.725629 19734 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.766718 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.739s (SENT)
I20260709 13:07:19.767361 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:19.716104 19574 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:19.749770 19698 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.725308 19725 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:19.795699 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.671664 19723 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.780742 19706 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.674574 19701 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:19.807535 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.714789 19726 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:19.810621 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.809337 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64767.8us
I20260709 13:07:19.788733 19574 consensus_queue.cc:1243] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:19.670972 19711 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:19.814731 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 80692.7us
I20260709 13:07:19.797082 19708 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:19.787492 19727 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:19.820808 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:19.825625 15789 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:19.813936 19519 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.521s	user 0.015s	sys 0.000s
I20260709 13:07:19.832242 15719 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.806701 19529 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:19.855310 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.860142 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:19.854266 19529 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.862135 19529 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.787815 19734 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.846474 19662 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:19.772250 19651 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.872025 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:19.847193 19667 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.874974 15638 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:19.852108 19519 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:19.877542 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:19.878463 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:19.880798 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118471us
I20260709 13:07:19.884495 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.885311 15638 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:19.865224 19708 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:19.890411 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69697.8us
I20260709 13:07:19.890734 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:19.891184 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:19.891865 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.763s (SENT)
I20260709 13:07:19.892308 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:19.900024 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:19.909765 15789 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:19.909667 15641 raft_consensus.cc:2376] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9. Re-sending same reply.
I20260709 13:07:19.879498 19736 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:19.883608 19551 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:19.914561 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:19.895099 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84922.4us
I20260709 13:07:19.922750 15719 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:19.924183 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:19.925004 15688 leader_election.cc:400] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 6 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7.
I20260709 13:07:19.847664 19727 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:19.883896 19747 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:19.886612 19730 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:19.935863 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44014.1us
I20260709 13:07:19.936604 15787 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:19.823921 19719 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.900451 19723 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:19.895735 19604 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:19.993701 19708 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:19.920149 19519 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.937526 19746 tablet_replica.cc:333] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:07:20.000032 16334 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:20.006522 19551 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:07:20.018113 19551 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.018875 19551 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.883745 19667 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:20.028734 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 151264us
I20260709 13:07:19.903255 19574 raft_consensus.cc:2764] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:20.025346 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 98243.2us
W20260709 13:07:19.929466 19684 consensus_meta.cc:287] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.111s	user 0.012s	sys 0.002s
I20260709 13:07:20.029724 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:20.033107 16300 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.771s (SENT)
I20260709 13:07:19.988360 19730 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.038744 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:20.030921 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 139794us
I20260709 13:07:20.039518 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:19.909245 19725 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:07:20.036613 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.037707 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.037446 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.040045 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:19.916267 19683 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:19.998376 19744 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:20.013064 19750 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.009680 19529 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.072480 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:20.073457 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.074103 16333 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:20.030158 19604 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.083983 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.074438 16332 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:20.074839 19684 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.079623 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:20.081131 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 169603us
I20260709 13:07:20.034837 19719 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.088346 16329 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:20.089602 19759 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.087239 19683 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.082127 19519 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:20.089660 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 60090.4us
I20260709 13:07:20.084501 19749 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.042191 19730 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:20.089936 19743 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:07:20.097707 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.098490 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:19.988927 19747 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:19.989342 19736 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:20.101338 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68256.1us
W20260709 13:07:20.107995 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.102123 15718 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.092355 19759 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.103847 19729 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:20.105399 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65466.1us
I20260709 13:07:20.109063 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.110608 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:20.099525 19682 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.860s	user 0.009s	sys 0.004s
I20260709 13:07:20.094395 19708 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.090881 19683 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:20.113524 19574 raft_consensus.cc:2764] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:20.078637 19756 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:20.100409 19575 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.096370 19692 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.124531 15688 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.106046 19749 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:20.131772 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.133527 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.136044 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.139534 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.113912 19759 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.084983 19744 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:20.159219 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 44463.6us
I20260709 13:07:20.168812 16330 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:20.125010 19519 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.164197 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:20.157969 19748 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:20.144460 19659 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.158128 19758 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:20.121196 19682 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:20.214212 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74743.7us
I20260709 13:07:20.216740 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:20.141834 19692 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.220465 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.095252 19750 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.189142 19574 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.113583 19755 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:07:20.225606 16327 raft_consensus.cc:2376] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11. Re-sending same reply.
I20260709 13:07:20.190788 19662 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.231020 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:20.232154 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 68075.1us
I20260709 13:07:20.159560 19729 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:07:20.242218 16327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 876) took 1868 ms (client timeout 1509 ms). Trace:
I20260709 13:07:20.242545 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.213688 19734 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:20.240089 15759 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:20.220170 19575 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.218813 19758 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:20.242686 16327 rpcz_store.cc:269] 0709 13:07:18.367656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.371193 (+  3537us) service_pool.cc:224] Handling call
0709 13:07:20.220306 (+1849113us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b5800072398. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:20.235751 (+ 15445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19589504}
I20260709 13:07:20.157675 19761 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:07:20.237896 19574 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:20.251602 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 118205us
W20260709 13:07:20.253229 19764 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:20.253729 19762 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:20.254199 19742 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:07:20.253929 19708 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:20.254474 19752 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:20.247203 19551 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.193862 19683 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.235610 19529 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:07:20.273164 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:20.262038 19739 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:07:20.266537 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.271515 19734 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:20.331403 19770 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:07:20.272528 19574 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.281459 19761 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:07:20.357617 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.277575 19762 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:20.364701 19751 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:07:20.365031 19753 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:07:20.280891 19692 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:20.384717 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 58540.6us
I20260709 13:07:20.301854 19752 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.276968 19667 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.428342 19747 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.429059 19770 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:20.430198 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 467) took 1195 ms. Trace:
I20260709 13:07:20.430492 19744 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:20.434201 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 182769us
I20260709 13:07:20.435287 19736 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:20.538159 15640 rpcz_store.cc:276] 0709 13:07:19.234518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.250164 (+ 15646us) service_pool.cc:224] Handling call
0709 13:07:19.263332 (+ 13168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.296550 (+ 33218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.296581 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.311851 (+ 15270us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.752122 (+440271us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.752177 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.752269 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.429928 (+677659us) raft_consensus.cc:1685] finished
0709 13:07:20.429955 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.430125 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":227204,"threads_started":1,"wal-append.queue_time_us":590438}
W20260709 13:07:20.415521 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 149092us
I20260709 13:07:20.301951 19772 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.326589 19727 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.370460 19551 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.556628 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 468) took 1321 ms. Trace:
I20260709 13:07:20.557055 15647 rpcz_store.cc:276] 0709 13:07:19.234845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.340558 (+105713us) service_pool.cc:224] Handling call
0709 13:07:19.501485 (+160927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.539953 (+ 38468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.539995 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.567917 (+ 27922us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.741546 (+173629us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.741603 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.741696 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.556409 (+814713us) raft_consensus.cc:1685] finished
0709 13:07:20.556430 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.556571 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":831,"raft.queue_time_us":6579,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6021,"thread_start_us":127427,"threads_started":1,"wal-append.queue_time_us":234988}
I20260709 13:07:20.546178 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:20.444860 19680 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.835s	user 0.013s	sys 0.003s
I20260709 13:07:20.538534 19684 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.443974 19762 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.540452 19770 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:20.568781 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.577418 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.263144 19749 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.555526 19734 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:20.571672 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.518951 19756 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.541983 19752 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.555292 19551 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:20.565026 15685 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:20.560045 19692 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:20.589083 15721 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:20.567425 19761 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:07:20.597892 15646 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:07:20.598093 19775 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.598299 19715 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.598526 19768 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:20.598876 19773 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:20.599176 19769 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:07:20.596692 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.600586 15721 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:20.604271 15644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2149) took 2358 ms (client timeout 1686 ms). Trace:
I20260709 13:07:20.605253 15639 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:20.585958 19776 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:20.605930 19777 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:20.606386 19765 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:07:20.588270 19756 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.606778 19735 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:20.585893 19736 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.572902 19763 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:20.610569 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1862) took 2367 ms. Trace:
I20260709 13:07:20.610906 19682 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.573028 19680 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:20.619475 15644 rpcz_store.cc:269] 0709 13:07:18.245786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.321565 (+ 75779us) service_pool.cc:224] Handling call
0709 13:07:20.603951 (+2282386us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54000aa354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:20.604137 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855167872}
I20260709 13:07:20.581509 19727 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:20.623996 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.566098 19755 consensus_queue.cc:1243] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:20.626456 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 80376.7us
I20260709 13:07:20.546687 19758 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.651168 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:20.651376 19529 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:20.651966 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.652298 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:20.652761 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:20.632134 19744 raft_consensus.cc:2764] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:20.653405 15640 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:20.635722 15717 pending_rounds.cc:85] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:07:20.659861 15717 pending_rounds.cc:107] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:20.660167 15717 raft_consensus.cc:2889] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.630290 15646 rpcz_store.cc:276] 0709 13:07:18.243498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.292977 (+ 49479us) service_pool.cc:224] Handling call
0709 13:07:20.536156 (+2243179us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:07:20.545288 (+  9132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.607495 (+ 62207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.610520 (+  3025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28839680}
I20260709 13:07:20.639880 19651 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:20.641196 19684 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:20.647722 19735 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:20.665262 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.644992 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.646556 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.651062 19758 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.675194 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:20.653541 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:20.654338 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.655057 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:20.655827 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:20.655974 19720 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.657361 19767 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.684774 19767 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:20.686179 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2172) took 2016 ms. Trace:
I20260709 13:07:20.686622 15639 rpcz_store.cc:276] 0709 13:07:18.670282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.168400 (+498118us) service_pool.cc:224] Handling call
0709 13:07:20.604808 (+1436408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.619650 (+ 14842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.685955 (+ 66305us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000aa350. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:20.686115 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3260598016}
I20260709 13:07:20.688618 19714 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.690877 15796 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:20.657881 19539 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.696874 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.698132 19779 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.700242 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:20.701450 19779 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:20.702097 19779 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:20.703117 19779 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.620257 19761 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:20.634368 19704 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.705364 19761 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:20.705895 19761 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.707904 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:20.664805 16331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 568) took 2383 ms (client timeout 2100 ms). Trace:
W20260709 13:07:20.709378 16331 rpcz_store.cc:269] 0709 13:07:18.275184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.275694 (+   510us) service_pool.cc:224] Handling call
0709 13:07:20.658543 (+2382849us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400731754. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:20.658696 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301418240}
I20260709 13:07:20.666018 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.643049 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:20.710628 15788 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:20.712460 15719 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:20.666618 19756 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.666410 19735 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.668061 19692 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.612977 19715 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.676827 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.677258 15641 raft_consensus.cc:2376] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9. Re-sending same reply.
I20260709 13:07:20.678589 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.678823 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.677294 15638 raft_consensus.cc:2376] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10. Re-sending same reply.
I20260709 13:07:20.679457 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.679461 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 568) took 1137 ms. Trace:
I20260709 13:07:20.726780 15639 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:20.726836 15790 rpcz_store.cc:276] 0709 13:07:19.542362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.542525 (+   163us) service_pool.cc:224] Handling call
0709 13:07:19.563225 (+ 20700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.761074 (+197849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.761112 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.761157 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.761193 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.679217 (+918024us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001383d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:20.679267 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.679381 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454545152}
I20260709 13:07:20.680902 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.682094 15640 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:20.682586 19694 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:20.631489 19730 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:07:20.627104 19775 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:20.715165 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 498467us
I20260709 13:07:20.736385 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.736593 15714 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.718415 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:20.731956 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.732687 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 55962.9us
W20260709 13:07:20.722841 19698 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.002s
I20260709 13:07:20.738740 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:20.739522 15647 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:20.744740 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.747088 16330 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:20.749918 15642 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:20.724560 19667 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:20.754637 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.760488 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.752015 19775 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.764127 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.764487 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:20.795590 15720 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:20.731539 19694 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:20.736644 19720 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.794447 15790 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:20.799669 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.757088 19773 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:20.764034 19756 raft_consensus.cc:2764] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:20.662346 19734 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.818086 15790 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:20.798635 19706 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.004s
I20260709 13:07:20.824580 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:20.769502 19667 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:20.713696 19767 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.797178 19701 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.829981 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.827728 15790 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.736649 19730 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.752593 19698 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.831596 16332 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:20.849115 15788 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:20.757483 19621 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:07:20.851837 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:20.833287 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:20.835799 15642 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:20.824028 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:20.839183 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.853193 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:20.816742 19708 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.803941 19773 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.630863 19551 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:20.844753 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 153750us
I20260709 13:07:20.847124 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.815723 19728 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.817166 19539 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:20.847946 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:20.850180 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.863665 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.850063 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.850679 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.853983 16333 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:20.854388 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.864316 16332 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:20.865651 16334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 747) took 1139 ms. Trace:
I20260709 13:07:20.855713 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:20.858166 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 97795.3us
I20260709 13:07:20.831483 19755 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.866032 16334 rpcz_store.cc:276] 0709 13:07:19.725833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.725986 (+   153us) service_pool.cc:224] Handling call
0709 13:07:20.865491 (+1139505us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400505d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:20.865598 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375929728}
I20260709 13:07:20.829749 19684 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:20.866611 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.869341 15792 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:20.869439 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 133131us
I20260709 13:07:20.884668 19730 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.873342 19776 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:20.886292 19776 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:20.886868 19776 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.887040 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 570) took 2575 ms. Trace:
I20260709 13:07:20.887563 16325 rpcz_store.cc:276] 0709 13:07:18.297037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.304389 (+  7352us) service_pool.cc:224] Handling call
0709 13:07:18.460899 (+156510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.470691 (+  9792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.872669 (+2401978us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54004e2350. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:20.872816 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317262080}
I20260709 13:07:20.888978 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.866611 19767 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.891077 15789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2258) took 1310 ms (client timeout 1535 ms). Trace:
I20260709 13:07:20.891152 19682 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:20.891610 15789 rpcz_store.cc:269] 0709 13:07:19.581085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.583744 (+  2659us) service_pool.cc:224] Handling call
0709 13:07:20.890924 (+1307180us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54001f81d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:20.891019 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553839616}
I20260709 13:07:20.848248 19762 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.893927 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:20.872326 19728 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.894413 19680 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.895175 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:20.895759 16326 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.879105 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.903070 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:20.892889 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.874279 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.906648 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.907435 15794 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:07:20.908465 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.908891 19575 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:20.909423 19575 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:20.892735 19682 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:07:20.910545 19575 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.911582 19575 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.912614 19529 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:20.866917 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:20.915088 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 48213.5us
I20260709 13:07:20.915620 16328 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:20.916219 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:20.860983 19727 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.857534 19779 raft_consensus.cc:2764] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:20.865331 19773 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.928424 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65922us
I20260709 13:07:20.854969 19651 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.868155 19621 consensus_queue.cc:1243] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 8.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:20.926614 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.913055 19529 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.872474 19539 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.852063 19701 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.945261 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:20.865366 19708 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.946590 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.947420 19539 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.947685 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.948300 15796 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:20.948402 19708 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:20.948796 19701 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:20.937120 16329 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:20.949427 15793 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:20.950132 16328 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:20.952368 19667 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.955134 19728 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:20.949219 19779 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:20.960477 19779 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:20.961421 19775 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:20.964665 19752 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:20.968575 19701 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:20.969367 16297 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:20.970124 16327 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:20.970235 19546 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.970788 19546 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:20.971231 19780 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:07:20.971347 19546 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.974208 19529 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.977289 19762 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:20.950021 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.979090 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.980228 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.981283 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:20.981443 19761 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:20.984994 19604 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:20.919667 19730 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.916472 19694 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:20.964583 19719 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.871s	user 0.009s	sys 0.000s
I20260709 13:07:20.989378 16326 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:20.928153 19756 raft_consensus.cc:2764] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:20.987550 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 113319us
I20260709 13:07:20.999217 15787 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
W20260709 13:07:20.960542 19759 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.000s
I20260709 13:07:20.991545 15790 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
W20260709 13:07:21.000835 15685 leader_election.cc:336] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.869s (SENT)
I20260709 13:07:20.985594 19604 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:21.010610 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:21.011515 16332 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:20.987607 19755 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.006371 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.008038 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.009334 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:20.921630 19783 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:21.022178 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.024646 15790 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:21.026687 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:21.030521 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.032011 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.033306 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:20.922222 19684 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.037976 16326 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:07:20.994973 19682 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:21.054916 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 127951us
I20260709 13:07:21.057425 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:21.058120 15646 raft_consensus.cc:606] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:21.058579 15646 raft_consensus.cc:614] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.059685 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:21.001024 19777 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:21.022450 19694 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.011195 19604 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:21.066413 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.073926 15789 raft_consensus.cc:2410] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:21.074141 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.068120 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.028919 19783 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.026549 19778 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:21.075937 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:21.076279 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.076609 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 144952us
I20260709 13:07:21.022918 19755 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:21.059194 19744 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.079865 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.083284 15642 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.081293 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.062623 19680 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:21.083742 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 82955.4us
I20260709 13:07:21.085415 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:21.059218 19682 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:21.062774 19715 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.087797 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.090538 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:21.091192 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.107707 15789 raft_consensus.cc:2376] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8. Re-sending same reply.
I20260709 13:07:21.092459 15644 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.108923 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:21.111013 19776 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.095808 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.116261 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:21.116709 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.028112 19759 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.115103 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.119738 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.120579 15646 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:21.120632 15642 raft_consensus.cc:2376] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11. Re-sending same reply.
I20260709 13:07:21.123370 15645 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.126151 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.078238 19783 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.091233 19682 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.140306 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.084693 19778 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.090458 19744 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.218315 16332 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:21.153245 15795 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:21.188632 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 79766.7us
I20260709 13:07:21.093518 19667 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.187088 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.165014 16329 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:21.223964 19735 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.218477 19761 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:21.189146 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.212841 15789 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:21.203603 19659 consensus_meta.cc:287] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.002s
W20260709 13:07:21.144426 19784 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:21.138646 19539 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.235654 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:21.236678 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.214787 19698 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.203936 19776 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:21.227319 19667 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.232894 19752 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.235292 19575 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:07:21.248291 19761 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.249329 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:21.241573 19659 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.254436 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.255263 15646 raft_consensus.cc:2376] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7. Re-sending same reply.
I20260709 13:07:21.263480 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.265627 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:21.240684 19539 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:21.269554 19758 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:07:21.245715 19667 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.132025 19604 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.142064 19755 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.275727 15794 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:21.278936 19776 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:21.273721 19786 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:07:21.277513 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.287840 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.288741 15722 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:21.289294 19574 consensus_meta.cc:287] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.001s
W20260709 13:07:21.273237 19797 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:21.244448 19728 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:21.299824 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.300113 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.310185 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2838) took 1411 ms. Trace:
I20260709 13:07:21.314823 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.310827 15717 rpcz_store.cc:276] 0709 13:07:19.898549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.635133 (+736584us) service_pool.cc:224] Handling call
0709 13:07:20.635499 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:20.718312 (+ 82813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.718344 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:20.719129 (+   785us) log.cc:844] Serialized 52 byte log entry
0709 13:07:20.853595 (+134466us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.853637 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.853712 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.309835 (+456123us) raft_consensus.cc:1685] finished
0709 13:07:21.309867 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.310090 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89490,"raft.queue_time_us":59570,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10327,"thread_start_us":96998,"threads_started":1,"wal-append.queue_time_us":250508}
I20260709 13:07:21.270275 19684 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:21.276140 19636 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:21.312649 19788 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:07:21.272802 19539 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.325989 19755 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.298867 19759 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:21.407429 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:21.465442 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.332903 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.442673 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.464432 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.332188 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:21.464216 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.468848 15717 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
W20260709 13:07:21.326304 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.467998 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.387535 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:21.470125 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:21.470425 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.471958 15722 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:21.470667 15717 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:21.289994 19744 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:21.466769 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.331301 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.349512 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.419344 15713 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.438714 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2263) took 1743 ms. Trace:
I20260709 13:07:21.493693 15645 raft_consensus.cc:2368] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:21.476148 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.417495 19783 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.478120 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.397527 19604 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.495002 19693 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:21.406811 19773 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.500319 19693 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:21.501215 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:21.501857 15795 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:21.502231 19773 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.502661 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2261) took 1837 ms. Trace:
I20260709 13:07:21.503073 15791 rpcz_store.cc:276] 0709 13:07:19.665375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.665503 (+   128us) service_pool.cc:224] Handling call
0709 13:07:19.691419 (+ 25916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.692290 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.502471 (+1810181us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b5400422cd0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:21.502602 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58733952}
I20260709 13:07:21.503985 19783 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:21.489949 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 155621us
I20260709 13:07:21.504266 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:21.490921 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.484381 19619 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:21.497613 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 607) took 1785 ms. Trace:
I20260709 13:07:21.505484 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.507341 15647 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.506688 15715 rpcz_store.cc:276] 0709 13:07:19.711917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.712024 (+   107us) service_pool.cc:224] Handling call
0709 13:07:19.734910 (+ 22886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.008223 (+273313us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:20.077381 (+ 69158us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.215328 (+137947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.215374 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:20.215409 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.497379 (+1281970us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400439c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:21.497430 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.497562 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2245,"prepare.queue_time_us":113492,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2238,"raft.queue_time_us":44666,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":14895,"spinlock_wait_cycles":627837568,"thread_start_us":139526,"threads_started":2,"wal-append.queue_time_us":193865}
I20260709 13:07:21.508318 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.508941 15647 raft_consensus.cc:2376] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9. Re-sending same reply.
I20260709 13:07:21.509205 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.502689 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.510166 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.510537 15795 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.510798 15639 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:21.289721 19574 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.325018 19776 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:21.402187 19778 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:21.493882 15792 rpcz_store.cc:276] 0709 13:07:19.695100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.695253 (+   153us) service_pool.cc:224] Handling call
0709 13:07:21.425557 (+1730304us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540021b6d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:21.438611 (+ 13054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684482944}
I20260709 13:07:21.505470 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:21.495124 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:21.472977 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.521678 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:21.515236 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.523765 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.524895 15717 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:21.339478 19668 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:21.518708 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.512506 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.522819 15792 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:21.527927 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.528093 16298 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:21.529021 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.348955 19727 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.341149 19735 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.525020 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.522022 15722 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:21.537098 19776 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:21.539896 19767 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.006s
I20260709 13:07:21.544384 15795 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:21.549561 15713 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:21.545679 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:21.583628 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.607266 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 288477us
I20260709 13:07:21.401676 19546 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.409596 19682 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.606645 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:21.421175 19529 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.631122 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:21.609103 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.631439 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:21.609706 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.558696 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:21.609980 15643 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:21.609611 15644 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:21.633396 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:21.608688 15791 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
I20260709 13:07:21.634474 16327 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:21.609028 15713 pending_rounds.cc:85] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 5
I20260709 13:07:21.321558 19802 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.536233 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.642096 15713 pending_rounds.cc:107] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:21.642583 15713 raft_consensus.cc:2889] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:21.636570 15610 connection.cc:256] RPC call timeout handler was delayed by -1.6189836829998967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:07:21.643309 15610 connection.cc:256] RPC call timeout handler was delayed by -1.52988368299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 13:07:21.632602 15715 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:21.644057 15610 connection.cc:256] RPC call timeout handler was delayed by -1.5082836829999451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:07:21.634632 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.609028 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.550464 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.645970 15645 raft_consensus.cc:2376] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9. Re-sending same reply.
I20260709 13:07:21.638064 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:21.642668 15717 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.647251 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.650830 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.651275 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.651397 15646 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.558236 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.542197 19724 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.660840 19724 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.661237 19724 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.662519 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.663283 15796 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:21.637660 19778 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.666720 19778 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:21.667119 19778 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.669932 19682 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:21.644908 15610 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.518s (SENT) [suppressed 63 similar messages]
I20260709 13:07:21.664076 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.671875 15796 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:21.672765 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 63833.3us
I20260709 13:07:21.654083 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.327528 19770 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.659299 19750 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:21.659137 19546 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:21.659951 19729 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.660372 19651 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.672448 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:21.649791 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:21.673986 15791 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.674016 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:21.674607 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.651404 15792 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.670126 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.685904 15646 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.622979 19574 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:21.676654 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:21.677282 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2817) took 3541 ms. Trace:
I20260709 13:07:21.637487 19636 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.688048 15713 rpcz_store.cc:276] 0709 13:07:18.114237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.136372 (+ 22135us) service_pool.cc:224] Handling call
0709 13:07:18.136701 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.537891 (+2401190us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b58008894d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad253620aa 00007fad253e4447 00007fad253fcfe7 00007fad253fe7de 00007fad25408b49 00007fad25409416 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4
0709 13:07:21.418771 (+880880us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400299120. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2537ba1d 00007fad253621a4 00007fad253e4447 00007fad253fcfe7 00007fad253fe7de 00007fad25408b49 00007fad25409416 00007fad25405d8f 00007fad2540583e 00007fad2a3ca419
0709 13:07:21.654944 (+236173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.655226 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772649216}
I20260709 13:07:21.689914 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.690457 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:21.659343 19694 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:07:21.645677 19735 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.587945 19668 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.558928 19715 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.543004 19773 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.683284 19760 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.687065 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.704044 15639 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.687194 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.681254 15717 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:21.694972 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.696025 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:21.696406 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46774.4us
I20260709 13:07:21.655515 19744 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:21.698333 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.699622 15789 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:21.699019 15721 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:21.712603 15721 pending_rounds.cc:85] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 4
I20260709 13:07:21.712731 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.712965 15721 pending_rounds.cc:107] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:21.713482 15647 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.713485 15721 raft_consensus.cc:2889] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.700336 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.676554 19802 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:21.686502 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.705965 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:21.692404 19767 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.693318 19718 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.714432 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:21.685379 19761 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:07:21.648028 19667 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.727557 15717 raft_consensus.cc:2410] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:21.728183 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:21.726157 19708 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.698975 19480 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.701725 19682 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.701084 19715 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.696226 19729 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:21.734167 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.734536 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.764387 15639 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.736090 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:21.764914 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.740716 15715 pending_rounds.cc:85] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 8
I20260709 13:07:21.740916 15716 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:07:21.744381 15717 raft_consensus.cc:1217] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 2.1->[5.2-10.4]   Dedup: 5.2->[8.3-10.4]
I20260709 13:07:21.740091 15792 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:21.700938 19604 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:21.752957 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.768673 15643 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.729707 19767 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:21.692222 19651 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.765173 15647 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:21.751793 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.765663 15641 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.765652 15715 pending_rounds.cc:107] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:21.777124 15715 raft_consensus.cc:2889] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.733198 19718 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.767575 15717 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [5.2-10.4]
I20260709 13:07:21.789045 15641 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:21.789372 15717 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.703625 19668 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.770180 15642 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:21.790398 15641 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:07:21.740278 19744 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:21.780591 19809 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:21.781519 15647 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 13:07:21.807096 15647 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.807423 15641 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.777559 19767 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.758522 19539 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.757550 19798 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:07:21.786397 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58272.5us
I20260709 13:07:21.787019 19763 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.739866 19709 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.757244 19750 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:21.791582 15717 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.796573 19774 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:21.797062 19529 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:21.797494 19668 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.761441 19696 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:21.798131 19694 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.798913 19729 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.794497 19718 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.801329 19713 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.765044 19715 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.761680 19682 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:21.809729 15647 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:21.833431 15646 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:21.811755 15792 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 13:07:21.810874 15641 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:07:21.839268 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:21.812021 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2832) took 1988 ms. Trace:
I20260709 13:07:21.848976 16333 raft_consensus.cc:2368] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:21.813161 15794 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.816728 15722 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:21.817333 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.822757 15791 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:21.819459 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:21.848814 15719 rpcz_store.cc:276] 0709 13:07:19.823433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.923841 (+100408us) service_pool.cc:224] Handling call
0709 13:07:21.811840 (+1887999us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54002a8854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:21.811965 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810433280}
I20260709 13:07:21.840006 15796 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:21.811028 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 606) took 2099 ms. Trace:
W20260709 13:07:21.842056 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.822535 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.826059 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:21.854400 15718 rpcz_store.cc:276] 0709 13:07:19.711531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.711656 (+   125us) service_pool.cc:224] Handling call
0709 13:07:19.732116 (+ 20460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.108832 (+376716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.810811 (+1701979us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540011a3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:21.810977 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850293632}
I20260709 13:07:21.855013 15717 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:21.822073 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 752) took 1175 ms. Trace:
W20260709 13:07:21.868336 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.855661 16330 rpcz_store.cc:276] 0709 13:07:20.646763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.646913 (+   150us) service_pool.cc:224] Handling call
0709 13:07:21.821915 (+1175002us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54004e2354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:21.822015 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173248384}
I20260709 13:07:21.810436 19744 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.887564 15791 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:21.887686 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 70438.1us
I20260709 13:07:21.760725 19728 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:07:21.891227 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68784.2us
I20260709 13:07:21.889266 15796 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:07:21.888814 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 243924us
W20260709 13:07:21.896086 15610 leader_election.cc:336] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.686s (SENT)
I20260709 13:07:21.896759 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:21.898042 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:21.882421 19682 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.912216 15794 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:21.816498 19539 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:21.827070 19774 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:21.813431 19667 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:21.818054 19750 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:21.915073 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.817620 19763 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:21.822594 19760 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:07:21.900398 19480 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.886989 19778 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.903831 19775 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.901563 19696 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:21.932170 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 43788.8us
I20260709 13:07:21.825276 19724 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.936657 15792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:21.963896 15792 raft_consensus.cc:606] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:21.964314 15792 raft_consensus.cc:614] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.942499 15794 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.818003 19709 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:21.961728 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65665.3us
W20260709 13:07:21.966861 15610 connection.cc:256] RPC call timeout handler was delayed by -1.4497836829999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 13:07:21.961796 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:21.964018 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 212294us
I20260709 13:07:21.809851 19802 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:21.925176 19723 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.926062 19700 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.929885 19758 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.937712 19763 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.972311 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:21.986380 19726 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.988164 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:21.992744 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:21.998163 19709 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.998464 19798 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.930763 19599 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:07:21.993999 19539 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:21.995364 19724 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:21.996011 19750 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:21.930981 19711 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:07:22.049546 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.050019 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.996837 15792 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.990126 19694 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:22.043685 15610 connection.cc:256] RPC call timeout handler was delayed by -1.4083836829998972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22890000000000002s for a response
W20260709 13:07:22.059015 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2346836829999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24820000000000003s for a response
W20260709 13:07:22.059659 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.044286 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118211us
W20260709 13:07:22.061105 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.061372 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:21.983330 19728 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:22.080478 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 118780us
I20260709 13:07:22.072604 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:21.982846 19758 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:22.098320 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:22.099011 15646 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:22.098366 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.100055 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:22.157366 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 114777us
I20260709 13:07:22.068199 19755 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.982254 19723 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.168355 15641 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:22.070530 19694 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:22.171916 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:22.172518 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 74261.7us
I20260709 13:07:22.081818 19539 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:22.040239 19700 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.177546 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.179215 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.105204 19599 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.162461 19726 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.104362 19758 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:22.180621 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 108129us
I20260709 13:07:22.178085 19711 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.175669 19694 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.215415 15791 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:22.162904 19696 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:07:22.217768 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:22.180335 19798 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.183760 19760 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.184026 19728 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.197001 19574 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.209430 19714 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.171713 19755 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.254149 15610 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:22.234251 19696 consensus_queue.cc:1243] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 8.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:22.240932 19724 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:07:22.259037 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:22.262637 15719 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.236420 19604 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:22.264665 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:22.209693 19726 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.259215 19667 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.267699 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:22.282264 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:22.283423 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.253283 19683 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.289750 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.300309 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:22.301119 15792 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:22.253492 19714 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.280109 19574 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.288020 19775 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:22.402000 15688 leader_election.cc:336] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.518s (SENT)
I20260709 13:07:22.288723 19778 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:22.244222 19539 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.296432 19604 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.298450 19696 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.467942 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:22.438405 19817 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 13:07:22.435796 19574 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.469484 19735 consensus_meta.cc:287] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.007s
I20260709 13:07:22.481384 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:22.497942 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 215747us
I20260709 13:07:22.300159 19708 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.173s
I20260709 13:07:22.502224 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:22.478020 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:22.572997 15795 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:22.574296 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:22.574455 15719 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:22.575004 15795 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:22.577720 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 175781us
I20260709 13:07:22.578265 15646 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:22.578862 15688 leader_election.cc:336] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.531s (SENT)
W20260709 13:07:22.573052 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70912.9us
W20260709 13:07:22.579980 15688 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.607s (SENT)
W20260709 13:07:22.580982 15688 leader_election.cc:336] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.650s (SENT)
I20260709 13:07:22.467510 19604 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:22.438544 19728 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:07:22.599740 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:22.603381 15795 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.606323 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:22.500502 19574 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.608372 15640 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.581446 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:22.629173 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 292264us
W20260709 13:07:22.631851 15760 leader_election.cc:336] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.532s (SENT)
I20260709 13:07:22.632297 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.596143 19775 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.443658 19824 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.288s
I20260709 13:07:22.604213 19604 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.641165 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:22.643338 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:22.631013 19819 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
W20260709 13:07:22.634177 19813 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
I20260709 13:07:22.577499 19735 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:22.656658 19825 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.359s	user 0.000s	sys 0.000s
I20260709 13:07:22.633550 19667 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.632969 19700 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:22.644407 19816 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
W20260709 13:07:22.649161 19821 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
I20260709 13:07:22.649933 19760 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.667706 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2195) took 1603 ms. Trace:
I20260709 13:07:22.671444 19714 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:22.675349 15643 rpcz_store.cc:276] 0709 13:07:21.064105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.774645 (+710540us) service_pool.cc:224] Handling call
0709 13:07:21.775067 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:21.775582 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.775626 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:21.796254 (+ 20628us) log.cc:844] Serialized 52 byte log entry
0709 13:07:21.973086 (+176832us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:22.003610 (+ 30524us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.004386 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.004464 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.667398 (+662934us) raft_consensus.cc:1685] finished
0709 13:07:22.667427 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.667625 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8828,"prepare.queue_time_us":30220,"prepare.run_wall_time_us":14608,"raft.queue_time_us":39131,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":25673,"spinlock_wait_cycles":14029184,"thread_start_us":176425,"threads_started":1,"wal-append.queue_time_us":172258}
I20260709 13:07:22.650199 19824 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:07:22.661597 19729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.012s	sys 0.038s
I20260709 13:07:22.661031 19696 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.685204 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:22.678966 19599 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:22.688584 15788 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:22.690533 15795 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
W20260709 13:07:22.682205 19729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.013s	sys 0.039s
W20260709 13:07:22.692559 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 111612us
W20260709 13:07:22.689419 19820 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.436s	user 0.001s	sys 0.000s
W20260709 13:07:22.702531 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 95009.3us
I20260709 13:07:22.703409 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:22.704917 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:22.699061 19830 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:07:22.713068 19727 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.714027 19838 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:22.717917 16330 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.720973 19599 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:22.723717 19833 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:07:22.704071 19729 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.706679 19667 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:22.690863 19696 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.737071 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:22.740500 16332 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:22.740613 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1723) took 1562 ms. Trace:
I20260709 13:07:22.741055 15713 rpcz_store.cc:276] 0709 13:07:21.177757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.715374 (+537617us) service_pool.cc:224] Handling call
0709 13:07:21.715788 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.740434 (+ 24646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.740466 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.740922 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.941385 (+200463us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.941424 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.941488 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.712801 (+771313us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:22.729205 (+ 16404us) raft_consensus.cc:1685] finished
0709 13:07:22.729236 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.740548 (+ 11312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11459,"raft.queue_time_us":13836,"raft.run_cpu_time_us":10534,"raft.run_wall_time_us":965809,"spinlock_wait_cycles":9959168,"thread_start_us":161911,"threads_started":1,"wal-append.queue_time_us":333050}
I20260709 13:07:22.743229 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:22.733218 19822 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:07:22.748034 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:22.706737 19775 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:07:22.753919 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.720685 19727 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.737932 19824 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:22.772099 15713 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:22.772681 15688 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.698s (SENT)
I20260709 13:07:22.763883 19838 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:22.781785 19775 consensus_queue.cc:1243] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:22.766575 19767 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.956s	user 0.003s	sys 0.009s
I20260709 13:07:22.795817 19767 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.798144 15641 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:22.800199 15639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.003s
W20260709 13:07:22.800985 15639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.003s
I20260709 13:07:22.802856 19667 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:22.803987 19667 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:22.808566 15787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2267) took 2134 ms (client timeout 1632 ms). Trace:
W20260709 13:07:22.809020 15787 rpcz_store.cc:269] 0709 13:07:20.674577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.674708 (+   131us) service_pool.cc:224] Handling call
0709 13:07:22.808372 (+2133664us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54001f8bd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:22.808487 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626599808}
I20260709 13:07:22.752890 19574 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.818519 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:22.836647 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61205us
I20260709 13:07:22.838451 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1722) took 1672 ms. Trace:
I20260709 13:07:22.838948 15715 rpcz_store.cc:276] 0709 13:07:21.166049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.729062 (+563013us) service_pool.cc:224] Handling call
0709 13:07:21.740556 (+ 11494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.778043 (+ 37487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.778097 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.778709 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.070031 (+291322us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:22.070081 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.070192 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.838252 (+768060us) raft_consensus.cc:1685] finished
0709 13:07:22.838271 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.838396 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":183022,"threads_started":1,"wal-append.queue_time_us":452118}
W20260709 13:07:22.820906 19718 consensus_meta.cc:287] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.991s	user 0.013s	sys 0.000s
I20260709 13:07:22.817575 19838 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.859053 19718 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:22.860314 19682 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.934s	user 0.004s	sys 0.007s
I20260709 13:07:22.860725 19682 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.861791 15789 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:22.847203 15688 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.821s (SENT)
W20260709 13:07:22.820048 19713 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.973s	user 0.006s	sys 0.006s
I20260709 13:07:22.858110 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:22.865473 15795 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:22.869352 15688 leader_election.cc:336] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.836s (SENT)
I20260709 13:07:22.870152 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.861249 19718 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:22.830828 19735 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:22.864650 19758 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
W20260709 13:07:22.880908 16300 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.644s (SENT)
I20260709 13:07:22.876873 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:22.883226 15715 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:22.865996 19848 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:22.875638 19763 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.003s
I20260709 13:07:22.864012 19667 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:22.832360 19775 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:22.872243 19699 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.898141 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:22.895419 15795 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:07:22.898713 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 153177us
I20260709 13:07:22.885866 19539 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.847445 19847 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:07:22.876611 19856 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.879122 19842 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.901957 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:22.907624 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:22.890686 19848 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:22.904736 19718 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:22.888711 19758 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.905488 19852 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.907413 19539 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.936789 19539 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:22.896950 19763 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.941865 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:22.899434 19667 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.924431 19718 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.903136 19699 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:22.957623 15688 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.993s (SENT)
I20260709 13:07:22.944455 19839 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:22.994714 19839 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.995383 19667 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:22.996232 19713 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.948248 19848 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.996898 19839 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:22.996858 19713 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:22.997361 19848 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.937531 19696 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:22.982244 19854 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:22.982755 19574 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:23.003736 15790 raft_consensus.cc:2410] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:22.983137 19682 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:22.988682 19694 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.000s
I20260709 13:07:22.914839 19856 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:22.991983 19758 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:22.994220 19683 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.701s	user 0.017s	sys 0.005s
I20260709 13:07:22.995133 19763 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:22.980814 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:22.999130 19713 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.017940 15714 raft_consensus.cc:2410] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:22.938261 19852 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:23.002079 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 73626.9us
I20260709 13:07:22.972679 19772 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:23.012633 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:22.973135 19857 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:23.015082 19715 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.126s	user 0.020s	sys 0.000s
I20260709 13:07:22.973526 19767 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:22.999085 19853 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:22.950284 19718 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.023924 19684 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.025461 19770 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.029150 15715 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:23.029183 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 71612.6us
I20260709 13:07:23.026011 19852 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:23.050886 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.077360 15638 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:23.076584 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.078507 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.079136 15638 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.999502 19604 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.025537 19856 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:23.013844 19694 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.026309 19683 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.081215 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:23.081720 15688 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.153s (SENT)
I20260709 13:07:23.083407 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.091125 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2837) took 3192 ms. Trace:
W20260709 13:07:23.118008 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 104581us
I20260709 13:07:23.094220 19668 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.095407 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2277) took 2253 ms. Trace:
I20260709 13:07:23.060943 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:23.099025 15685 leader_election.cc:400] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:23.119362 15685 leader_election.cc:403] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:23.030438 19857 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:23.045001 19767 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:23.115164 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.030279 19574 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:07:23.119871 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.120327 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:23.117663 15721 rpcz_store.cc:276] 0709 13:07:19.898372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.626671 (+728299us) service_pool.cc:224] Handling call
0709 13:07:20.696237 (+ 69566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.714413 (+1018176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.090865 (+1376452us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001e7154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:23.091054 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305348992}
W20260709 13:07:23.122923 15688 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.167s (SENT)
I20260709 13:07:23.128113 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:23.128615 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.128880 15795 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:23.130228 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.131292 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.131709 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.119107 15793 rpcz_store.cc:276] 0709 13:07:20.841599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.665901 (+824302us) service_pool.cc:224] Handling call
0709 13:07:21.666253 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.727610 (+ 61357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.727663 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.733892 (+  6229us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.912104 (+178212us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.912146 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.094992 (+1182846us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b5400137ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:23.095042 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.095093 (+    51us) raft_consensus.cc:1685] finished
0709 13:07:23.095109 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.095335 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2033,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11269,"spinlock_wait_cycles":140254464,"thread_start_us":148671,"threads_started":1,"wal-append.queue_time_us":295755}
I20260709 13:07:23.073251 19684 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.097879 19761 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:23.133505 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.134061 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.134954 16334 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:23.035318 19715 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.165155 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.167171 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.169513 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.169829 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.170125 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.170414 16332 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.171545 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.172154 16325 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:23.172873 15792 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.137255 19683 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.173348 15792 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:23.174007 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.174592 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.174268 15792 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.175187 16327 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:23.145792 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.176059 15721 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:23.176872 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.177505 19604 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:23.177887 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.178632 15721 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 9 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:23.178220 19857 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.109040 19682 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:23.179397 19857 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.172953 19747 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.146497 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.147315 15639 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.126929 19767 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.182475 19767 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:23.151232 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 609) took 1656 ms (client timeout 2112 ms). Trace:
W20260709 13:07:23.183799 15722 rpcz_store.cc:269] 0709 13:07:21.531245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.606902 (+ 75657us) service_pool.cc:224] Handling call
0709 13:07:23.151011 (+1544109us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54003bcc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:23.151143 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424576256}
I20260709 13:07:23.178247 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:23.185720 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.186050 15787 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:23.186224 19683 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:23.186508 19729 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.186746 19683 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:23.184958 16332 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:23.152951 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 578) took 1653 ms. Trace:
I20260709 13:07:23.187225 19729 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:23.135311 19802 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.188061 19729 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.187668 19683 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.187605 16328 rpcz_store.cc:276] 0709 13:07:21.499314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.499436 (+   122us) service_pool.cc:224] Handling call
0709 13:07:21.823054 (+323618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.823418 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.823450 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.823965 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.000418 (+176453us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:22.288599 (+288181us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.639731 (+351132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.639815 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.709280 (+ 69465us) raft_consensus.cc:1685] finished
0709 13:07:22.709304 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.152738 (+443434us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54004e2350. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:23.152866 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":595788,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":20358,"raft.queue_time_us":12546,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":3867,"spinlock_wait_cycles":712997120,"thread_start_us":741878,"threads_started":3,"wal-append.queue_time_us":356961}
I20260709 13:07:23.190008 19682 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.190286 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:23.190481 19682 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:23.152889 19761 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.160691 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.170166 16326 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.174098 19845 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.134848 19842 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.123221 19539 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.196269 19761 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:23.187109 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.121106 19668 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:23.216894 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.218189 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.218921 16327 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.217593 16328 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:23.141844 15715 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:23.194226 15792 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.197069 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:23.179548 19715 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.197788 15638 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:23.223114 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 612) took 1691 ms. Trace:
I20260709 13:07:23.223894 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.224542 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.225353 15638 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:23.226584 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.227818 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.229048 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.201550 16332 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.208050 15646 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.208457 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.208660 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.231163 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:23.232120 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45174.3us
I20260709 13:07:23.224371 15715 rpcz_store.cc:276] 0709 13:07:21.532169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.222117 (+1689948us) service_pool.cc:224] Handling call
0709 13:07:23.222457 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.222680 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.222731 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.222789 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.222853 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.222923 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.223043 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.223330 16326 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:23.213551 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:23.231715 15643 raft_consensus.cc:2376] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10. Re-sending same reply.
I20260709 13:07:23.239593 15795 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:23.240552 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.241267 15795 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:23.242329 15795 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.242192 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:23.244215 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:23.245015 15715 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:23.245927 15795 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:23.225297 19760 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.010s
I20260709 13:07:23.255457 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:23.258042 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:23.261392 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 47979.9us
I20260709 13:07:23.262387 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.262550 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:23.263113 15715 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:23.262913 15792 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:07:23.263833 15792 pending_rounds.cc:85] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 2
I20260709 13:07:23.264071 15792 pending_rounds.cc:107] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:07:23.264818 15792 raft_consensus.cc:2889] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.269989 19767 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.271546 19726 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.274369 19604 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.276605 19718 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.278043 19668 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.278625 19718 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.279099 19668 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.280016 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:23.280452 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:23.280551 16327 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:23.249580 19715 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:23.215270 19761 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.281404 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:23.287179 19834 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:23.287737 19834 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:23.288290 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:23.290053 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 611) took 1758 ms. Trace:
I20260709 13:07:23.284188 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:23.291617 15788 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:23.290799 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.291456 15722 rpcz_store.cc:276] 0709 13:07:21.531885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.184822 (+1652937us) service_pool.cc:224] Handling call
0709 13:07:23.185118 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.185330 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:23.199411 (+ 14081us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.289644 (+ 90233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.289716 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.289822 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.289893 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.290001 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13377,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":17364,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":70757,"threads_started":2}
I20260709 13:07:23.293821 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:23.256629 19760 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.288718 19834 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.223189 19682 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.290887 19798 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:23.308501 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.309413 16332 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.309378 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.310055 15787 raft_consensus.cc:2410] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:23.311450 15722 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:23.312789 15722 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.314618 19726 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.315140 19726 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.317252 19726 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.317971 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.318035 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.317106 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.321377 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.297963 19715 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:23.324448 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 613) took 1688 ms. Trace:
I20260709 13:07:23.327544 15722 rpcz_store.cc:276] 0709 13:07:21.635675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.312239 (+1676564us) service_pool.cc:224] Handling call
0709 13:07:23.312584 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.324181 (+ 11597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.324388 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.329177 15722 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:23.329993 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 616) took 1676 ms. Trace:
I20260709 13:07:23.330386 15722 rpcz_store.cc:276] 0709 13:07:21.653979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.328441 (+1674462us) service_pool.cc:224] Handling call
0709 13:07:23.328803 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.329665 (+   862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.329927 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:23.332661 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 135650us
I20260709 13:07:23.335214 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:23.340296 19774 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.342767 19693 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:23.345062 19826 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.069s	user 0.002s	sys 0.000s
I20260709 13:07:23.326591 19749 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.351148 19749 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:23.352674 19812 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 1.181s	user 0.003s	sys 0.009s
I20260709 13:07:23.354519 19839 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.354948 19839 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:23.356053 19723 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:23.333688 16297 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:23.341473 19774 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.355777 19839 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.361097 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 892) took 2099 ms. Trace:
I20260709 13:07:23.326377 19844 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:23.361670 16329 rpcz_store.cc:276] 0709 13:07:21.261613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.270733 (+  9120us) service_pool.cc:224] Handling call
0709 13:07:21.271077 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.667458 (+396381us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b18000bc4a0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:21.676751 (+  9293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.676798 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.687139 (+ 10341us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.834163 (+147024us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.834200 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.834266 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.352041 (+1517775us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:23.360789 (+  8748us) raft_consensus.cc:1685] finished
0709 13:07:23.360818 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.361019 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7032,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":39337,"spinlock_wait_cycles":23704576,"thread_start_us":466346,"threads_started":2,"wal-append.queue_time_us":338313}
I20260709 13:07:23.330786 19845 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.326903 19694 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:23.379107 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97737.9us
W20260709 13:07:23.380946 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.381582 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.382575 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 94361.5us
I20260709 13:07:23.336326 19682 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.333324 19760 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.333956 19798 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:23.371747 19845 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.385864 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.395860 15643 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:23.369598 19844 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.399533 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.387033 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.400563 15719 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:07:23.411922 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.408751 15642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2189) took 2346 ms (client timeout 2146 ms). Trace:
I20260709 13:07:23.403026 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.419400 15788 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:23.419710 19882 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.411479 19873 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:23.421871 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.418131 19839 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:23.417629 15642 rpcz_store.cc:269] 0709 13:07:21.062656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.332655 (+269999us) service_pool.cc:224] Handling call
0709 13:07:23.408476 (+2075821us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54000e7ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:23.408636 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688051456}
I20260709 13:07:23.423875 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.424847 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.425956 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.406424 19746 raft_consensus.cc:2243] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.426643 15642 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:23.427457 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:23.428040 15642 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.394942 19747 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.399672 19877 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:23.396983 19845 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.436708 19746 raft_consensus.cc:2272] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.442313 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.443382 19770 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.444728 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.451090 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.445593 19770 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.458806 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.394691 19760 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.400625 19844 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.415346 19778 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.464769 19798 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.472983 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:23.475986 19827 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.992s	user 0.001s	sys 0.000s
W20260709 13:07:23.477475 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.478446 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.484243 19714 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:23.489501 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1904) took 1399 ms. Trace:
I20260709 13:07:23.490523 19856 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:23.545827 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 94862us
I20260709 13:07:23.448063 19746 ts_tablet_manager.cc:1916] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:23.464576 19729 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.491952 19539 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:23.544625 15643 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:23.574976 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2841) took 2102 ms. Trace:
W20260709 13:07:23.566594 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.563577 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 576) took 2661 ms. Trace:
I20260709 13:07:23.586822 15789 rpcz_store.cc:276] 0709 13:07:20.902276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.746265 (+843989us) service_pool.cc:224] Handling call
0709 13:07:21.763852 (+ 17587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.862184 (+1098332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.563240 (+701056us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400271fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:23.563492 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524523776}
I20260709 13:07:23.550750 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.592732 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.533651 15642 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:23.593538 15646 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:23.554582 19551 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.599069 15646 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:07:23.587862 15643 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:23.551087 15645 rpcz_store.cc:276] 0709 13:07:22.090273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.100582 (+ 10309us) service_pool.cc:224] Handling call
0709 13:07:22.170623 (+ 70041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.181253 (+ 10630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.181284 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.193183 (+ 11899us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.508652 (+315469us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:22.684658 (+176006us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.684958 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.685071 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.487145 (+802074us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b180046c0c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:23.489170 (+  2025us) raft_consensus.cc:1685] finished
0709 13:07:23.489268 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.489426 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3497,"prepare.queue_time_us":209315,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":10300,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":15385,"spinlock_wait_cycles":5901696,"thread_start_us":356654,"threads_started":2,"wal-append.queue_time_us":467082}
W20260709 13:07:23.559890 19855 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.636s	user 0.002s	sys 0.000s
I20260709 13:07:23.584085 15718 rpcz_store.cc:276] 0709 13:07:21.472662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.855294 (+382632us) service_pool.cc:224] Handling call
0709 13:07:21.900073 (+ 44779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.913859 (+ 13786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.913902 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.919336 (+  5434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.063839 (+144503us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:22.063898 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.064014 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.475193 (+1411179us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:23.574536 (+ 99343us) raft_consensus.cc:1685] finished
0709 13:07:23.574567 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.574862 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5653,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":16192,"spinlock_wait_cycles":28777216,"thread_start_us":102280,"threads_started":1,"wal-append.queue_time_us":363444}
I20260709 13:07:23.606408 15643 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:07:23.586862 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.564145 19882 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.549705 19747 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.552067 19856 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:23.579983 19760 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.614576 15645 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.551802 19778 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.623417 15718 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.609066 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2843) took 2135 ms. Trace:
I20260709 13:07:23.545178 19885 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:07:23.643780 19755 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:23.611343 19744 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:23.666273 19831 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.182s	user 0.003s	sys 0.000s
I20260709 13:07:23.667441 19744 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:23.668013 19744 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.668413 19844 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.645350 19845 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:23.670013 19736 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:23.671715 19845 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:23.674706 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1908) took 1098 ms. Trace:
I20260709 13:07:23.675374 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:23.676184 15787 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.679329 15715 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:23.680022 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1737) took 1468 ms. Trace:
I20260709 13:07:23.680349 15715 rpcz_store.cc:276] 0709 13:07:22.220484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.678720 (+1458236us) service_pool.cc:224] Handling call
0709 13:07:23.679056 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.679761 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.679967 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.680737 19723 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.681304 19723 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.682523 15647 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.652118 15643 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:23.683431 15787 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:23.662676 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:23.686898 15789 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:23.690822 15720 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:23.692481 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:23.693795 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:23.695679 15715 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:23.696717 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1741) took 1470 ms. Trace:
I20260709 13:07:23.697158 15715 rpcz_store.cc:276] 0709 13:07:22.226463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.681147 (+1454684us) service_pool.cc:224] Handling call
0709 13:07:23.681474 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.696260 (+ 14786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.696540 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.654959 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 619) took 1473 ms. Trace:
I20260709 13:07:23.675163 15641 rpcz_store.cc:276] 0709 13:07:22.576665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.577388 (+   723us) service_pool.cc:224] Handling call
0709 13:07:22.577660 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.798675 (+221015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.674466 (+875791us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003ec1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:23.674643 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506481536}
W20260709 13:07:23.648494 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61708.9us
I20260709 13:07:23.700403 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.700259 15718 rpcz_store.cc:276] 0709 13:07:22.181320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.609537 (+1428217us) service_pool.cc:224] Handling call
0709 13:07:23.623216 (+ 13679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.654625 (+ 31409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.654885 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.654649 15717 rpcz_store.cc:276] 0709 13:07:21.473519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.855666 (+382147us) service_pool.cc:224] Handling call
0709 13:07:21.855935 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.856123 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:22.045059 (+188936us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.351066 (+1306007us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b180040b040. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a
0709 13:07:23.608721 (+257655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.608767 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.608829 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.608888 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.609012 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13529,"prepare.queue_time_us":352963,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":5819,"raft.queue_time_us":42214,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1728,"spinlock_wait_cycles":13671168,"thread_start_us":556936,"threads_started":3,"wal-append.queue_time_us":257338}
I20260709 13:07:23.704300 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1739) took 1458 ms. Trace:
I20260709 13:07:23.704759 15713 rpcz_store.cc:276] 0709 13:07:22.225779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.747793 (+522014us) service_pool.cc:224] Handling call
0709 13:07:23.684159 (+936366us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b54001798d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:23.684304 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49939712}
I20260709 13:07:23.706357 15713 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.708045 15713 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.698810 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:23.710970 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:23.726778 15715 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.707007 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:23.709571 15643 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:23.729465 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:23.653165 19683 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.734750 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.728272 19773 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:23.691574 19776 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.742486 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:23.734134 19845 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.743275 19839 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:07:23.746960 19845 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.747633 19839 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:23.741269 19856 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.749445 19839 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:23.751009 19856 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.751226 19839 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:23.753010 19839 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.753765 19839 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.754262 19839 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:23.730456 19886 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.741227 19668 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:23.758052 15719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 620) took 1576 ms (client timeout 1574 ms). Trace:
I20260709 13:07:23.758615 19668 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.759052 19668 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:23.758843 15719 rpcz_store.cc:269] 0709 13:07:22.181620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.627741 (+446121us) service_pool.cc:224] Handling call
0709 13:07:23.757753 (+1130012us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400095e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:23.757943 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741884160}
I20260709 13:07:23.758118 19886 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.739455 19682 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.761761 19886 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.762351 19682 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.764346 19682 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:23.740135 19718 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:23.765218 19718 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.729625 19551 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.765584 19718 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.735214 19882 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:23.766574 19882 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.766918 19882 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:23.766993 19651 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:23.767822 19882 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:23.768265 15714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1714) took 2651 ms (client timeout 1532 ms). Trace:
W20260709 13:07:23.768714 15714 rpcz_store.cc:269] 0709 13:07:21.116375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.116488 (+   113us) service_pool.cc:224] Handling call
0709 13:07:23.768030 (+2651542us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540026d4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:23.768174 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4370237824}
I20260709 13:07:23.771250 19886 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:23.772995 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.755653 19839 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.775458 19839 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.705248 19755 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:23.779235 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.733506 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:23.786334 15719 raft_consensus.cc:1217] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 2.1->[5.2-10.4]   Dedup: 5.2->[8.3-10.4]
I20260709 13:07:23.731734 19711 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:23.800587 15719 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [5.2-10.4]
I20260709 13:07:23.787019 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.802217 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.739831 19539 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.802646 15719 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
W20260709 13:07:23.788780 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.786618 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:23.803942 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 478036us
I20260709 13:07:23.787473 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:23.818966 15713 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.821516 15719 pending_rounds.cc:85] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 3
I20260709 13:07:23.822117 15719 pending_rounds.cc:107] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:23.803676 15714 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:23.825580 15719 raft_consensus.cc:2889] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.801445 19715 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:23.731899 19774 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:07:23.784395 19736 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.787936 19723 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:23.837493 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:23.806366 19755 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:23.803877 19711 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.797034 19882 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.820653 19779 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:23.841393 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 482665us
I20260709 13:07:23.832120 19886 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:23.846251 15713 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:23.784886 19776 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:23.852600 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.840034 19711 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.840214 19773 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:23.826676 19744 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.844092 19723 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:23.862979 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.838559 19877 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:23.829393 19539 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.843431 19736 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.861255 19773 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.846308 19779 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.939384 19539 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:23.932121 19877 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.909447 19723 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:23.892580 19715 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:23.956089 19893 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:23.966163 19889 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.996003 15759 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:23.950234 19755 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:23.986367 19893 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:24.012881 15790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2499) took 3076 ms (client timeout 3192 ms). Trace:
I20260709 13:07:24.015769 15796 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:07:24.019868 15796 pending_rounds.cc:85] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 6
I20260709 13:07:24.020126 15796 pending_rounds.cc:107] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:07:24.020356 15796 raft_consensus.cc:2889] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.018359 15713 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:23.997521 19889 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:24.017827 15790 rpcz_store.cc:269] 0709 13:07:20.936789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.033043 (+ 96254us) service_pool.cc:224] Handling call
0709 13:07:24.012644 (+2979601us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54001f72d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:24.012814 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4506720128}
I20260709 13:07:24.009574 19727 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:24.016392 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 282939us
I20260709 13:07:24.021576 19709 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.034360 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1747) took 1154 ms. Trace:
I20260709 13:07:24.011726 19772 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:24.034816 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:24.060007 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.077600 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.040100 15716 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:24.073201 19772 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.083577 19744 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:24.032421 19892 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:07:24.017321 19894 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:07:24.090168 19896 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:24.090430 19890 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.091039 19772 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.091061 19890 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:24.091553 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 1907) took 2000 ms. Trace:
I20260709 13:07:24.092214 19890 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.091924 15644 rpcz_store.cc:276] 0709 13:07:22.091341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.091754 (+   413us) service_pool.cc:224] Handling call
0709 13:07:22.092284 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.092728 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.092770 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.565253 (+1472483us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b2c000014c8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:23.565919 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.819434 (+253515us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:23.819498 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.819657 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.091218 (+271561us) raft_consensus.cc:1685] finished
0709 13:07:24.091236 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.091489 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1183,"raft.queue_time_us":555,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11877,"spinlock_wait_cycles":9823104,"thread_start_us":252943,"threads_started":1,"wal-append.queue_time_us":404454}
I20260709 13:07:24.079304 19736 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.098601 19893 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.099715 19893 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.035223 19709 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:24.113001 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.119340 15719 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 13:07:24.119627 15714 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
W20260709 13:07:24.120609 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.124238 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:24.087357 19699 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.111584 19736 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:24.137450 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 138389us
I20260709 13:07:24.138818 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:24.025950 19723 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.136451 19901 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:24.143107 19901 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.143491 19901 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.101958 19889 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:24.150882 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 308486us
I20260709 13:07:24.162350 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:24.164513 16333 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:07:24.132601 19899 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:24.135354 19736 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:24.173674 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.175334 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:24.188215 19903 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:24.130407 19718 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.200095 16332 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:24.114442 19760 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:24.209810 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:24.209981 15790 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:24.210516 16332 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.192793 19736 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.216629 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:24.219581 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 186937us
I20260709 13:07:24.217442 16334 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:24.221751 19750 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:24.223384 19798 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:24.224273 19798 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.224591 19798 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:24.225412 19798 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.226625 19798 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.227105 19839 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:24.227859 19839 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.232127 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.233385 19839 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:24.235720 19668 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.239220 19574 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:24.239863 19574 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.240854 19834 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.242187 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2281) took 2808 ms. Trace:
I20260709 13:07:24.242606 15791 rpcz_store.cc:276] 0709 13:07:21.434235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.981861 (+547626us) service_pool.cc:224] Handling call
0709 13:07:22.046964 (+ 65103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.220838 (+173874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.241924 (+2021086us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400307ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:24.242091 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375536512}
W20260709 13:07:24.246328 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.250751 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:24.252300 16329 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
W20260709 13:07:24.258633 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 134406us
W20260709 13:07:24.281803 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.287703 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.197281 19899 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.297143 16332 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:24.259999 19842 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.261266 19760 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.300292 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:24.278604 19574 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:24.304388 15720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1720) took 3154 ms (client timeout 1522 ms). Trace:
I20260709 13:07:24.307660 19778 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.307785 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.280777 19774 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.318158 19882 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:24.278169 19905 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:24.317023 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.347426 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:24.261363 19856 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:24.348583 19856 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:24.301239 19842 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:24.325678 15720 rpcz_store.cc:269] 0709 13:07:21.150220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.248025 (+ 97805us) service_pool.cc:224] Handling call
0709 13:07:24.304141 (+3056116us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b540026d9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:24.304300 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5476429696}
I20260709 13:07:24.356276 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.356905 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:24.299808 19907 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.360302 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:24.361202 16332 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:24.362072 19746 ts_tablet_manager.cc:1929] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:07:24.362696 19746 log.cc:1199] T b106b4017dc84b21a7c6f58814593886 P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/b106b4017dc84b21a7c6f58814593886
I20260709 13:07:24.364145 19746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53344 (request call id 0) took 5528 ms. Trace:
I20260709 13:07:24.364573 19746 rpcz_store.cc:276] 0709 13:07:18.859660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.010242 (+150582us) service_pool.cc:224] Handling call
0709 13:07:19.882203 (+871961us) ts_tablet_manager.cc:1151] Deleting tablet b106b4017dc84b21a7c6f58814593886
0709 13:07:19.895914 (+ 13711us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:07:24.000620 (+4104706us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:24.361922 (+361302us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:24.364038 (+  2116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3351781,"tablet-delete.queue_time_us":290886,"thread_start_us":182352,"threads_started":1}
I20260709 13:07:24.365916 19882 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:24.365700 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.359695 19842 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.367084 19882 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.367514 19574 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:24.368336 19574 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:24.369213 15720 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:24.369998 19911 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:24.370690 19772 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:24.371249 19856 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.371779 19844 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:24.371843 19856 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.358059 19905 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.367094 19829 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.375401 19829 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.375773 19829 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.378610 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.379328 19899 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.371304 19772 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.381198 19668 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:24.382664 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:24.383997 19908 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.384802 19908 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:24.385358 19908 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:24.386938 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.379889 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:24.388206 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:24.388526 15715 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:24.388827 15713 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.390962 15715 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:24.392167 15715 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:24.393356 15715 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:24.394068 19772 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:24.394785 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2523) took 2108 ms. Trace:
I20260709 13:07:24.395218 15796 rpcz_store.cc:276] 0709 13:07:22.285936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.286074 (+   138us) service_pool.cc:224] Handling call
0709 13:07:24.012777 (+1726703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.028300 (+ 15523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.394572 (+366272us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001f72d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:24.394708 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3936139136}
I20260709 13:07:24.329288 19718 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.319481 19760 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.386620 19908 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.400990 19760 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.403784 19779 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.407069 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:24.408453 19747 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.408917 19747 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.409302 19747 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:24.414285 19711 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:07:24.035231 15718 rpcz_store.cc:276] 0709 13:07:22.879592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.728110 (+848518us) service_pool.cc:224] Handling call
0709 13:07:23.785754 (+ 57644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.785988 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:23.819813 (+ 33825us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.034024 (+214211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.034078 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:24.034130 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.034190 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.034304 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33539,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":18170,"thread_start_us":209921,"threads_started":1}
I20260709 13:07:24.414803 19711 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.417152 19711 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.417896 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:24.427469 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:24.426692 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.446607 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 163525us
I20260709 13:07:24.458106 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.445003 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:24.440963 19718 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:24.472289 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 197957us
I20260709 13:07:24.482544 15762 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:24.484984 15715 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:24.441323 19903 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:24.492812 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:24.493688 15641 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.495636 15646 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:24.490245 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.489939 19901 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.502086 19901 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.358419 19774 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.505297 19774 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.422991 19907 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.506469 19723 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.506891 19723 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.507228 19723 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.507700 19907 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.508014 19856 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:24.509145 19903 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.513011 15796 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.514780 19905 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.515797 19736 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.517809 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.513437 19913 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:24.518929 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.519768 15644 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:24.519606 19913 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:24.521020 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:24.521101 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:24.521426 19899 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:24.519666 19574 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:24.521714 16330 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:24.522231 19899 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.522661 19899 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:24.522477 19842 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.523417 15759 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:24.523463 19899 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.522246 19574 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:24.524681 19899 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.525718 19774 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.525553 19917 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:24.526145 19774 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:24.526543 19774 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.527510 19845 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:24.521816 16328 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:24.530774 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2846) took 3042 ms. Trace:
I20260709 13:07:24.531127 15716 rpcz_store.cc:276] 0709 13:07:21.488087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.105534 (+617447us) service_pool.cc:224] Handling call
0709 13:07:22.168945 (+ 63411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.089219 (+1920274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.530545 (+441326us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54001a77d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:24.530717 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4302348672}
I20260709 13:07:24.525321 19574 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.532538 15716 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:24.521973 19913 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.534322 19913 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:24.535312 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:24.535156 19913 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.536689 19913 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.536983 15796 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:24.532490 19574 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.535156 19736 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.497205 19750 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:24.533840 19761 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.539647 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 610) took 3008 ms. Trace:
W20260709 13:07:24.497483 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.540033 15721 rpcz_store.cc:276] 0709 13:07:21.531596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.179183 (+1647587us) service_pool.cc:224] Handling call
0709 13:07:23.179453 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.190838 (+ 11385us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:23.370934 (+180096us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.625061 (+254127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.625114 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.625171 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.539420 (+914249us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b540026cfd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:24.539461 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.539590 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8087,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":22196,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":32131,"spinlock_wait_cycles":369888896,"thread_start_us":432894,"threads_started":2,"wal-append.queue_time_us":468014}
I20260709 13:07:24.525259 19747 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.542279 15718 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:24.544473 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:24.545892 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:24.490918 15713 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:24.546779 16328 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.550859 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:24.551427 15638 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.547585 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:24.559114 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.559665 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.559753 15642 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:24.562791 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.459714 16325 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:24.563504 15790 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:24.567880 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.568744 15790 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:24.570609 16328 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:24.571959 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:24.573550 15638 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:24.575791 15641 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:24.577806 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.578641 15789 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:24.577538 15790 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:24.581429 19711 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.581768 19776 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:24.585161 19888 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.723s	user 0.003s	sys 0.000s
I20260709 13:07:24.554649 19842 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.555119 19778 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.561584 19856 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:24.586068 19778 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:24.586328 19856 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.587093 19778 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.588639 19856 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.590847 19747 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.560704 19877 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.593112 19877 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:24.594110 19877 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.595371 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 493) took 1537 ms. Trace:
I20260709 13:07:24.595942 19723 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.595763 15640 rpcz_store.cc:276] 0709 13:07:23.058009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.118810 (+ 60801us) service_pool.cc:224] Handling call
0709 13:07:23.128081 (+  9271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.193829 (+ 65748us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:23.216794 (+ 22965us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.282798 (+ 66004us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.282865 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.282937 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.595121 (+1312184us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54000e83d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:24.595170 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.595307 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26730,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":2617,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5179,"spinlock_wait_cycles":150487424,"thread_start_us":65620,"threads_started":1,"wal-append.queue_time_us":89272,"wal-append.run_cpu_time_us":1061,"wal-append.run_wall_time_us":1001967}
I20260709 13:07:24.594491 19773 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.598551 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:24.599582 15789 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:24.602173 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.615763 16326 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.616108 15790 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.608511 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:24.617278 16332 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:24.575816 19750 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:24.579985 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 153001us
I20260709 13:07:24.611321 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.621049 15787 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.622020 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:24.624992 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:24.570767 19917 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:24.605542 19693 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.708562 19917 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.710891 19917 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.643230 15718 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:24.630414 19758 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:24.663733 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.670899 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.689355 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.698624 15790 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:24.710628 16326 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:24.598664 19723 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.629354 15787 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:24.630096 19750 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:24.600860 19829 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:24.718657 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 93703.2us
I20260709 13:07:24.730535 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:24.718935 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.732208 15787 raft_consensus.cc:2376] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8. Re-sending same reply.
I20260709 13:07:24.720711 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:24.721899 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.658525 19773 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:24.734163 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.737042 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.736518 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.742153 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.728328 19699 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:24.721460 19917 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:24.743335 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.743916 15791 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:24.744611 15788 raft_consensus.cc:2368] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:24.745253 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.728880 19881 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:24.748097 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.749540 15789 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:24.750304 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.751284 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.738822 19776 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.733879 19920 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.722584 19839 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:24.761893 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:24.778721 15642 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 13:07:24.762826 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:24.780649 15713 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:07:24.780992 15639 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.782580 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.763748 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.784946 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:24.785066 15641 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:24.785533 15719 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.764664 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.771224 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:24.786892 15646 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.771791 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:24.772524 15721 raft_consensus.cc:1217] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 2.1->[5.2-11.4]   Dedup: 5.2->[8.3-11.4]
I20260709 13:07:24.787722 15721 pending_rounds.cc:85] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 2
I20260709 13:07:24.788044 15721 pending_rounds.cc:107] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:07:24.788332 15721 raft_consensus.cc:2889] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.774789 15716 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 11. Ops: []
I20260709 13:07:24.789813 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.789960 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.739674 19758 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:24.790495 15715 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:24.791031 15640 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:24.797293 15716 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:24.797477 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.801002 15796 raft_consensus.cc:2368] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:24.797551 19776 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:24.809051 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.810432 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.812940 19890 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.812853 19798 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:24.822194 19776 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.822748 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.823242 19709 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.824497 19709 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.808687 19882 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:07:24.829398 19845 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.829232 19772 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:24.831193 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.745635 19774 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.833104 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:24.834438 15646 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:24.835206 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 627) took 1083 ms. Trace:
I20260709 13:07:24.840905 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.841732 15716 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:24.835712 15717 rpcz_store.cc:276] 0709 13:07:23.752190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.752355 (+   165us) service_pool.cc:224] Handling call
0709 13:07:23.752685 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.753130 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.753164 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.416664 (+663500us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b2c000108d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:24.417114 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.689153 (+272039us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.689206 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.689311 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.827644 (+138333us) raft_consensus.cc:1685] finished
0709 13:07:24.827667 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.835146 (+  7479us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":522,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":62840064,"thread_start_us":271552,"threads_started":1,"wal-append.queue_time_us":399330}
I20260709 13:07:24.844612 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.849496 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:24.813876 19883 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.958s	user 0.003s	sys 0.000s
I20260709 13:07:24.851598 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.852272 15716 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:24.754233 19917 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.766291 19881 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.791877 19909 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:07:24.862931 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.867276 15719 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:24.868001 15716 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:24.829892 19845 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.826278 19918 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.798015 19856 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:07:24.865177 15639 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:24.873170 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.814110 19908 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:24.792225 19919 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:07:24.879642 15788 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.869212 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:24.907655 15794 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 4. (term mismatch)
I20260709 13:07:24.908149 15794 pending_rounds.cc:85] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 3
I20260709 13:07:24.908468 15794 pending_rounds.cc:107] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 10.4
I20260709 13:07:24.908763 15794 raft_consensus.cc:2889] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.908519 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:24.783910 19920 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.912930 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.911827 19699 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:24.916236 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:24.917057 15719 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:24.913295 19480 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.917941 19480 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.922833 19881 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.923197 19917 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.924109 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.924856 15791 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:24.929086 19839 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:24.929998 19839 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.930351 19839 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:24.930498 19774 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:24.931228 19839 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.932548 19839 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.933584 19895 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.957s	user 0.004s	sys 0.007s
I20260709 13:07:24.876401 19845 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.934166 15714 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:24.935932 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:24.936272 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:24.945577 15719 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.938541 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.956840 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.827479 19750 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:24.963330 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 201563us
I20260709 13:07:24.944160 15762 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:24.911384 19856 consensus_queue.cc:1243] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:24.967245 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:24.970233 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.921626 19480 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:24.972219 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:24.942184 19844 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.966215 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:24.975500 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:24.973356 19856 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:24.993615 19877 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.993764 19856 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:24.994349 19877 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.994998 19856 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:24.996482 19856 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.998062 19877 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:24.998359 19924 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:24.999647 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2847) took 3203 ms. Trace:
I20260709 13:07:25.000514 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:24.940466 19699 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:25.002867 19897 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.027s	user 0.011s	sys 0.005s
I20260709 13:07:25.002662 19699 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.933943 19922 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:24.977465 19761 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.006807 19761 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.934496 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.881705 19918 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.009857 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2299) took 1551 ms. Trace:
I20260709 13:07:25.009938 15791 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:25.010951 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:24.963138 19779 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.966317 19882 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:25.011629 15647 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:25.012121 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:25.011684 19779 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.015923 15789 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:07:24.964560 19867 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.017077 19867 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.017181 15789 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:25.017515 19867 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.971798 19903 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:25.018630 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:25.019193 19903 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:25.019939 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:25.020123 19903 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:24.967437 19893 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.020800 15715 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:25.021787 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:25.034662 15789 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:25.023576 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2522) took 3722 ms. Trace:
I20260709 13:07:25.000120 15722 rpcz_store.cc:276] 0709 13:07:21.796779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.334587 (+1537808us) service_pool.cc:224] Handling call
0709 13:07:23.334915 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.335244 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:23.345977 (+ 10733us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.650313 (+304336us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.650813 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.650971 (+   158us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.651005 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.651070 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.658902 (+1007832us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:24.999315 (+340413us) raft_consensus.cc:1685] finished
0709 13:07:24.999421 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.999569 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19886,"prepare.queue_time_us":11145,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":71887,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":29306,"spinlock_wait_cycles":4483456,"thread_start_us":283344,"threads_started":1,"wal-append.queue_time_us":487444}
I20260709 13:07:25.035509 15794 rpcz_store.cc:276] 0709 13:07:21.301201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.965847 (+664646us) service_pool.cc:224] Handling call
0709 13:07:21.990830 (+ 24983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.913122 (+2922292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.023271 (+110149us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b540047c2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:25.023502 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6653002112}
I20260709 13:07:25.036487 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:25.037236 15722 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.010321 15792 rpcz_store.cc:276] 0709 13:07:23.458879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.459036 (+   157us) service_pool.cc:224] Handling call
0709 13:07:23.459449 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.459939 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.459997 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.461612 (+  1615us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.840916 (+379304us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.840959 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.842017 (+  1058us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.932956 (+1090939us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:25.009553 (+ 76597us) raft_consensus.cc:1685] finished
0709 13:07:25.009575 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.009797 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":386,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3566,"spinlock_wait_cycles":91822848,"thread_start_us":376672,"threads_started":1,"wal-append.queue_time_us":512086}
I20260709 13:07:25.040207 15792 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:24.971557 19725 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:25.044158 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.047267 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54427.2us
I20260709 13:07:25.048938 15719 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:24.940201 15788 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:25.073355 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:25.070098 15792 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:25.079586 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:25.079617 15792 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:25.084519 15794 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:25.075810 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:25.087474 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:24.977218 19842 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:25.102348 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.102720 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:25.042807 19922 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:25.042557 19744 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.095288 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:25.105988 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:25.011998 19882 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.093643 15638 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:25.025537 19938 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:25.104828 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.081020 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:25.085556 19636 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:25.076864 19772 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:25.023998 19844 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:25.117879 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.104681 19802 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.124049 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:25.096251 19725 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:25.054627 19893 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.112071 15796 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:25.096652 19894 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.127427 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:25.078164 19881 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:25.102914 19761 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.098148 19776 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.118862 15794 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:25.117194 19938 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.128769 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:25.074889 19798 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:25.104831 19842 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:25.112298 19834 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:25.135234 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.135994 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.167229 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:25.141135 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2302) took 1469 ms. Trace:
I20260709 13:07:25.141153 15789 raft_consensus.cc:1217] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[8.4-10.5]   Dedup: 10.5->[]
I20260709 13:07:25.169291 15789 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 13:07:25.143198 19882 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:25.130275 19772 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:25.170246 19772 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.171700 19893 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.172322 19772 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:25.173983 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:25.112646 19744 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.161754 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:25.162992 15722 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:25.180393 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:25.135921 19942 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.134063 19755 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.186740 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:25.150702 15638 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:25.168326 15793 rpcz_store.cc:276] 0709 13:07:23.671587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.672767 (+  1180us) service_pool.cc:224] Handling call
0709 13:07:23.673179 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.673617 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.673650 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.848904 (+1175254us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:24.858773 (+  9869us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.079582 (+220809us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:25.079620 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.079687 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.140771 (+ 61084us) raft_consensus.cc:1685] finished
0709 13:07:25.140799 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.141067 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":500,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":24140032,"thread_start_us":168812,"threads_started":1,"wal-append.queue_time_us":263019}
I20260709 13:07:25.147913 19802 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:25.151669 19779 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.151281 19636 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:25.160573 19574 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.164351 19938 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.165771 19776 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.168907 19890 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:07:25.137126 19894 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:25.193115 19913 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.656s	user 0.014s	sys 0.000s
I20260709 13:07:25.316936 15719 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:25.245282 19908 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:24.818167 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:25.226497 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.230535 15793 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:24.778169 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet b106b4017dc84b21a7c6f58814593886 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:07:25.236809 15716 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:25.177817 19480 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.178251 19919 consensus_queue.cc:1243] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:25.255548 19709 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.255682 15795 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:25.255708 19636 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.181356 19772 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.186038 19755 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.165278 19842 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.272055 19574 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.179104 19920 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:25.242563 19899 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.003s
I20260709 13:07:25.239948 19759 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:25.225989 19910 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.232203 19946 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:25.232203 19829 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:25.227350 19911 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:25.335556 15715 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
W20260709 13:07:25.317981 19931 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:07:25.341135 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 194185us
W20260709 13:07:25.344753 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 158127us
I20260709 13:07:25.413231 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:25.279006 19887 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:25.272782 19725 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.192276 19942 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.400440 19759 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:25.263288 19802 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.345148 19913 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:25.394411 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.339689 19945 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:25.349190 19480 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.397800 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 236118us
I20260709 13:07:25.194317 19922 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:25.355670 15530 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 577570us
I20260709 13:07:25.388288 19755 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.356541 19943 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.355839 19877 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:25.236990 19845 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.429147 15790 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:25.391109 19772 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.444024 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:25.469161 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:25.433550 19940 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:07:25.406749 19910 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.430867 19798 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:07:25.467154 19839 consensus_meta.cc:287] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.002s
I20260709 13:07:25.423738 19937 consensus_queue.cc:1059] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:25.417524 19946 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.485595 16326 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:25.451392 19953 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:07:25.484160 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:25.466005 19899 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.443465 19913 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.468515 19919 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.522593 19961 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.491662 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:25.720573 16327 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:07:25.528370 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.452723 19945 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:25.563494 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.743216 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.513473 19958 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.441497 19480 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.651183 19839 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.648346 19744 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.478750 19837 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:25.510768 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.647200 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.658493 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 174439us
I20260709 13:07:25.757380 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:25.429854 19887 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:25.710788 19949 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:07:25.586369 19829 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:25.711320 19889 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.743695 19961 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.484192 19943 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.666823 19911 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.741770 19776 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.766624 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:25.559360 19759 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.770576 19961 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:25.777729 19957 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 13:07:25.779309 19960 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:07:25.756762 19837 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:25.776073 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:25.782965 19944 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.768040 19919 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.768306 19798 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.783790 19759 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.758674 19839 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.755785 19894 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.790856 19574 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.771471 19829 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:25.790722 19919 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.796152 19877 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.752604 19958 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.830626 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2312) took 1101 ms. Trace:
W20260709 13:07:25.831010 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.005s	sys 0.008s
I20260709 13:07:25.813928 19779 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:25.830885 15796 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:25.821815 19856 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.825s	user 0.013s	sys 0.000s
I20260709 13:07:25.834962 15787 rpcz_store.cc:276] 0709 13:07:24.729161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.730222 (+  1061us) service_pool.cc:224] Handling call
0709 13:07:25.830394 (+1100172us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b54002193d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:25.830552 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443008}
W20260709 13:07:25.835048 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.008s
W20260709 13:07:25.836067 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 668004us
I20260709 13:07:25.836861 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2867) took 1069 ms. Trace:
I20260709 13:07:25.839708 15721 rpcz_store.cc:276] 0709 13:07:24.767788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.771959 (+  4171us) service_pool.cc:224] Handling call
0709 13:07:24.772294 (+   335us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:24.956329 (+184035us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:24.956362 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.956919 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.126999 (+170080us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.127035 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.127102 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.836657 (+709555us) raft_consensus.cc:1685] finished
0709 13:07:25.836674 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.836807 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16218,"raft.queue_time_us":45404,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":12921,"thread_start_us":290700,"threads_started":2,"wal-append.queue_time_us":276520}
W20260709 13:07:25.844244 19699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.002s	sys 0.003s
I20260709 13:07:25.797472 19798 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.827098 19837 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:25.845055 19684 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:25.840206 19951 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:07:25.843037 19845 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:25.912214 19894 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:26.081360 19480 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.082337 19894 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.084779 19480 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:25.837864 19877 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:25.981165 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.876366 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.952505 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 185659us
W20260709 13:07:26.086431 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.828399 19919 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:25.914341 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 77374.5us
W20260709 13:07:26.096683 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 320682us
I20260709 13:07:25.837193 19772 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.100999 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:25.920637 19910 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.109349 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.103646 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.110146 15647 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.839787 19942 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:26.087749 19699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.007s	sys 0.012s
I20260709 13:07:26.084770 19894 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.108197 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.109066 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.114460 15640 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.968648 19829 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.102901 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:26.015951 19867 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.998s	user 0.000s	sys 0.013s
I20260709 13:07:25.845220 19779 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:26.113694 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:26.116115 19958 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.116662 19798 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.121073 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.095841 19574 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.097810 19758 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.138348 15645 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:26.097175 19944 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:25.951876 19913 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.126458 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:26.129030 19945 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.122352 19943 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.130897 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.137311 15647 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:26.103753 19856 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:26.135424 19910 raft_consensus.cc:2764] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:07:26.154284 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.155658 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:26.142547 19938 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.003s
I20260709 13:07:26.111542 19837 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.127060 19921 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.130491 15639 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:26.148787 15638 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:26.157454 15638 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:26.157699 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:26.138851 19842 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.003s
I20260709 13:07:26.158370 15638 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.158593 19842 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.159474 15638 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.126835 19887 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.138099 19977 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:26.152148 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.163033 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.171571 15647 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:26.163247 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.174225 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:25.941632 19973 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.210s
I20260709 13:07:26.164403 19839 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.164844 15793 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:26.165313 19829 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.166064 19844 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.168920 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2319) took 1198 ms. Trace:
I20260709 13:07:26.163980 19921 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.151252 19699 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.190047 15796 rpcz_store.cc:276] 0709 13:07:24.970117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.150698 (+180581us) service_pool.cc:224] Handling call
0709 13:07:25.830561 (+679863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.835393 (+  4832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.168705 (+333312us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54002193d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:26.168862 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562655104}
I20260709 13:07:26.200013 15638 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:26.200418 15638 pending_rounds.cc:85] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 8
I20260709 13:07:26.200711 15638 pending_rounds.cc:107] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:26.187386 15640 raft_consensus.cc:2410] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:07:26.197531 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.198562 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.202152 15610 leader_election.cc:400] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:26.202474 15610 leader_election.cc:403] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.144271 19574 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.172087 19945 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:26.204994 15610 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.201018 15638 raft_consensus.cc:2889] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:26.173485 19755 consensus_meta.cc:287] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260709 13:07:26.197858 19829 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.172472 19943 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:26.192790 19834 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.171919 19938 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.203480 19856 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.170077 19977 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.221212 19961 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.193106 19910 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.212270 19779 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.144599 19758 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.206700 19980 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:26.140481 19867 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.232362 15610 leader_election.cc:400] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:26.270087 15610 leader_election.cc:403] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.237534 19978 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:26.238222 19942 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:26.200802 19842 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.199544 19699 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:26.273950 19758 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.274540 19699 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.276240 15787 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:26.248342 19834 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:26.277033 19834 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.201591 19913 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:26.251031 19945 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.279261 19945 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.255831 19839 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.282091 19839 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.282824 19918 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.284204 19839 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:26.287840 19899 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.620s	user 0.003s	sys 0.009s
I20260709 13:07:26.288305 19899 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.289248 15643 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:26.290794 19961 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.292034 19747 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:26.292435 19747 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:26.292949 19956 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.496s	user 0.000s	sys 0.002s
I20260709 13:07:26.293247 19747 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.295066 19747 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.260704 15720 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [8.3-8.3]
W20260709 13:07:26.296653 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64455.6us
W20260709 13:07:26.297297 15795 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2539) took 1561 ms (client timeout 1897 ms). Trace:
W20260709 13:07:26.297688 15795 rpcz_store.cc:269] 0709 13:07:24.736103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.736736 (+   633us) service_pool.cc:224] Handling call
0709 13:07:26.297134 (+1560398us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400152f54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:26.297238 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185215872}
I20260709 13:07:26.298233 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:26.298870 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2549) took 1551 ms. Trace:
I20260709 13:07:26.299444 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.301090 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1777) took 1282 ms. Trace:
I20260709 13:07:26.301465 15717 rpcz_store.cc:276] 0709 13:07:25.018883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.235400 (+216517us) service_pool.cc:224] Handling call
0709 13:07:25.235660 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.251069 (+ 15409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.251096 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.252399 (+  1303us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.441176 (+188777us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.441215 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.300717 (+859502us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54003bae54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:26.300768 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.300815 (+    47us) raft_consensus.cc:1685] finished
0709 13:07:26.300828 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.301034 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18639,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":46180,"spinlock_wait_cycles":34616064,"thread_start_us":103363,"threads_started":1,"wal-append.queue_time_us":541482}
I20260709 13:07:26.303309 19574 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.305388 19829 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.306217 19747 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.306730 19747 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.307562 19938 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.307760 15647 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:26.308703 19747 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.308977 19921 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.309389 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.310019 15642 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
W20260709 13:07:26.294989 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.311537 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.311846 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.299242 15788 rpcz_store.cc:276] 0709 13:07:24.747153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.782379 (+ 35226us) service_pool.cc:224] Handling call
0709 13:07:26.298696 (+1516317us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b540047b3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:26.298805 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221840768}
I20260709 13:07:26.313109 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.315411 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.316238 15642 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:26.316473 15792 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:26.318389 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.320137 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.321414 15717 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.331912 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.332322 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:26.333025 15716 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:26.333357 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:26.335673 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.335448 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.341130 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.345640 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.346276 15722 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:26.350235 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:26.351500 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.352192 15718 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:26.281646 19945 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.240213 19944 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.334647 19961 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:26.341008 19918 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.364666 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.341459 19913 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:26.375738 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.377285 15641 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:26.378491 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:26.248668 19755 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.355079 19908 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.370055 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.388859 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:26.371966 19987 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.172s	user 0.003s	sys 0.000s
I20260709 13:07:26.372565 19909 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:26.374202 19867 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.355142 19969 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.354174 19877 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.353041 19943 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:26.376740 19889 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.603s	user 0.005s	sys 0.005s
I20260709 13:07:26.389585 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:26.351565 19968 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:26.392629 15718 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:26.359546 19856 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:26.388840 19908 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.369297 19918 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.399684 15721 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:26.375851 19946 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.394942 19909 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:26.396430 19969 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.375743 19834 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.412411 19910 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:26.387910 19972 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.376138 19772 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.431711 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:26.432747 16333 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:07:26.416985 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 92971.8us
I20260709 13:07:26.368584 19919 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.421193 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:26.429811 19755 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.421872 19983 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:26.396847 19961 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:26.419377 19908 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.442773 15640 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:26.424274 19969 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.432713 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:26.446355 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:26.446867 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.420042 19918 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.437449 19842 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:26.438264 19747 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:26.438591 19938 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.438764 15647 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.461568 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.439086 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.439931 19983 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:26.435491 19945 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.462917 15644 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.426321 19943 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:07:26.465981 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.519196 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.464262 15647 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:07:26.463323 19755 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.516404 15644 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:26.517084 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.524767 15794 raft_consensus.cc:2410] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:26.445191 19946 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:26.518088 15790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2545) took 1772 ms (client timeout 1797 ms). Trace:
W20260709 13:07:26.525628 15790 rpcz_store.cc:269] 0709 13:07:24.746103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.750071 (+  3968us) service_pool.cc:224] Handling call
0709 13:07:26.517934 (+1767863us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400421dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:26.518041 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498285440}
I20260709 13:07:26.454205 19844 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:07:26.466676 19938 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.521245 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.522221 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:26.531337 16327 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:26.531615 15647 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:26.457801 19910 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.526940 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.435953 19972 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.512616 19977 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.514761 19856 consensus_queue.cc:1243] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:26.475543 19945 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:26.536517 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.519053 19889 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.525286 19877 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:26.524109 19755 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:26.530076 19839 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:26.573288 16332 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:26.711302 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.652102 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:26.712613 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.598366 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:26.713258 15644 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:26.713800 16328 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:26.645361 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:26.714164 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:26.692399 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:26.684161 19802 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:26.715242 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.715328 16331 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.575850 16334 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:26.716084 15644 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:26.716572 19755 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.717062 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.717995 15644 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:07:26.718694 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.718930 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:26.719269 19893 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.719738 15644 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:26.691490 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:26.721179 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2553) took 1952 ms. Trace:
I20260709 13:07:26.721419 16330 raft_consensus.cc:2410] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:26.721860 19945 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.719796 19893 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.713078 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:26.648236 15611 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.524s (SENT) [suppressed 28 similar messages]
W20260709 13:07:26.589617 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.573134 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 52005.4us
I20260709 13:07:26.723721 15647 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:26.725994 15647 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:07:26.538702 19910 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.721578 15789 rpcz_store.cc:276] 0709 13:07:24.768539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.043019 (+274480us) service_pool.cc:224] Handling call
0709 13:07:25.140977 (+ 97958us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:25.169670 (+ 28693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.721003 (+1551333us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b5400152550. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:26.721124 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223755520}
I20260709 13:07:26.728102 15647 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:26.728379 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.719923 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.730736 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:26.732333 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.732659 15647 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:26.521533 19983 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:26.529072 19946 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:26.731264 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:26.738574 15688 connection.cc:256] RPC call timeout handler was delayed by -1.6675484589999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 13:07:26.732918 15789 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:26.739622 19773 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.683696 19856 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.573521 19837 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.741515 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 93325.5us
I20260709 13:07:26.742208 15647 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:26.763602 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.702445 19829 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.743314 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.764683 15789 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:26.747620 19922 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.748449 19983 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.714809 19889 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.740491 19693 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.752547 19755 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:26.753328 19988 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:26.755584 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.781589 15787 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:26.782577 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.783149 15787 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:26.783942 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:26.784614 15787 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:26.761233 19882 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:26.785334 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.681591 19977 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:26.774227 19922 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.770380 19837 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.799517 19977 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.801160 19922 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.801394 19837 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:26.762337 15688 connection.cc:256] RPC call timeout handler was delayed by -1.4558049040000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
I20260709 13:07:26.731887 19910 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.726039 19867 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:26.769239 19747 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:26.806030 19867 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.807740 19969 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.808146 19867 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.760236 19772 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.808825 19772 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.763226 19856 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.810026 15793 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:26.732497 19877 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.811043 19772 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.811631 19856 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.735603 19834 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.774850 19693 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.775343 15718 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.775396 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:26.777791 19972 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:26.778263 19952 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.356s	user 0.009s	sys 0.000s
I20260709 13:07:26.785761 19882 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.786598 15645 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:26.787284 15714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2864) took 2524 ms (client timeout 1574 ms). Trace:
I20260709 13:07:26.840884 15645 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:26.790398 16329 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:07:26.840968 15714 rpcz_store.cc:269] 0709 13:07:24.262506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.307506 (+ 45000us) service_pool.cc:224] Handling call
0709 13:07:26.787113 (+2479607us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400119ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:26.787213 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386711808}
I20260709 13:07:26.715396 19802 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.771828 19935 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.731964 19839 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.739147 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:26.798918 19758 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:26.766340 19919 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.757992 19887 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:26.740623 19844 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:26.797590 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2551) took 2046 ms. Trace:
I20260709 13:07:26.771912 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.842093 15645 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.850500 15789 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:26.813366 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 128254us
I20260709 13:07:26.806186 19747 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:26.784739 19699 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.002s
I20260709 13:07:26.821285 16331 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:26.831192 15790 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 6.
W20260709 13:07:26.847685 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 110153us
I20260709 13:07:26.850437 15645 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.812525 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.801600 19977 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.848670 15791 rpcz_store.cc:276] 0709 13:07:24.747616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.028261 (+280645us) service_pool.cc:224] Handling call
0709 13:07:25.080018 (+ 51757us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:25.080685 (+   667us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:25.272054 (+191369us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.594028 (+321974us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:25.638662 (+ 44634us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.638997 (+   335us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:25.639541 (+   544us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.311123 (+671582us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18004160e0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:26.793296 (+482173us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b18004160e0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287
0709 13:07:26.793420 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.793503 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.793541 (+    38us) raft_consensus.cc:1685] finished
0709 13:07:26.793554 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.793685 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90572,"prepare.queue_time_us":166949,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":388976,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":26889,"spinlock_wait_cycles":15246336,"thread_start_us":474491,"threads_started":3,"wal-append.queue_time_us":466549}
I20260709 13:07:26.638868 19938 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.852592 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.865671 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:26.835741 19969 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.774256 19829 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.887467 19867 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:26.890988 19755 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.891628 19755 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:26.892071 19693 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:26.892122 19755 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.887487 19802 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.871080 19699 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.851697 19758 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.884351 19938 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:26.898394 19910 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.899164 19938 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.899677 19699 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.900524 19910 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.901201 19938 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.891009 19747 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:26.903348 19829 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.908347 19918 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.909614 15644 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:26.911964 15787 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.855370 19837 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:26.931504 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.933450 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:26.981033 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:26.848119 19935 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:26.993211 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1632319179999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:07:27.000043 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0891153769998709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:07:26.885448 19877 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:26.859568 19887 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:26.849570 19946 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:26.999699 15787 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:07:27.009112 15715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 2876) took 1876 ms (client timeout 1524 ms). Trace:
I20260709 13:07:27.031477 19839 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.091305 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.091998 15713 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:26.859499 19844 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.011657 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:26.990810 19699 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.921386 19893 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.101678 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:27.093339 15721 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:27.104408 15719 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.037115 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:27.095577 15788 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:27.106328 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:27.008213 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.099896 15722 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:27.100309 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.109239 15717 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
W20260709 13:07:27.112191 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.090730 15715 rpcz_store.cc:269] 0709 13:07:25.132820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.166892 (+ 34072us) service_pool.cc:224] Handling call
0709 13:07:27.008890 (+1841998us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540017bbd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.009030 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384883584}
I20260709 13:07:27.081324 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:27.123219 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.028093 19882 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.178921 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.095484 19877 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:27.088871 19759 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.237345 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.532475 15715 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:27.006235 19867 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.187651 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:27.240605 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 307251us
I20260709 13:07:27.252020 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:27.252475 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:27.292055 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.309933 19887 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:27.316265 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 101813us
I20260709 13:07:27.129498 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:27.388135 19945 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.666s	user 0.003s	sys 0.006s
I20260709 13:07:27.551169 15721 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:27.231879 19978 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.358000 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 436989us
I20260709 13:07:27.188223 19938 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:27.104921 19946 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:27.537843 16300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.009s
I20260709 13:07:27.546366 15791 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:27.566473 16300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.017s	sys 0.014s
I20260709 13:07:27.282830 19755 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:27.534184 16327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.013s
I20260709 13:07:27.528035 19882 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.509207 19877 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.179539 19893 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.567653 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 532987us
I20260709 13:07:27.549582 16297 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:27.568542 16327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.012s	sys 0.013s
I20260709 13:07:27.558218 19938 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.129498 19699 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:27.567785 19908 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.113s	user 0.005s	sys 0.005s
I20260709 13:07:27.557960 19972 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.539650 19759 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.554083 20007 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.609117 20007 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.607460 19908 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.612335 19908 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:27.612811 19759 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.559463 19978 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.605867 19889 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.623584 20007 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.624159 19909 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.625486 19909 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.630605 19978 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:27.632494 19972 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.635231 19972 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:27.555183 19945 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:27.154534 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.167063 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.502477 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 310747us
I20260709 13:07:27.382637 15645 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:27.534659 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:27.548497 15716 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
W20260709 13:07:27.148334 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 67139us
I20260709 13:07:27.212489 15719 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:27.552639 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.552103 19867 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:27.587571 19893 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:27.570389 19918 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.594750 19938 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:27.598842 19699 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:27.571165 19844 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.591523 19935 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:27.596939 20008 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:27.765059 15789 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:27.710004 15640 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:27.762748 15788 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:27.601526 19758 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:27.701632 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2266) took 1060 ms. Trace:
I20260709 13:07:27.738611 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2258) took 1203 ms. Trace:
I20260709 13:07:27.742072 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2873) took 2619 ms. Trace:
I20260709 13:07:27.945971 15720 rpcz_store.cc:276] 0709 13:07:25.122895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.238327 (+115432us) service_pool.cc:224] Handling call
0709 13:07:25.238638 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.296094 (+1057456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.741361 (+1445267us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003bb354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:27.741843 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349946240}
I20260709 13:07:27.945762 15639 rpcz_store.cc:276] 0709 13:07:26.640573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.848006 (+207433us) service_pool.cc:224] Handling call
0709 13:07:26.873029 (+ 25023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.873259 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.873285 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.877671 (+  4386us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.253375 (+375704us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:27.253415 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.253480 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.700694 (+447214us) raft_consensus.cc:1685] finished
0709 13:07:27.700885 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.701264 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":363214,"threads_started":1,"wal-append.queue_time_us":693940}
I20260709 13:07:27.948709 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.948922 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:27.754266 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2246) took 1316 ms. Trace:
I20260709 13:07:27.578135 19877 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.578429 19882 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:27.949690 15642 rpcz_store.cc:276] 0709 13:07:26.437890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.438040 (+   150us) service_pool.cc:224] Handling call
0709 13:07:26.438333 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.455137 (+ 16804us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:26.647159 (+192022us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.762545 (+115386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.762594 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:26.762656 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.630975 (+868319us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b180026b660. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:27.712822 (+ 81847us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b180026b660. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419
0709 13:07:27.753559 (+ 40737us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54003aff54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:27.753634 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.754001 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3021,"prepare.queue_time_us":321086,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":3132,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7588,"spinlock_wait_cycles":129082880,"thread_start_us":291532,"threads_started":2,"wal-append.queue_time_us":215256,"wal-append.run_cpu_time_us":1490,"wal-append.run_wall_time_us":1024789}
I20260709 13:07:27.953017 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:27.742561 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 505) took 1634 ms (client timeout 2033 ms). Trace:
W20260709 13:07:27.771251 15792 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2320) took 1613 ms (client timeout 1917 ms). Trace:
I20260709 13:07:27.764566 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2564) took 1120 ms. Trace:
I20260709 13:07:27.766474 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2336) took 1325 ms. Trace:
I20260709 13:07:27.728716 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 1952) took 1573 ms. Trace:
I20260709 13:07:27.740608 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.710959 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:27.711441 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:27.715570 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.736208 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:27.761245 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:27.722795 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:27.941890 19973 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:27.776793 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:27.980425 15640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2249) took 1541 ms (client timeout 1685 ms). Trace:
W20260709 13:07:27.980938 15640 rpcz_store.cc:269] 0709 13:07:26.438757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.443942 (+  5185us) service_pool.cc:224] Handling call
0709 13:07:27.980137 (+1536195us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540019bc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.980354 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900410240}
I20260709 13:07:27.982702 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2569) took 1265 ms. Trace:
W20260709 13:07:27.983543 19942 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.043s	sys 0.088s
I20260709 13:07:27.945837 15644 rpcz_store.cc:276] 0709 13:07:26.534782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.722235 (+187453us) service_pool.cc:224] Handling call
0709 13:07:26.722553 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.910029 (+187476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.737944 (+827915us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000a9e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:27.738421 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429439744}
I20260709 13:07:27.983192 15789 rpcz_store.cc:276] 0709 13:07:26.717334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.852352 (+135018us) service_pool.cc:224] Handling call
0709 13:07:27.982408 (+1130056us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540021b6d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.982610 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050694528}
W20260709 13:07:27.953908 15646 rpcz_store.cc:269] 0709 13:07:26.108110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.109133 (+  1023us) service_pool.cc:224] Handling call
0709 13:07:27.742056 (+1632923us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002db754. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.742322 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3220449664}
I20260709 13:07:27.955814 15790 rpcz_store.cc:276] 0709 13:07:26.644172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.730793 (+ 86621us) service_pool.cc:224] Handling call
0709 13:07:27.764047 (+1033254us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54001383d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.764283 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200253824}
I20260709 13:07:28.017200 19758 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:28.017633 15720 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:28.018360 19758 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:27.956141 15787 rpcz_store.cc:276] 0709 13:07:26.440974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.865362 (+424388us) service_pool.cc:224] Handling call
0709 13:07:27.765984 (+900622us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5400136fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.766273 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89204608}
I20260709 13:07:27.953491 19882 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:27.955715 15792 rpcz_store.cc:269] 0709 13:07:26.157322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.157456 (+   134us) service_pool.cc:224] Handling call
0709 13:07:27.770802 (+1613346us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400137ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.771070 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363572480}
I20260709 13:07:27.956298 15643 rpcz_store.cc:276] 0709 13:07:26.155269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.155420 (+   151us) service_pool.cc:224] Handling call
0709 13:07:27.728089 (+1572669us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54000e8dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:27.728472 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305231104}
I20260709 13:07:28.016844 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:27.945624 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:27.639292 19945 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:27.903141 20014 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:28.032027 15639 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:28.037359 15794 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.040138 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2329) took 1686 ms. Trace:
I20260709 13:07:28.040679 15790 rpcz_store.cc:276] 0709 13:07:26.345197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.018373 (+1673176us) service_pool.cc:224] Handling call
0709 13:07:28.018936 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.019332 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.019358 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.019438 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.019493 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.031631 (+ 12138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.031784 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.040534 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2572) took 1158 ms. Trace:
I20260709 13:07:28.047158 15638 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:28.046797 15715 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.045907 15788 rpcz_store.cc:276] 0709 13:07:26.882469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.107381 (+224912us) service_pool.cc:224] Handling call
0709 13:07:28.007979 (+900598us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002193d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:28.040464 (+ 32485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491383040}
I20260709 13:07:28.055738 15641 raft_consensus.cc:2410] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:28.060299 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.063208 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:28.065214 15718 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:28.061514 15647 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:28.069038 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.078601 20011 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.078802 19889 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.079533 19889 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.080123 19889 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.079986 19887 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:28.081025 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:28.081871 19913 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:28.082492 15719 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 9: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:28.082659 19699 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.083997 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.083684 19699 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.084961 15719 raft_consensus.cc:2376] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11. Re-sending same reply.
I20260709 13:07:28.078881 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2265) took 1401 ms. Trace:
I20260709 13:07:28.086740 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:28.093657 15646 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.087684 15645 rpcz_store.cc:276] 0709 13:07:26.640267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.786215 (+145948us) service_pool.cc:224] Handling call
0709 13:07:26.786493 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.913966 (+1127473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.041468 (+127502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.103240 20014 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.105772 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.107136 15716 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
W20260709 13:07:28.108213 15533 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.409s	user 0.006s	sys 0.023s
I20260709 13:07:28.100983 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:28.116313 20004 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:28.079800 20011 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.120590 15713 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:28.093864 15717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.019s	sys 0.066s
I20260709 13:07:28.124439 15641 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.124601 15638 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:28.125181 15638 pending_rounds.cc:85] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 4
I20260709 13:07:28.054925 19973 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.130326 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.129783 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1789) took 1010 ms. Trace:
W20260709 13:07:28.134510 15717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.021s	sys 0.066s
I20260709 13:07:28.134409 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:28.133446 15713 rpcz_store.cc:276] 0709 13:07:27.119017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.543797 (+424780us) service_pool.cc:224] Handling call
0709 13:07:28.122852 (+579055us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:28.131613 15722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.012s	sys 0.019s
W20260709 13:07:28.082580 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 501950us
W20260709 13:07:28.125626 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 180498us
I20260709 13:07:28.103261 19699 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:28.150027 15722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.019s
I20260709 13:07:28.151826 15644 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.149173 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.143127 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:28.143278 19834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.044s
I20260709 13:07:28.156752 15643 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.157233 15789 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.147289 15638 pending_rounds.cc:107] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:28.157851 15714 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:28.165714 19893 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.166322 19942 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:28.167266 19942 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.167824 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:28.160605 15638 raft_consensus.cc:2889] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.208760 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.212004 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 602) took 1742 ms. Trace:
I20260709 13:07:28.214392 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.216266 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.193994 19758 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:28.212486 15788 rpcz_store.cc:276] 0709 13:07:26.456208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.068940 (+1612732us) service_pool.cc:224] Handling call
0709 13:07:28.137791 (+ 68851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.185515 (+ 47724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.185556 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.198451 (+ 12895us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:28.198518 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.198597 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.198728 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:28.183612 19834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.005s	sys 0.045s
I20260709 13:07:28.227905 19918 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:28.228114 15793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2331) took 1869 ms (client timeout 1763 ms). Trace:
I20260709 13:07:28.228475 19918 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.229002 19918 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.228554 15793 rpcz_store.cc:269] 0709 13:07:26.358177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.375458 (+ 17281us) service_pool.cc:224] Handling call
0709 13:07:28.227600 (+1852142us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54001fa9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:28.227892 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994614656}
I20260709 13:07:28.168681 19945 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:07:28.236300 15642 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:28.235114 15791 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:28.239161 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:28.190806 19946 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.237254 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.207805 19887 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.246294 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.242991 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2339) took 1783 ms. Trace:
I20260709 13:07:28.245267 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.256088 15714 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:28.248912 15713 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.254822 15791 rpcz_store.cc:276] 0709 13:07:26.459537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.098807 (+1639270us) service_pool.cc:224] Handling call
0709 13:07:28.184701 (+ 85894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.242677 (+ 57976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.242927 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:28.267613 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.243440 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 536856us
I20260709 13:07:28.272434 15719 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 8: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:28.246300 19946 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.277529 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:28.278621 15788 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 13:07:28.278949 19699 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.279320 19699 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:28.279917 19699 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.282302 19844 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.282778 19844 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.283200 19844 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.283743 19867 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.288350 20011 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:28.289865 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.290969 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0082389549999107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:07:28.294510 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:28.296907 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:28.297937 19778 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:28.298522 19778 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:28.298924 20019 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:28.277755 19574 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:28.300776 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1786) took 1183 ms. Trace:
I20260709 13:07:28.300241 19778 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.301195 15717 rpcz_store.cc:276] 0709 13:07:27.117053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.117187 (+   134us) service_pool.cc:224] Handling call
0709 13:07:27.117614 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.146968 (+ 29354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.147011 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.147639 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.232808 (+1085169us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:28.232937 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.233086 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.300442 (+ 67356us) raft_consensus.cc:1685] finished
0709 13:07:28.300464 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.300670 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28808,"raft.queue_time_us":61611,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":128298,"thread_start_us":990060,"threads_started":1,"wal-append.queue_time_us":988659}
I20260709 13:07:28.303021 19946 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.303591 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.305029 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.298960 19973 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:28.267167 19887 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.307456 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.308355 15641 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
W20260709 13:07:28.278640 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 146574us
W20260709 13:07:28.278647 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 91278.2us
I20260709 13:07:28.312424 19935 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:28.313138 19718 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:28.302435 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.315897 19942 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.316434 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.276471 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.279458 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2573) took 1396 ms. Trace:
I20260709 13:07:28.319746 15788 rpcz_store.cc:276] 0709 13:07:26.882755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.239853 (+1357098us) service_pool.cc:224] Handling call
0709 13:07:28.278259 (+ 38406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.279103 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.279313 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.309409 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:28.308458 20023 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:07:28.314865 19983 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:28.327481 15794 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:07:28.331370 16333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 773) took 4151 ms (client timeout 1733 ms). Trace:
I20260709 13:07:28.333660 15714 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:28.337251 15794 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2334) took 1959 ms (client timeout 2004 ms). Trace:
I20260709 13:07:28.349752 15717 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:28.337538 15643 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:28.342509 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1793) took 1164 ms. Trace:
I20260709 13:07:28.346966 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.339440 15715 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
W20260709 13:07:28.346719 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50112.7us
I20260709 13:07:28.390309 15714 rpcz_store.cc:276] 0709 13:07:27.187307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.321999 (+1134692us) service_pool.cc:224] Handling call
0709 13:07:28.333264 (+ 11265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.336841 (+  3577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.342435 (+  5594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.394234 15641 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
W20260709 13:07:28.337788 15794 rpcz_store.cc:269] 0709 13:07:26.378270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.557690 (+179420us) service_pool.cc:224] Handling call
0709 13:07:27.776512 (+1218822us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5800014a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1f8c 00007fad222e1ef6 0000000000375939 00007fad2a3551e0 00007fad2a41e0c4 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:28.337193 (+560681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373822080}
W20260709 13:07:28.336472 16333 rpcz_store.cc:269] 0709 13:07:24.174529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.175119 (+   590us) service_pool.cc:224] Handling call
0709 13:07:28.309509 (+4134390us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54003f5554. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:28.317860 (+  8351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5102600960}
I20260709 13:07:28.420428 15713 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:28.422837 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 131158us
I20260709 13:07:28.342188 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2328) took 1996 ms. Trace:
I20260709 13:07:28.342674 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.426788 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1791) took 1307 ms. Trace:
I20260709 13:07:28.426671 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.427874 15715 rpcz_store.cc:276] 0709 13:07:27.119648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.534392 (+414744us) service_pool.cc:224] Handling call
0709 13:07:28.421285 (+886893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.431295 15646 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:28.433198 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.434307 15646 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.435202 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.436247 15646 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:28.437129 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.441913 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.442891 15641 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
I20260709 13:07:28.443987 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:28.444873 15641 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.449543 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.450795 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.452162 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 260629us
I20260709 13:07:28.452841 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 789) took 1912 ms. Trace:
I20260709 13:07:28.399927 19778 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.456015 19726 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.456233 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.456743 19726 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.458516 19773 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.459474 19726 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:28.460302 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.461189 15788 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
W20260709 13:07:28.461323 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:28.463371 15647 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 6.
I20260709 13:07:28.464586 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:28.465238 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.465963 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:28.470331 19935 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.470790 19935 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:28.471226 19935 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.471520 19725 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.472084 19725 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.472914 15642 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:28.472460 20014 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.474356 15642 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:28.475039 19725 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.475975 15642 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:28.476559 19887 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.459211 19773 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.477439 15642 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:28.498400 15646 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:28.457262 15716 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:28.499931 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.336229 19983 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:28.300832 19574 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.484668 19913 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:28.349016 19918 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.479010 19773 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:28.517935 15721 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:28.347347 19893 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:28.482846 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:28.481810 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 169533us
I20260709 13:07:28.347112 19839 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:28.512821 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1787) took 1394 ms. Trace:
I20260709 13:07:28.425348 15795 rpcz_store.cc:276] 0709 13:07:26.340405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.774520 (+1434115us) service_pool.cc:224] Handling call
0709 13:07:27.775263 (+   743us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:27.776316 (+  1053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.776386 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:27.777608 (+  1222us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.030443 (+252835us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.048192 (+ 17749us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.060759 (+ 12567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.065641 (+  4882us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.336184 (+270543us) raft_consensus.cc:1685] finished
0709 13:07:28.336206 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.336356 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41592,"prepare.queue_time_us":15464,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":66,"raft.queue_time_us":79754,"raft.run_cpu_time_us":650,"raft.run_wall_time_us":141864,"thread_start_us":188138,"threads_started":1,"wal-append.queue_time_us":507064}
I20260709 13:07:28.516678 15789 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:07:28.484733 19877 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.534s	user 0.019s	sys 0.000s
I20260709 13:07:28.521086 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.522226 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.527436 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.530051 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.531371 15642 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:28.523557 15716 rpcz_store.cc:276] 0709 13:07:27.118317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.108215 (+989898us) service_pool.cc:224] Handling call
0709 13:07:28.455963 (+347748us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b58001e2798. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:07:28.512745 (+ 56782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11438848}
I20260709 13:07:28.532691 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2335) took 2137 ms. Trace:
I20260709 13:07:28.533120 15789 rpcz_store.cc:276] 0709 13:07:26.387020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.054804 (+1667784us) service_pool.cc:224] Handling call
0709 13:07:28.122088 (+ 67284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.524491 (+402403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.524729 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.528787 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2897) took 1426 ms. Trace:
I20260709 13:07:28.542318 15638 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.544401 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.546188 15715 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:28.549438 15791 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:28.453305 16327 rpcz_store.cc:276] 0709 13:07:26.540353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.541479 (+  1126us) service_pool.cc:224] Handling call
0709 13:07:26.542721 (+  1242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.813837 (+271116us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:27.587442 (+773605us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.128526 (+541084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.144943 (+ 16417us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:28.159440 (+ 14497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.452302 (+292862us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400731754. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:28.452350 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.452566 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45456,"prepare.queue_time_us":1253015,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":7121,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":30116,"spinlock_wait_cycles":622706048,"thread_start_us":1207640,"threads_started":2,"wal-append.queue_time_us":503724}
I20260709 13:07:28.555699 15642 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:28.556839 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.557031 19574 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.557528 15642 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:28.558007 19773 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:28.558646 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:28.558737 19773 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.560038 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.559876 19889 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.567950 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:28.569567 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.533501 19877 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.532196 19913 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:28.636286 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65532.7us
I20260709 13:07:28.628610 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.658098 15646 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.632815 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.659632 15715 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.619767 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:28.663095 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.573879 15642 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:28.534132 15722 rpcz_store.cc:276] 0709 13:07:27.102434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.107983 (+  5549us) service_pool.cc:224] Handling call
0709 13:07:27.108364 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.108625 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:28.175679 (+1067054us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.485021 (+309342us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.485461 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.485632 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.485699 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.493540 (+  7841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.503852 (+ 10312us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.528710 (+ 24858us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1052652,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":150,"raft.queue_time_us":33094,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":13587,"spinlock_wait_cycles":13715840,"thread_start_us":816042,"threads_started":2}
I20260709 13:07:28.573721 15643 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:28.589310 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44883.9us
I20260709 13:07:28.634968 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:28.587677 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:28.631023 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.614753 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:28.619498 19889 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.636673 20040 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.616721 19574 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:28.635246 19938 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:28.687853 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53023.4us
I20260709 13:07:28.620290 19918 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.636503 19773 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:28.688117 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 73498.7us
I20260709 13:07:28.694023 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:28.696280 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:28.691887 15759 leader_election.cc:336] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.565s (SENT)
W20260709 13:07:28.704432 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 441665us
I20260709 13:07:28.705281 15795 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:28.706542 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:28.706820 15646 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:28.708155 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:28.656359 19946 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.712021 15791 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:28.718647 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:28.704545 19839 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.726660 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.711129 19942 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:28.706269 19893 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.732033 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.735234 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.619177 19983 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.739444 15645 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.731782 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:28.740118 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 216427us
I20260709 13:07:28.732788 15795 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:28.701472 19574 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.743796 15647 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:28.746716 19693 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.746959 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.728655 19839 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.745057 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.731904 19773 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.747251 19945 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:28.734385 19942 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:28.752172 15685 connection.cc:256] RPC call timeout handler was delayed by -1.3282107890000816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 13:07:28.760418 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:28.761539 19726 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.701634 20040 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.747294 19693 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.731755 19893 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:28.739785 19889 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:28.755082 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.750203 15639 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:28.752979 19839 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.761698 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:28.770514 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 230686us
I20260709 13:07:28.771808 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.775561 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:28.780699 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:28.782245 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.822415 15789 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:07:28.791077 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.793780 15641 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:28.790961 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 634) took 1067 ms. Trace:
I20260709 13:07:28.787060 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:28.766628 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1800) took 1050 ms. Trace:
I20260709 13:07:28.828647 15639 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.768316 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:28.800576 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:28.826833 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.789258 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.812029 15715 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:28.802207 15788 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:28.832335 15713 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:07:28.827493 15721 rpcz_store.cc:276] 0709 13:07:27.723292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.487093 (+763801us) service_pool.cc:224] Handling call
0709 13:07:28.502585 (+ 15492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.518682 (+ 16097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.790708 (+272026us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b54001e8050. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:28.790871 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29710080}
I20260709 13:07:28.783633 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2340) took 2041 ms. Trace:
I20260709 13:07:28.832844 15713 pending_rounds.cc:85] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 6
I20260709 13:07:28.844453 15713 pending_rounds.cc:107] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:07:28.788973 20030 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.552s	user 0.006s	sys 0.004s
I20260709 13:07:28.844765 15713 raft_consensus.cc:2889] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.848652 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:28.827791 15714 rpcz_store.cc:276] 0709 13:07:27.716167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.423792 (+707625us) service_pool.cc:224] Handling call
0709 13:07:28.447077 (+ 23285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.447638 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:28.447671 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.448239 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.682056 (+233817us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.682112 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.682191 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.766243 (+ 84052us) raft_consensus.cc:1685] finished
0709 13:07:28.766272 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.766514 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2295,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":226,"thread_start_us":228696,"threads_started":1,"wal-append.queue_time_us":308181}
I20260709 13:07:28.787747 19945 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.770476 19877 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.846387 15795 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:28.848152 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.766139 19693 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.775319 19946 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.767463 20040 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.752135 20032 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:28.776618 19938 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.851626 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.771916 19889 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.768532 19893 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.785498 19882 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.845816 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 164058us
I20260709 13:07:28.855965 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2898) took 1702 ms. Trace:
I20260709 13:07:28.765287 19574 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.857259 15722 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.766170 19887 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:28.762142 19726 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:28.833065 15790 rpcz_store.cc:276] 0709 13:07:26.742739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.126610 (+1383871us) service_pool.cc:224] Handling call
0709 13:07:28.136416 (+  9806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.189543 (+ 53127us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:28.189587 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.223222 (+ 33635us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.447605 (+224383us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800268a80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:28.672432 (+224827us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:28.672496 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.673562 (+  1066us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.783270 (+109708us) raft_consensus.cc:1685] finished
0709 13:07:28.783291 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.783561 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30296,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":30094,"spinlock_wait_cycles":34941312,"thread_start_us":224557,"threads_started":1,"wal-append.queue_time_us":474814}
I20260709 13:07:28.790511 19983 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.836910 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 75308.9us
I20260709 13:07:28.860970 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:28.861183 15791 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:28.799376 19942 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.859140 15720 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:28.782711 15540 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 6, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 6 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.850556 19834 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.882380 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:28.882634 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 95749.3us
I20260709 13:07:28.883262 15789 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:28.872323 19889 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.859597 19945 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.875239 19882 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.776132 19699 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.880331 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:28.878132 19726 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.885427 20032 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:28.888535 19913 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:28.890980 19844 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.004s
I20260709 13:07:28.894057 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.873044 15719 rpcz_store.cc:276] 0709 13:07:27.153339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.308999 (+1155660us) service_pool.cc:224] Handling call
0709 13:07:28.400899 (+ 91900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.445850 (+ 44951us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:28.533308 (+ 87458us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.846795 (+313487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.846852 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.853299 (+  6447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.853423 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.855655 (+  2232us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54002a8850. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:28.855852 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43303,"prepare.queue_time_us":128529,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":15291,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16799,"spinlock_wait_cycles":185184512,"thread_start_us":212958,"threads_started":1}
I20260709 13:07:28.899895 15688 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:28.901388 19778 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:28.902290 20037 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 13:07:28.914196 15790 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:28.904780 19935 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.912748 15795 raft_consensus.cc:2376] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 10. Re-sending same reply.
I20260709 13:07:28.920032 19574 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.923099 15610 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:28.923535 19574 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.925860 20040 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.926388 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:28.926612 20040 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.928371 20032 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.931609 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:28.932330 16331 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:28.932596 19574 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.929448 20040 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.933238 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:28.933971 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.934625 15788 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:28.920257 19913 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.935948 15788 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:28.936168 19913 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.938539 19913 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.914939 19778 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:28.942193 19778 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.941828 19887 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.944221 19887 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:28.946431 15789 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:28.947657 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:28.949035 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:28.951184 19699 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:28.952037 15794 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:28.957046 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1804) took 1239 ms. Trace:
I20260709 13:07:28.884891 15533 maintenance_manager.cc:643] P 309d6534a0164bf3ab5f6a8a7f6a5a65: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.063s	user 0.206s	sys 0.162s Metrics: {"bytes_written":29519,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":238225,"dirs.run_cpu_time_us":508,"dirs.run_wall_time_us":21610,"drs_written":1,"lbm_read_time_us":433,"lbm_reads_lt_1ms":4,"lbm_write_time_us":354497,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":12,"lbm_writes_lt_1ms":20,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":535363,"threads_started":2,"update_count":5,"wal-append.queue_time_us":407961}
I20260709 13:07:28.959928 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:28.960354 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2327) took 2577 ms. Trace:
I20260709 13:07:28.957585 15713 rpcz_store.cc:276] 0709 13:07:27.721700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.424125 (+702425us) service_pool.cc:224] Handling call
0709 13:07:28.488661 (+ 64536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.909857 (+421196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.956664 (+ 46807us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001e7654. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:28.956958 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718678400}
I20260709 13:07:28.963855 15540 catalog_manager.cc:5697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 4 to 7, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.920794 19877 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:28.966192 19877 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:28.893918 19938 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.967327 19877 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.967788 19938 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:28.918251 19773 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.970270 19773 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.960832 15796 rpcz_store.cc:276] 0709 13:07:26.335294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.772786 (+1437492us) service_pool.cc:224] Handling call
0709 13:07:27.773382 (+   596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:27.955207 (+181825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.955239 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:28.019341 (+ 64102us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.057606 (+ 38265us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.070602 (+ 12996us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.086888 (+ 16286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.086967 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.344424 (+257457us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b48001d01d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:28.772835 (+428411us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:28.912120 (+139285us) raft_consensus.cc:1685] finished
0709 13:07:28.912140 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.912270 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19648,"prepare.queue_time_us":12814,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":22198,"raft.queue_time_us":130173,"raft.run_cpu_time_us":3924,"raft.run_wall_time_us":365243,"spinlock_wait_cycles":50600448,"thread_start_us":37646,"threads_started":1,"wal-append.queue_time_us":101003}
I20260709 13:07:28.882426 19834 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:28.972352 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 72654.6us
I20260709 13:07:28.972434 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:28.982322 15794 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:28.983117 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 67222.1us
W20260709 13:07:28.985036 20041 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:07:28.985198 15534 maintenance_manager.cc:419] P 309d6534a0164bf3ab5f6a8a7f6a5a65: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8609 bytes on disk
I20260709 13:07:28.949590 15789 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.919238 19844 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:28.995770 16327 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:28.986160 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:28.987470 16325 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:28.987646 19834 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.988128 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:28.989266 15796 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:28.925572 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:29.001139 15795 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:29.004734 15794 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:29.005825 15790 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.010254 15722 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:29.013581 19935 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.005842 15796 pending_rounds.cc:85] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 9
I20260709 13:07:29.014542 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.014835 15796 pending_rounds.cc:107] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:29.015257 15796 raft_consensus.cc:2889] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.013965 19779 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:29.013612 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88206.8us
I20260709 13:07:29.020718 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2570) took 2139 ms. Trace:
I20260709 13:07:29.021710 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.023938 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:29.029471 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.030050 16329 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13. Re-sending same reply.
I20260709 13:07:29.016736 19779 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.037372 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.037999 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2575) took 2154 ms. Trace:
W20260709 13:07:29.039531 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 203727us
I20260709 13:07:29.039747 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.023581 19918 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.022744 19938 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.019410 20053 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.042502 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1805) took 1320 ms. Trace:
I20260709 13:07:29.045607 19972 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:29.047117 19907 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:29.049971 20017 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:29.023243 15792 rpcz_store.cc:276] 0709 13:07:26.881837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.156644 (+1274807us) service_pool.cc:224] Handling call
0709 13:07:28.189685 (+ 33041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.235196 (+ 45511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.235227 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.286075 (+ 50848us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.556958 (+270883us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b1800355900. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:28.707976 (+151018us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.006579 (+298603us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.006863 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.006952 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.006997 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:29.020469 (+ 13472us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.020647 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6648,"prepare.queue_time_us":61547,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":23351,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":48871,"spinlock_wait_cycles":64888064,"thread_start_us":412647,"threads_started":2,"wal-append.queue_time_us":469924}
W20260709 13:07:29.050520 15545 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 277) took 43685 ms (client timeout 15000 ms). Trace:
I20260709 13:07:28.987306 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet b106b4017dc84b21a7c6f58814593886 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:53344
I20260709 13:07:29.028947 19946 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.038506 15793 rpcz_store.cc:276] 0709 13:07:26.883332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.229956 (+1346624us) service_pool.cc:224] Handling call
0709 13:07:28.230688 (+   732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.232332 (+  1644us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:28.232964 (+   632us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.650285 (+417321us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.650412 (+   127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.682371 (+ 31959us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.682578 (+   207us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.682858 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.683123 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.683232 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.769437 (+ 86205us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b1800439180. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:28.989064 (+219627us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b2400262478. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2219f9c4 00007fad2219dacb 00007fad22358dc9 00007fad22358a55 00007fad22357fb0 00007fad24fce488 00007fad24fcebe8 00007fad24fa6398 00007fad24fa176a 00007fad24fa0bb6
0709 13:07:29.037784 (+ 48720us) raft_consensus.cc:1685] finished
0709 13:07:29.037811 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.037938 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113124,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":120,"raft.queue_time_us":3170,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":19099,"spinlock_wait_cycles":54478336,"thread_start_us":415662,"threads_started":1,"wal-append.queue_time_us":505944}
I20260709 13:07:29.053120 15795 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:29.039722 19574 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:29.075731 19574 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:29.076257 19574 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.077836 20040 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.078330 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 600) took 2633 ms. Trace:
W20260709 13:07:29.079631 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50435us
I20260709 13:07:29.078796 15787 rpcz_store.cc:276] 0709 13:07:26.444772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.462244 (+2017472us) service_pool.cc:224] Handling call
0709 13:07:28.462717 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.463308 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.463347 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.463972 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.708423 (+244451us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:28.708486 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.708586 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.027354 (+318768us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b2400262478. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2219f9c4 00007fad2219dacb 00007fad22358dc9 00007fad22358a55 00007fad22357fb0 00007fad24fce488 00007fad24fcebe8 00007fad24fa6398 00007fad24fa176a 00007fad24fa0bb6
0709 13:07:29.077961 (+ 50607us) raft_consensus.cc:1685] finished
0709 13:07:29.078001 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.078259 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6707,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":34118528,"thread_start_us":243943,"threads_started":1,"wal-append.queue_time_us":456507}
I20260709 13:07:29.039690 19779 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.043304 19954 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.082985 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:29.055629 20053 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.089941 15789 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:07:29.096117 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60930us
I20260709 13:07:29.062657 19693 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.094233 15540 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 5 to 7, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.059451 19918 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:29.054466 19882 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.064749 19907 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.039538 19935 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:07:29.114943 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:29.113076 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 61143.8us
I20260709 13:07:29.117856 15796 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.108275 20057 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:29.121470 19693 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.055784 15717 rpcz_store.cc:276] 0709 13:07:27.722236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.424917 (+702681us) service_pool.cc:224] Handling call
0709 13:07:28.451623 (+ 26706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.451941 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:28.852190 (+400249us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.039087 (+186897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.042282 (+  3195us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.042333 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.042382 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.042461 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78289,"prepare.queue_time_us":187744,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3819,"raft.queue_time_us":25279,"thread_start_us":389599,"threads_started":2}
I20260709 13:07:29.124421 19844 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.091766 19954 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:29.131349 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.125840 19907 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.137413 15533 maintenance_manager.cc:643] P 309d6534a0164bf3ab5f6a8a7f6a5a65: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.120s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":24837,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
W20260709 13:07:29.130472 19829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.031s	sys 0.043s
I20260709 13:07:29.110735 20053 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.137444 15540 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 4 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 5 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.148406 19882 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:29.148959 19946 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.149516 19938 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:29.140635 19954 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.119210 20017 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:29.152462 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.157523 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:29.152124 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.157884 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.196914 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.203006 15713 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
W20260709 13:07:29.206521 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 113830us
I20260709 13:07:29.157375 15540 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 4 to 5, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 5 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.142840 20032 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:29.231107 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 73406.5us
W20260709 13:07:29.144243 19829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.031s	sys 0.044s
W20260709 13:07:29.237556 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 152315us
I20260709 13:07:29.155159 19882 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.264808 15540 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 5 to 7, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.267314 15717 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:29.267936 19726 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:29.278720 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46804.6us
W20260709 13:07:29.282467 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 211978us
W20260709 13:07:29.065544 15545 rpcz_store.cc:269] 0709 13:06:45.365791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.366304 (+   513us) service_pool.cc:224] Handling call
0709 13:07:29.050225 (+43683921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:18.230967 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:18.231704 (+   737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:18.231763 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:18.231782 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:18.232545 (+   763us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:18.232617 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:18.232646 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:18.233308 (+   662us) tablet.cc:701] Row locks acquired
0709 13:07:18.233359 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:07:18.233517 (+   158us) write_op.cc:270] Start()
0709 13:07:18.233672 (+   155us) write_op.cc:276] Timestamp: P: 1783602438233453 usec, L: 0
0709 13:07:18.233695 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:18.337110 (+103415us) log.cc:844] Serialized 2064 byte log entry
0709 13:07:19.304159 (+967049us) op_driver.cc:464] REPLICATION: finished
0709 13:07:19.846373 (+542214us) write_op.cc:301] APPLY: starting
0709 13:07:19.858419 (+ 12046us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:19.901123 (+ 42704us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:19.901225 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:19.941970 (+ 40745us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:20.083204 (+141234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:20.091072 (+  7868us) write_op.cc:312] APPLY: finished
0709 13:07:20.104362 (+ 13290us) log.cc:844] Serialized 47 byte log entry
0709 13:07:20.104591 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.104713 (+   122us) write_op.cc:454] Released schema lock
0709 13:07:20.104799 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:20.111435 (+  6636us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.111470 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":473650,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":480659,"apply.run_cpu_time_us":4624,"apply.run_wall_time_us":289188,"num_ops":5,"prepare.queue_time_us":458758,"prepare.run_cpu_time_us":82621,"prepare.run_wall_time_us":427208,"raft.queue_time_us":359713,"raft.run_cpu_time_us":67995,"raft.run_wall_time_us":517531,"replication_time_us":1020126,"thread_start_us":773976,"threads_started":4,"wal-append.queue_time_us":394390,"wal-append.run_cpu_time_us":98921,"wal-append.run_wall_time_us":2436978}]]}
W20260709 13:07:29.285079 15760 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.838s (SENT)
I20260709 13:07:29.239181 19778 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.295413 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:29.296383 19778 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.296679 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:29.297896 19773 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:29.298379 20061 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:07:29.289952 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 89168.7us
I20260709 13:07:29.291354 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:29.268441 19946 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:29.294140 20058 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:07:29.306622 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.269111 19935 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:29.307021 15540 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 1 to 6, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 6 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:29.321213 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.325973 19887 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:29.330644 20064 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:29.334909 20001 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:29.335367 20001 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:29.336265 20001 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.337438 20001 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.338866 19882 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.340123 19882 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.346794 15796 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:29.348542 15790 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:29.304039 19844 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.312575 19726 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:29.358923 20062 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:29.359514 20062 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.302429 19778 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:29.277280 19918 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:29.370501 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.362900 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.371779 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.375379 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:29.370949 19829 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:07:29.380347 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65907.6us
I20260709 13:07:29.379561 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.367012 19972 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:29.369066 15540 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:29.312218 19834 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.393949 16297 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:29.366143 19778 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:29.368707 19574 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.395634 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.394420 20032 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.369511 20040 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.351966 19889 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.362774 20068 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:29.397119 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.386253 20017 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:29.388593 19893 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:07:29.405253 19983 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.405998 15540 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 8, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 8 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.409304 19574 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.384594 19773 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.410679 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.373400 19954 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:29.416756 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 138088us
I20260709 13:07:29.419620 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.420557 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.426252 15713 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.399718 19778 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.429010 15540 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 4 to 6, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 6 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.433053 16334 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:29.432883 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet b106b4017dc84b21a7c6f58814593886 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:07:29.434458 19726 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:29.434520 19938 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.435029 19726 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:29.455494 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.405333 20053 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.434018 20062 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.415095 19983 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:29.416379 19699 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.460932 19726 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:29.436795 19945 consensus_meta.cc:287] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:07:29.420233 19877 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.428016 20040 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:29.464478 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:29.465394 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.420121 19773 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:29.470894 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66585.5us
I20260709 13:07:29.439831 20032 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:29.473423 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:29.455278 15540 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 6, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 6 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:07:29.475487 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 78471us
I20260709 13:07:29.476713 15719 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:29.462836 19834 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.466970 19983 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.418071 19893 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.472065 19945 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.486984 19778 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.472430 19907 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.483717 19877 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:29.491894 19778 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.492492 19877 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.492643 19889 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.497710 19726 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.499394 20053 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.473212 19574 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:29.484305 19839 consensus_meta.cc:287] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.005s
I20260709 13:07:29.504019 19839 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.504859 19779 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.506595 19839 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.507797 19954 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:29.510882 19779 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.517536 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:29.518208 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58086.1us
I20260709 13:07:29.519380 20053 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.518216 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.472383 20040 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:29.520977 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.521070 20040 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.522495 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.523241 16327 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:29.526458 16329 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:29.517689 20077 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.520120 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.528333 16334 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:29.528753 19907 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:29.529111 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:29.476929 19699 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:29.531049 19699 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.532147 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:29.517987 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 90252.5us
I20260709 13:07:29.533221 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.533366 20057 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.532894 19945 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.533947 20060 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:29.533947 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.536252 19844 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:29.536725 19844 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.535967 15719 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.484926 15713 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:29.541885 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.534504 19935 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:29.477082 19773 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.554121 15540 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.555176 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:29.557304 15760 leader_election.cc:336] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.775s (SENT)
I20260709 13:07:29.536989 20057 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.424877 19946 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.557864 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.557726 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:29.568578 16327 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:29.570474 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 143447us
I20260709 13:07:29.481976 20032 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:29.476768 20017 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:29.583012 20072 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.583544 20057 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.584903 15788 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:29.587852 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 110103us
I20260709 13:07:29.587819 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:29.592432 15790 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.589385 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:29.570148 19918 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:29.607846 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 74696.4us
I20260709 13:07:29.606269 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.572974 20053 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.574144 19574 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:29.582044 20032 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.578800 19907 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.617238 15790 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:29.623119 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:29.623450 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 66180.9us
I20260709 13:07:29.626070 16327 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:29.573853 19887 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:29.628341 19887 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:29.631147 19893 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.641885 19574 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:29.652606 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.655293 15760 leader_election.cc:336] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.864s (SENT)
W20260709 13:07:29.655468 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0305690040000854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:07:29.650122 19844 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.659247 19844 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.660207 19983 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.662154 19893 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:29.663826 19983 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:29.663470 20017 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.657258 15713 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:29.650436 20072 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:29.671144 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.672075 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.662179 20071 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:07:29.677603 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:29.680238 15647 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.680619 15713 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:29.621771 20053 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.684234 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:29.674916 19778 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.685132 15645 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 7: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:29.685482 19778 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.686283 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:29.687006 15645 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.687685 19778 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.688265 19778 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:29.688804 19778 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.689354 15641 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:29.691821 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:29.692427 15642 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.675041 20072 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.695811 20072 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:29.696981 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:29.699184 16334 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.699111 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.700397 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.701135 16329 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:29.701295 16331 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.701592 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.702181 16334 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.702375 16333 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:29.703315 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.704005 16326 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.704465 19942 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.701303 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.706604 16325 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:29.710472 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.713083 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.716513 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.717598 15715 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:29.719898 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.721107 20053 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.722572 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.723220 15722 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:29.721903 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.724583 15714 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:29.645264 19574 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.733309 15638 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:29.733485 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.734314 16334 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:29.734206 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.734915 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.735455 16329 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:29.736400 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.737393 16328 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:29.736503 20040 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.736398 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.742512 16333 raft_consensus.cc:2368] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10.
I20260709 13:07:29.743106 15643 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:29.743556 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.743835 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.744402 15717 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
W20260709 13:07:29.745157 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 94550.8us
I20260709 13:07:29.746620 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.748735 15714 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:29.750723 15642 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:29.752647 15719 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:29.754243 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.755215 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.756888 15715 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:29.754390 19918 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:29.762316 19945 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:29.762588 20003 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:29.713369 19983 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:29.778251 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.778503 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:29.780692 16331 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:29.781255 16331 pending_rounds.cc:85] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 8
I20260709 13:07:29.781538 16331 pending_rounds.cc:107] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:29.781888 16331 raft_consensus.cc:2889] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.743189 19935 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:29.789647 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.792784 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:29.793357 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.794065 15719 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.795415 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:29.798046 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:29.799435 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 208276us
W20260709 13:07:29.804065 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.801844 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:29.806761 16326 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:07:29.807456 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:29.812479 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.817008 15714 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:07:29.772092 19945 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:29.836150 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.792172 20001 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.837996 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.845870 15715 raft_consensus.cc:2368] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:29.848124 15719 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:29.840528 16333 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.833957 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:29.785543 19877 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:29.806006 19726 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.813561 19913 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.863123 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.863873 16326 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.864140 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.863286 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.868052 15722 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:29.870791 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.806068 19918 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:07:29.842079 20053 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.871742 16333 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:29.813176 19954 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:29.878544 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:29.882416 15722 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.857785 20001 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:29.837838 19972 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:29.888993 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.890856 16333 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:29.893720 15714 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.890456 19778 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.902981 16326 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:29.893941 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.894254 20066 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:29.893805 20079 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:29.913339 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54102.8us
I20260709 13:07:29.914606 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.863898 20032 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:29.905948 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:29.919539 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.920060 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 103105us
I20260709 13:07:29.892308 20057 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:29.924319 19887 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:29.928397 15645 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:29.929332 20040 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:29.930879 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:29.945008 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.951414 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:29.952023 16326 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.952117 15796 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.946087 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.949071 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:29.950158 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:29.956367 15610 connection.cc:256] RPC call timeout handler was delayed by -1.5974793440000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:07:29.956845 15610 connection.cc:256] RPC call timeout handler was delayed by -1.571379343999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 13:07:29.908614 20053 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.958345 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:29.961839 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:29.962513 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:29.965027 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.965648 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.966744 16326 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:29.922991 20066 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:29.969852 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.969177 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.971757 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:29.972235 15795 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.972275 15788 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.968534 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.974535 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.961270 15714 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:29.973534 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.978391 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:29.979368 20072 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.981539 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.982468 15715 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:29.970629 16329 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:29.985838 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:29.986878 15790 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:29.990583 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:29.971093 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.951472 19779 raft_consensus.cc:2764] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:29.997109 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:29.999817 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.000337 16326 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:07:30.000626 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.011409 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.994882 16331 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 6.
I20260709 13:07:30.013586 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:30.014132 15722 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:30.016614 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:30.017565 15759 leader_election.cc:336] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 2.228s (SENT)
I20260709 13:07:30.010370 16325 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:30.027805 15796 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:29.891842 19935 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.033398 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.033687 15759 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:30.035734 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.038554 15790 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:30.036085 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:30.033438 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:29.994107 20057 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:29.936830 19945 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.071990 15722 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:30.069489 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:29.920074 20079 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.077629 16326 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:30.074142 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.077555 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:30.083753 15796 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:30.083446 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:29.994226 19773 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.088841 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.089548 16326 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10. Re-sending same reply.
I20260709 13:07:30.090566 15713 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.079862 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:30.090986 15722 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:30.035969 19918 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:30.034468 20086 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.096046 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:30.093545 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 95532.3us
I20260709 13:07:30.097538 16326 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:07:30.098208 15759 leader_election.cc:336] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.533s (SENT)
I20260709 13:07:30.100033 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.101838 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.102589 15714 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:30.103474 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.104240 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.104790 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.049580 20001 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:30.105762 20095 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.106701 20068 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.107146 20068 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:30.108045 20068 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:30.112764 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 155340us
W20260709 13:07:30.114601 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2806793439999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:07:30.109424 20068 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.116560 15795 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
W20260709 13:07:30.118471 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.119071 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70203.7us
I20260709 13:07:30.119750 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.119889 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.122298 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.122592 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.123410 15647 raft_consensus.cc:2368] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:30.123914 15645 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:30.125485 15713 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.125370 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.126734 16326 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:30.096879 19918 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:30.129693 15790 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:30.131630 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.131923 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.093885 20086 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:30.076407 20053 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:30.141832 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.142597 15645 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.142618 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.143831 15638 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:07:30.147075 20032 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:30.149216 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.150197 15641 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 2.
I20260709 13:07:30.150595 15720 raft_consensus.cc:2410] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:30.150422 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.151883 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.152944 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.132578 15714 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10. Re-sending same reply.
I20260709 13:07:30.154067 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.154340 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.154857 15718 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:30.154996 15714 raft_consensus.cc:2368] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:30.133617 20057 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:30.158566 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.121472 20066 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.158846 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.161659 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.159958 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.567070 16333 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.566062 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.567430 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.567710 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.568235 15641 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:30.568331 15722 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:07:30.194842 15713 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
W20260709 13:07:30.568856 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 433592us
I20260709 13:07:30.174299 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:30.569895 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.532095 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.549091 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.571658 15642 raft_consensus.cc:2410] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
W20260709 13:07:30.395437 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 83551.1us
I20260709 13:07:30.572654 15715 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:30.186982 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.521862 15759 leader_election.cc:336] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.570s (SENT)
I20260709 13:07:30.240999 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:30.575553 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 53745.3us
I20260709 13:07:30.572695 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:30.576807 15759 leader_election.cc:336] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.635s (SENT)
I20260709 13:07:30.573381 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:07:30.471037 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.566099 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.578622 16328 raft_consensus.cc:2410] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:30.579108 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.580142 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.580936 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:30.469653 16298 leader_election.cc:336] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.523s (SENT)
I20260709 13:07:30.583519 15638 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:30.585522 15719 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:30.245270 20079 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:30.163544 20076 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.423s
I20260709 13:07:30.154117 20086 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:30.591882 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.592856 15716 raft_consensus.cc:2368] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:30.594885 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.593029 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.595664 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.595820 15718 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.595755 15647 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:30.186440 19834 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.184260 19877 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.167127 19773 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:30.590399 20017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.006s	sys 0.026s
I20260709 13:07:30.589951 20069 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.599835 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 130237us
I20260709 13:07:30.601300 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:30.603574 16298 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.759s (SENT)
W20260709 13:07:30.594726 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.012s	sys 0.027s
I20260709 13:07:30.599589 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.600423 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:30.601501 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.604007 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:30.594452 20086 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.607813 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.608462 16326 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:30.610839 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.599011 19834 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:30.602684 20017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.006s	sys 0.026s
I20260709 13:07:30.613339 19834 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.614018 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.614450 19834 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.614789 15716 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:30.615717 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:30.617098 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.604812 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.012s	sys 0.027s
I20260709 13:07:30.606684 15715 raft_consensus.cc:2410] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:30.606992 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.618405 15638 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.599378 20085 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.616830 20076 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.621894 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.622440 16334 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.622284 20076 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:30.623517 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.625241 16326 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:30.619170 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 788505us
I20260709 13:07:30.619056 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:30.628997 15641 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:30.159716 19918 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.625891 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.631870 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.630906 16332 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:30.621132 15718 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:30.630617 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.628659 19844 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.633879 16330 raft_consensus.cc:2368] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14.
I20260709 13:07:30.617882 19882 raft_consensus.cc:2764] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:30.657590 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:30.656584 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.659088 15642 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:30.646281 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.660302 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 56776.6us
I20260709 13:07:30.639211 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:30.662539 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.624451 20076 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:30.663259 15795 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:30.656654 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:30.670181 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:30.624867 20085 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:30.608147 20069 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.682791 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.632606 20017 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.691726 15721 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.683954 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:30.692332 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:30.698910 15795 raft_consensus.cc:2368] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:30.696002 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.700681 15644 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:30.702544 15642 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:30.661116 19844 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:30.707857 19844 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.721078 15789 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.722783 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:30.723549 15795 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.726123 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.727018 15790 raft_consensus.cc:2368] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:30.727497 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.728144 15796 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 7.
I20260709 13:07:30.605070 19877 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:30.727054 15760 leader_election.cc:336] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.570s (SENT)
I20260709 13:07:30.729421 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:30.735150 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:30.736367 15760 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.618s (SENT)
I20260709 13:07:30.736783 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:30.737705 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.737944 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:30.738404 15787 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:30.739219 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.739457 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:30.737404 16331 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:30.744163 15795 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:30.745067 19954 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.746187 19954 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:30.747021 19954 consensus_queue.cc:1243] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:30.747525 19954 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:30.748301 19954 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:30.748677 19954 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:30.739418 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:30.751406 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:30.749420 20099 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.620s	user 0.010s	sys 0.008s
I20260709 13:07:30.686172 20071 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.773512 16333 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:30.778004 15788 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:30.782217 15641 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:07:30.758246 15638 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:30.733949 20085 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.768916 20079 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:30.809319 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:30.835671 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 174436us
I20260709 13:07:30.836568 15638 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:30.836476 15642 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.836969 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:30.770560 19907 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:30.847287 15641 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 13:07:30.851236 16298 leader_election.cc:336] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.699s (SENT)
W20260709 13:07:30.859162 15688 connection.cc:256] RPC call timeout handler was delayed by -1.2413425860000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:07:30.861438 20001 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:30.863556 16298 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:30.865202 15639 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:30.816159 19935 raft_consensus.cc:2764] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:30.749580 19954 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.877238 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:30.817042 20079 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:30.877439 15642 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:30.879748 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:30.846164 19942 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.848140 19773 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.875218 20109 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.875640 19907 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:30.894815 15796 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.880753 20076 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:30.888193 20068 consensus_meta.cc:287] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.001s
I20260709 13:07:30.886292 19779 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.894475 19954 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.894099 19942 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:30.912024 19942 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:30.913933 20079 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.915776 20079 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.922412 20069 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:30.895507 20001 raft_consensus.cc:2764] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:30.897899 19773 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:30.928735 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 177411us
I20260709 13:07:30.938463 16327 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7.
W20260709 13:07:30.939993 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 210631us
W20260709 13:07:30.957168 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.964522 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 228164us
W20260709 13:07:30.965245 15760 leader_election.cc:336] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.635s (SENT)
W20260709 13:07:30.965102 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 184358us
I20260709 13:07:30.904522 19779 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.965879 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:30.973237 20110 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:30.976389 19907 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.929006 20066 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:07:31.000164 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.978638 20085 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:30.982244 19773 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:30.990876 15760 leader_election.cc:336] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.830s (SENT)
I20260709 13:07:30.949702 20109 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:07:31.009959 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 130271us
W20260709 13:07:31.015578 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.020910 16298 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:31.024077 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 155631us
W20260709 13:07:31.027125 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1315425860000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 13:07:31.029228 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0721295929999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33840000000000003s for a response
I20260709 13:07:31.029194 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.034057 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:31.034782 16333 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:31.005072 20069 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:31.024276 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 137681us
I20260709 13:07:31.034967 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:31.051298 16325 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:31.057380 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:31.057412 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.059335 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:31.024101 20068 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:31.008446 19844 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.023103 19882 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:31.077350 15685 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:07:31.084185 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 63375.5us
I20260709 13:07:31.087657 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.090188 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.095052 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:31.101634 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 93656.6us
I20260709 13:07:31.086833 19935 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:31.138624 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 190418us
I20260709 13:07:31.050887 19726 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:31.158283 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.163110 15639 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:31.164618 15759 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.096120 20069 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:07:31.175853 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89849.7us
I20260709 13:07:31.087106 20114 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:07:31.179661 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.125394 19877 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.182947 15791 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.171677 20068 consensus_queue.cc:1243] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:31.156128 20076 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.185550 15792 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 13:07:31.185940 15643 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:31.177646 20109 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.191205 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:31.181769 19834 consensus_meta.cc:287] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.009s
W20260709 13:07:31.195115 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.201987 16328 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:31.129838 20120 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:07:31.207167 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 129910us
I20260709 13:07:31.210691 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:31.217867 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.208403 20120 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:31.208499 19935 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:31.209180 19834 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.205664 20129 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:31.241422 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 76920.6us
I20260709 13:07:31.251343 19574 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:31.252195 20101 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 1.091s	user 0.012s	sys 0.000s
I20260709 13:07:31.244127 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:31.213716 20071 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:31.262069 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:31.223124 20109 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.240535 20085 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.276010 15719 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.269850 15715 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:31.262042 19574 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:31.267128 20114 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:31.284888 20132 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:07:31.296452 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 105375us
W20260709 13:07:31.296989 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 202022us
I20260709 13:07:31.269762 19844 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.301699 15719 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.285776 19893 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.221024 20122 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:07:31.301474 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:31.304422 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:31.304644 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 214541us
I20260709 13:07:31.297499 19574 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:31.305598 19946 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.306839 20136 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:31.310343 20145 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.310403 19935 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.300972 19834 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.312920 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.292968 20071 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:31.320528 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1844) took 1174 ms. Trace:
W20260709 13:07:31.324923 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 114296us
I20260709 13:07:31.330732 15789 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.332226 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.339815 15714 rpcz_store.cc:276] 0709 13:07:30.203529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.219215 (+1015686us) service_pool.cc:224] Handling call
0709 13:07:31.227465 (+  8250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.227696 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:31.228023 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.320172 (+ 92149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.320213 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:31.320248 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.320296 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.320478 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11054,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1811,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5681,"thread_start_us":91776,"threads_started":1}
I20260709 13:07:31.335975 15716 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:31.340811 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1840) took 1196 ms. Trace:
I20260709 13:07:31.341259 15713 rpcz_store.cc:276] 0709 13:07:30.144651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.331882 (+1187231us) service_pool.cc:224] Handling call
0709 13:07:31.340757 (+  8875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.332916 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:31.342264 15722 raft_consensus.cc:2376] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9. Re-sending same reply.
I20260709 13:07:31.342773 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1839) took 1198 ms. Trace:
I20260709 13:07:31.343091 15722 rpcz_store.cc:276] 0709 13:07:30.144374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.332600 (+1188226us) service_pool.cc:224] Handling call
0709 13:07:31.342718 (+ 10118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.325655 19574 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.320995 19893 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:31.350620 15760 leader_election.cc:400] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:31.358440 20071 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.331897 20145 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.359449 20133 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.362061 20147 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:07:31.364461 15720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 647) took 1646 ms (client timeout 1818 ms). Trace:
W20260709 13:07:31.372591 15720 rpcz_store.cc:269] 0709 13:07:29.718512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.718640 (+   128us) service_pool.cc:224] Handling call
0709 13:07:31.364151 (+1645511us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540011a3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:31.364362 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988341120}
I20260709 13:07:31.365931 20001 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.369097 15760 leader_election.cc:403] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.370322 15719 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:31.334973 20136 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.379889 20136 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.381482 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:31.381310 19574 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.383026 20143 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.383653 20143 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.384164 19574 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:31.386708 19834 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:31.386991 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 656) took 1603 ms. Trace:
I20260709 13:07:31.388001 19834 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:31.391492 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 69058.9us
I20260709 13:07:31.392823 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:31.387473 15717 rpcz_store.cc:276] 0709 13:07:29.784029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.784190 (+   161us) service_pool.cc:224] Handling call
0709 13:07:29.784628 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.812886 (+ 28258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.812922 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.845656 (+ 32734us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.954853 (+109197us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:30.127351 (+172498us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.127871 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.127942 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.365811 (+1237869us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800444ca0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:31.371574 (+  5763us) raft_consensus.cc:1685] finished
0709 13:07:31.386751 (+ 15177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.386921 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16660,"prepare.queue_time_us":92706,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2597,"raft.queue_time_us":12195,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":19034,"spinlock_wait_cycles":44699904,"thread_start_us":158576,"threads_started":2,"wal-append.queue_time_us":175863}
W20260709 13:07:31.398116 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 55059.1us
I20260709 13:07:31.400964 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.377719 20120 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.408181 20153 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:31.374264 20145 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.378485 20001 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:31.422188 15685 leader_election.cc:400] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
W20260709 13:07:31.423300 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 169174us
I20260709 13:07:31.428804 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.430992 15685 leader_election.cc:403] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.434253 15685 leader_election.cc:400] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:31.402894 20133 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:31.437840 15641 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:31.426450 20066 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:31.438804 20066 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:31.439420 20094 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.200s	user 0.008s	sys 0.015s
I20260709 13:07:31.439616 20066 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.440569 20156 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:31.440940 20066 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.441640 19779 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.441529 20157 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.442008 20155 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.442359 20157 consensus_queue.cc:1243] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:31.442957 20157 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.443315 20157 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:31.395186 19946 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:31.444095 20157 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.444671 19946 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.445091 19946 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:31.445411 20157 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.446266 15610 leader_election.cc:400] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14.
I20260709 13:07:31.453697 15610 leader_election.cc:403] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.445977 19946 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.447582 20001 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.457779 19907 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.422487 20153 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:31.458757 20153 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.460448 20143 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:31.426328 20120 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:31.451607 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 50753.9us
I20260709 13:07:31.462046 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:31.398204 19574 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:31.462538 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:31.426354 20098 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.270s	user 0.004s	sys 0.014s
I20260709 13:07:31.453260 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:31.463745 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.456036 15688 leader_election.cc:400] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:31.464290 15788 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.465040 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.458118 20001 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.448683 20121 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.426646 19844 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:07:31.421806 20057 raft_consensus.cc:2764] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:31.442282 19779 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.462631 15793 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.467316 15760 leader_election.cc:400] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:31.499576 15760 leader_election.cc:403] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:31.479914 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 164161us
I20260709 13:07:31.419945 19882 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:31.395015 19893 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.463222 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:31.467084 20155 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.454275 19954 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.504492 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:31.498667 20053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.010s	sys 0.023s
I20260709 13:07:31.483443 20143 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.508953 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.496306 19844 consensus_queue.cc:1243] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:31.482110 20121 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:31.510460 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.466638 19913 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:07:31.512482 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 46791.6us
W20260709 13:07:31.512351 20053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.011s	sys 0.023s
I20260709 13:07:31.500638 19882 consensus_queue.cc:1243] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:31.522235 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.506284 19972 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9.
I20260709 13:07:31.508486 20071 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:31.512625 19954 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.550354 20156 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:07:31.512301 20155 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:31.533512 20057 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:31.533139 19779 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.558946 20156 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.521363 19893 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.590147 20156 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:31.521665 20143 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.591120 20156 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.592338 20156 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.592408 20143 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:31.593168 20121 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.594750 20121 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:31.567916 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.596230 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.573105 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 108152us
I20260709 13:07:31.598987 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.600160 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.601235 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:31.575228 19954 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:31.602165 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.602435 15641 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.602910 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.603231 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:31.603569 15642 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:31.603785 15641 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.604601 15642 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.606045 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.607067 15644 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:31.576473 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 271528us
I20260709 13:07:31.556669 20071 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:31.577996 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.556311 20167 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.071s	user 0.000s	sys 0.004s
I20260709 13:07:31.581866 20144 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.552285 20053 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:07:31.583051 20120 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.584903 19942 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:31.588099 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.548333 19946 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.520533 20170 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14.
I20260709 13:07:31.551669 20161 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.613202 20153 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.602492 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.608546 15759 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:31.611594 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89458.5us
I20260709 13:07:31.635285 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.615708 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.636386 15639 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:31.616281 15793 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:31.618088 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:31.574070 20155 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.610554 20147 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.638253 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.613678 19942 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.640213 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:31.554978 20072 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:07:31.614645 20057 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:31.610232 20071 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.641535 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:31.653910 15642 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
W20260709 13:07:31.651921 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63884.6us
W20260709 13:07:31.655272 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 101874us
I20260709 13:07:31.655673 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.655964 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:31.658080 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:31.658584 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:31.659184 16331 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:31.659581 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:31.554447 20149 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
W20260709 13:07:31.662642 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 54199.8us
I20260709 13:07:31.669467 15759 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:31.660471 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.660748 16326 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.646142 20120 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.661242 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.646533 19954 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.684193 15717 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:31.663713 20079 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.747s	user 0.015s	sys 0.000s
I20260709 13:07:31.672160 15759 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.686088 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:31.663451 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:31.662591 20053 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.640316 19918 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:31.661630 20133 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.662735 20085 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.695137 15788 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:31.670945 20170 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.663249 20072 consensus_queue.cc:1243] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:31.724882 15787 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.722479 15793 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:31.723109 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:31.684322 20066 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.726431 15794 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:31.728632 15716 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:31.727197 15788 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:31.696122 20149 consensus_queue.cc:1243] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:31.702371 19907 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.684819 19913 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:31.764213 15638 raft_consensus.cc:2410] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:31.770298 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 109102us
W20260709 13:07:31.772001 16327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 946) took 1604 ms (client timeout 1599 ms). Trace:
W20260709 13:07:31.772503 16327 rpcz_store.cc:269] 0709 13:07:30.159465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.159632 (+   167us) service_pool.cc:224] Handling call
0709 13:07:31.760068 (+1600436us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54004d53d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:31.763511 (+  3443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778398080}
I20260709 13:07:31.726128 20085 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:31.777396 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.784294 20086 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.784951 20086 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.763454 20141 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:31.722237 20120 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:07:31.763677 20168 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.797258 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2303) took 1189 ms. Trace:
I20260709 13:07:31.776461 19907 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:31.797775 15647 rpcz_store.cc:276] 0709 13:07:30.608209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.610496 (+  2287us) service_pool.cc:224] Handling call
0709 13:07:30.617600 (+  7104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.630104 (+ 12504us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:31.556518 (+926414us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b1800143320. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:07:31.647475 (+ 90957us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.728848 (+ 81373us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.762020 (+ 33172us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.762204 (+   184us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:31.762237 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.762314 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.792204 (+ 29890us) raft_consensus.cc:1685] finished
0709 13:07:31.796986 (+  4782us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.797183 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30287,"prepare.queue_time_us":394347,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2376,"raft.queue_time_us":3922,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":28306,"spinlock_wait_cycles":14090624,"thread_start_us":118833,"threads_started":2,"wal-append.queue_time_us":121917}
I20260709 13:07:31.782276 20085 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.815524 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 152136us
I20260709 13:07:31.819268 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:31.824723 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:31.782511 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:31.827013 15790 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:31.827435 15794 raft_consensus.cc:606] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:31.827829 15794 raft_consensus.cc:614] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.829182 15717 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:31.829727 15717 pending_rounds.cc:85] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 9
I20260709 13:07:31.830042 15717 pending_rounds.cc:107] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:31.830353 15717 raft_consensus.cc:2889] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.834321 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.834607 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:31.814050 20171 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.813944 20072 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.810283 20141 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:31.768433 20057 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:31.837822 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.840096 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.842078 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.843725 15714 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:31.814031 20148 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:31.827809 19945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.658s	user 0.009s	sys 0.018s
I20260709 13:07:31.853310 20072 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:31.847802 20153 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.812408 20118 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
W20260709 13:07:31.904023 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.904760 20176 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:07:31.905639 20172 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:31.905819 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.943308 15720 raft_consensus.cc:2410] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:31.909899 20170 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.910989 19946 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.913897 15790 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:31.901839 15759 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.551s (SENT)
I20260709 13:07:31.902633 15722 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:31.846843 20171 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.805498 20178 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:07:31.932719 20017 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:31.936822 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 239361us
I20260709 13:07:31.917203 19913 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:31.970043 19913 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.970525 19913 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.934131 19907 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.983393 20187 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.984047 20187 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.987944 20085 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:31.925508 19945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.752s	user 0.010s	sys 0.018s
W20260709 13:07:31.949720 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.952108 15790 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:31.992285 20145 consensus_meta.cc:287] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:07:31.992808 20145 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:31.958945 20086 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:31.995142 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:31.999353 15646 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:31.937455 20148 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:32.001578 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2015) took 1365 ms. Trace:
I20260709 13:07:32.008044 15646 rpcz_store.cc:276] 0709 13:07:30.636642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.636803 (+   161us) service_pool.cc:224] Handling call
0709 13:07:30.663562 (+ 26759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.999787 (+1336225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.001336 (+  1549us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000aa854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:32.001521 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071351040}
I20260709 13:07:31.952009 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:31.958062 19946 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.935073 19942 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:31.962975 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:31.963500 16328 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:31.955410 20170 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:31.964695 20140 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:32.011744 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 109967us
I20260709 13:07:31.960683 20141 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.033263 15715 raft_consensus.cc:2368] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
I20260709 13:07:32.029860 20170 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.030891 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.034164 15720 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:07:32.031468 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.034919 15759 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.599s (SENT) [suppressed 68 similar messages]
I20260709 13:07:31.956139 20171 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:32.023295 20001 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.542s	user 0.003s	sys 0.007s
I20260709 13:07:32.024537 20118 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.086979 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.087226 20187 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.087790 15714 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:32.088922 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:32.089666 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.090356 15720 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:32.092741 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:32.098438 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 321847us
I20260709 13:07:32.099452 15717 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:32.101518 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:32.061533 20156 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:32.112169 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.056406 20071 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.033411 20072 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.113432 15720 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.081877 20085 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.045481 20140 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.099939 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:32.112485 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.135213 15720 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:32.137218 15718 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:32.079331 20017 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:32.077443 20001 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:32.138494 15720 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:32.146766 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46743.7us
W20260709 13:07:32.150353 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 114397us
W20260709 13:07:32.152392 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.156276 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:32.187695 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.201649 15720 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.147441 20187 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.201758 20170 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:32.208328 20121 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.003s
W20260709 13:07:32.210421 20136 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.003s
I20260709 13:07:32.229589 20071 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.090978 20148 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.237550 15720 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:07:32.245234 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 210316us
I20260709 13:07:32.224530 19946 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:32.239789 20183 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:32.249934 15759 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:32.254558 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 153123us
I20260709 13:07:32.292531 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2001) took 2592 ms. Trace:
I20260709 13:07:32.293779 15788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:32.294617 15788 raft_consensus.cc:606] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:32.295037 15788 raft_consensus.cc:614] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:32.251194 20145 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:32.225895 20192 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:32.292986 15640 rpcz_store.cc:276] 0709 13:07:29.669658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.674731 (+  5073us) service_pool.cc:224] Handling call
0709 13:07:29.691246 (+ 16515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.691459 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:29.858457 (+166998us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.922272 (+ 63815us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.983215 (+ 60943us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b180046cd80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:30.238759 (+255544us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b180046cd80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:30.400723 (+161964us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b180046cd80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:30.928496 (+527773us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b180046cd80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:31.170434 (+241938us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180046cd80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9
0709 13:07:31.438804 (+268370us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:32.006188 (+567384us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b180046cd80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:32.261949 (+255761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.261999 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:32.262045 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.262108 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.262211 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194725,"prepare.queue_time_us":257576,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":11701,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":31148,"spinlock_wait_cycles":154082816,"thread_start_us":463187,"threads_started":3,"wal-append.queue_time_us":102800}
I20260709 13:07:32.237828 20136 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.256228 20001 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:32.306406 20188 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:07:32.291831 20121 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:32.315912 15788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:32.322780 15788 raft_consensus.cc:606] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:32.323199 15788 raft_consensus.cc:614] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:32.312350 20001 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.312069 19574 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.334148 20178 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:32.334903 20178 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:32.336961 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 240315us
W20260709 13:07:32.337724 15688 leader_election.cc:336] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.153s (SENT)
I20260709 13:07:32.337910 19918 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.338620 19918 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.341324 19918 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.342455 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.356032 15645 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:32.343353 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.358531 15647 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:32.359561 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.360970 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:32.344619 20197 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:32.362201 20197 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.345891 15713 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:32.346361 19946 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.364320 19946 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.367198 19946 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:32.367986 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.349010 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.369089 16298 leader_election.cc:400] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
I20260709 13:07:32.369495 16298 leader_election.cc:403] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:32.369776 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:32.371206 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.372445 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.375831 20197 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:32.357288 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.378077 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.378975 20148 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:32.354720 20178 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.381943 20174 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.381551 20156 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:32.384167 20156 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:32.384682 20156 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:32.388487 20156 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.391909 20156 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:32.373682 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:32.396957 15639 raft_consensus.cc:2376] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13. Re-sending same reply.
I20260709 13:07:32.401943 15645 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:32.403323 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.404376 15645 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:32.378106 20141 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.407008 20141 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.415781 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.417649 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.419435 15643 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:32.424067 15646 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.322618 20121 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:32.327219 20001 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.326923 20145 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:32.427685 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58763.6us
I20260709 13:07:32.434134 20208 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:07:32.436717 20196 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:07:32.437474 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.434031 20140 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.439602 20145 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.440840 19893 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.441394 19893 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.442524 20145 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:32.443972 20194 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:32.433377 20121 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.453600 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.453826 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.454326 15716 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:32.454702 15715 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:32.329972 19574 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.451646 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:32.436497 20184 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:07:32.379706 20148 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.465482 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.466400 15721 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:32.481959 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:32.487499 15647 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:32.489449 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.490583 15715 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:07:32.502014 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.461256 19693 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.509585 20148 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:32.511727 20161 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.868s	user 0.004s	sys 0.007s
I20260709 13:07:32.512224 20161 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:32.464521 20178 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:32.512952 15644 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:32.512880 20178 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.502811 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:32.513989 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.518419 15642 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 3. (term mismatch)
I20260709 13:07:32.534647 15646 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:32.535007 15642 pending_rounds.cc:85] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 2
I20260709 13:07:32.535251 15642 pending_rounds.cc:107] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 8.3
W20260709 13:07:32.522122 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.535472 15642 raft_consensus.cc:2889] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.532920 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.542436 15721 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:32.472738 20197 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:32.543663 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:32.530085 19693 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.488771 19983 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:07:32.549592 20157 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:32.550625 19882 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:32.556849 16328 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:07:32.559383 20205 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:07:32.564811 19893 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.597792 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.583827 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:32.520087 20136 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:32.527055 19574 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.530624 20144 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.590602 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:32.617713 15715 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
W20260709 13:07:32.619601 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.543220 19918 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.570554 20197 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.615329 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.586082 20157 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:32.638206 15646 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:07:32.639780 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.621173 20161 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.616225 20208 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8.
W20260709 13:07:32.648627 15760 leader_election.cc:336] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.340s (SENT)
I20260709 13:07:32.617420 20144 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:32.653560 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 317347us
I20260709 13:07:32.622997 19918 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:32.628499 20197 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:32.655642 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:32.616250 20120 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:32.661921 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:32.661909 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:32.645537 19913 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.003s
W20260709 13:07:32.654116 20171 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.002s
W20260709 13:07:32.666699 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.673476 15717 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.676826 15646 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:32.645166 20161 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.688084 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:32.677666 15760 leader_election.cc:336] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.439s (SENT)
I20260709 13:07:32.691234 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:32.678627 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.682957 16331 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:32.692956 15638 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:32.683996 15645 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:32.675515 15643 pending_rounds.cc:85] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 10
I20260709 13:07:32.694218 15643 pending_rounds.cc:107] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:32.694494 15643 raft_consensus.cc:2889] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.665235 15715 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:32.766371 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.767311 15640 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:32.748128 19882 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:32.770853 19882 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.688907 15646 raft_consensus.cc:2376] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9. Re-sending same reply.
I20260709 13:07:32.773181 19882 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.670828 19918 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.746487 19907 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.712230 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:32.723793 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:32.728516 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.699285 20161 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.700058 20136 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.735419 19693 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:32.736634 16333 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:32.705698 20141 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:32.680927 19913 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.687686 20171 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.713335 20157 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.699249 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.777591 15638 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:32.732539 20144 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:32.791917 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68236.9us
W20260709 13:07:32.801191 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 89076.2us
I20260709 13:07:32.792090 19983 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.811654 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.792981 20208 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.848891 15641 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: [9.6-12.7]
W20260709 13:07:32.850703 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.819748 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:32.854802 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:32.757126 20178 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.823433 15717 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
W20260709 13:07:32.832973 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.840824 15795 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:32.818280 15645 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:32.845722 16327 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:32.818643 20220 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:32.846566 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.869182 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.869395 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.870934 16330 raft_consensus.cc:2368] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:32.848053 15793 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:32.869163 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:32.857978 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.872524 16329 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:32.858151 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.872752 15787 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:32.859045 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:32.859714 15639 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [4.4-9.5]
I20260709 13:07:32.859969 15789 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:32.865100 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:32.875207 15645 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:32.866019 15790 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:07:32.865906 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46233.9us
I20260709 13:07:32.866822 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.873158 15792 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:32.876605 16333 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:32.846484 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.793124 19907 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.858665 20157 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.883335 16334 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 7: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:32.884212 15790 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.881634 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:32.881762 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:32.848821 20208 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:32.886971 15645 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.960001 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.874368 20120 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:32.952766 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.970101 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 88424us
I20260709 13:07:32.957816 15790 raft_consensus.cc:1217] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Deduplicated request from leader. Original: 5.3->[6.4-8.5]   Dedup: 8.5->[]
I20260709 13:07:32.873823 20144 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.883970 19893 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.940292 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:32.977420 16330 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:32.971182 15790 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:07:32.972277 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.978256 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:32.979005 15795 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:32.979952 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:32.980580 15795 raft_consensus.cc:2368] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:32.972597 15796 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:32.976243 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.982393 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.987892 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:32.989162 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:32.966612 20208 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.990391 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:32.991098 15795 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.991192 20228 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.991787 20228 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:32.995510 20140 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.996021 20140 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:32.999078 19913 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:32.960111 19882 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.008235 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.011085 15795 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 8.
I20260709 13:07:33.009162 15790 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:33.011122 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:33.012038 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.013079 15645 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:32.974989 20069 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.015246 15787 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:32.985287 20141 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.017982 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.025213 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.025612 15793 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:33.016871 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.006446 20228 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.026678 15796 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:33.039057 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.039752 15789 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:33.040179 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:33.042192 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.043495 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.045020 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.016973 20140 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.046815 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:33.024303 20121 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:07:33.050274 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.051378 15796 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:33.000097 19893 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.023828 20215 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.055877 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.082082 15610 leader_election.cc:400] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:33.082472 15610 leader_election.cc:403] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:33.082464 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:33.047924 20156 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.655s	user 0.013s	sys 0.000s
I20260709 13:07:33.086457 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.089711 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.094767 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:33.096210 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:33.102221 15644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 520) took 1492 ms (client timeout 1741 ms). Trace:
W20260709 13:07:33.102819 15644 rpcz_store.cc:269] 0709 13:07:31.610409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.610614 (+   205us) service_pool.cc:224] Handling call
0709 13:07:33.101962 (+1491348us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54001bdfd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:33.102142 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997392256}
I20260709 13:07:33.104359 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.105161 15644 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:33.107044 15647 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:33.048032 19946 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.113509 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:33.109467 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:33.116112 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.116261 15647 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.048039 20207 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.025236 20069 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.129240 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.031193 20197 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.043183 20178 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:33.087594 20141 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.086652 20140 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.129534 20168 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.027s	sys 0.006s
I20260709 13:07:33.047969 19913 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:07:33.087548 20213 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.137179 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.139658 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.185243 15645 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:33.185185 15644 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:33.155210 15647 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:33.186525 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.187105 15647 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:33.188109 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.048105 19882 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:07:33.191849 19693 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:33.192642 20225 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:33.192517 19693 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.195007 20178 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.195577 20178 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.196375 15644 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:33.198356 15644 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:33.151799 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.200887 19882 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.201296 19882 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:33.201308 19693 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.201803 19882 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:33.203897 20221 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:07:33.206009 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:33.206583 15793 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.208256 19693 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.082376 20121 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.055379 20120 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.114984 20145 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:33.130290 20217 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:07:33.199258 15647 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.188717 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:33.212538 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60816.4us
I20260709 13:07:33.129333 19946 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:33.184346 20168 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.028s	sys 0.007s
I20260709 13:07:33.216150 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:33.217221 15796 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:33.219385 15793 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:33.238749 15796 pending_rounds.cc:85] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 7
I20260709 13:07:33.239017 15796 pending_rounds.cc:107] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:33.239284 15796 raft_consensus.cc:2889] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.176359 20156 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.136077 19983 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 13:07:33.214887 20234 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:07:33.175541 20149 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:33.214907 20120 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.255685 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:33.185009 20140 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.258551 20120 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.241364 19693 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.244279 20178 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:33.272948 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:33.244776 19907 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.241852 20156 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.261015 20227 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:07:33.279011 20001 consensus_meta.cc:287] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.821s	user 0.004s	sys 0.008s
I20260709 13:07:33.287887 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:33.279568 20231 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:33.301729 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 207001us
I20260709 13:07:33.285470 20238 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.287657 20156 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:33.303324 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.305836 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:33.310775 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 83479.5us
I20260709 13:07:33.292331 19693 raft_consensus.cc:2764] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:33.315701 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.293435 19907 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:33.319344 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.294977 20224 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:33.329214 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 247170us
I20260709 13:07:33.332469 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:33.347057 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44326.7us
I20260709 13:07:33.307101 20001 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.330940 20145 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:33.318920 20149 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:33.334816 20239 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:33.340730 20197 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.211215 20232 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:33.360824 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.333200 20079 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:33.345376 20069 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:33.296150 19946 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.088825 20215 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.364920 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.366055 16332 raft_consensus.cc:2368] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
W20260709 13:07:33.360438 20230 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:07:33.372011 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 56380.1us
I20260709 13:07:33.355413 20242 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.356451 20121 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:33.364282 20231 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.375038 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.172605 20207 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.213850 20213 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.314847 20238 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.332253 20224 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.379186 20207 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.383927 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.389634 15721 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:33.385670 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.370402 20197 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.393718 15722 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:33.394243 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.402856 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.405215 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.407582 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.410933 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.407876 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.413307 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:33.409788 15716 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:33.416031 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.416905 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.380805 20249 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.431784 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.435767 15720 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:33.439268 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:33.440003 15789 raft_consensus.cc:606] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:33.440416 15789 raft_consensus.cc:614] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:33.392935 20245 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.386298 19907 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:07:33.445622 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.414237 20140 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.438063 20255 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:33.419047 20231 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:33.432411 20242 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.435343 20249 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.393077 20233 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:33.411727 20235 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:33.416626 20121 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:33.467132 15644 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:33.465394 20244 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:33.470136 20240 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:33.471539 20208 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.482770 20121 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:33.483165 20121 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:33.472524 20254 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.418179 20197 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.468093 20249 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.430104 20145 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:33.475255 20237 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:07:33.479684 20251 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:33.465819 20255 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.484412 20208 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.506130 20255 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.509013 20156 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.491046 20001 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.516592 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.491729 20254 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:33.475054 20215 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.495594 20231 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.496194 20197 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:33.496376 20213 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.466171 20242 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.499071 20161 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.001s
W20260709 13:07:33.500340 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.453809 20149 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:07:33.477825 20244 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:33.487063 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2316) took 1154 ms. Trace:
I20260709 13:07:33.481547 19882 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:33.512006 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.483981 20121 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:33.487784 19918 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
I20260709 13:07:33.549446 16330 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:33.514217 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:33.520171 15789 raft_consensus.cc:2410] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:33.525153 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:33.525676 15720 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:33.520984 20254 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.527714 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:33.551357 16332 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:33.553035 15794 raft_consensus.cc:606] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:07:33.528085 20242 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.527994 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.528017 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:33.533536 15642 rpcz_store.cc:276] 0709 13:07:32.333132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.343897 (+ 10765us) service_pool.cc:224] Handling call
0709 13:07:32.344259 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.536350 (+192091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.486738 (+950388us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003eb2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:33.486984 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359915264}
I20260709 13:07:33.492682 20141 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:33.543591 16326 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:33.566041 15787 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.557691 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:33.567021 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 119806us
I20260709 13:07:33.569247 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:33.570638 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.571499 15717 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:33.559482 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.591687 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:33.598337 20264 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.598917 20264 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.602638 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.600034 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:33.610862 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.611865 15719 raft_consensus.cc:2410] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:33.544216 20244 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.605562 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.612859 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:33.606215 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:33.606237 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63757.5us
I20260709 13:07:33.579795 19972 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.618252 19972 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.620440 19972 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:33.622908 20197 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.624168 20197 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.542021 20161 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.627049 15646 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:33.629532 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.632085 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.632494 15787 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:33.633610 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:33.602895 20121 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.528879 20245 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:07:33.552162 19918 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.660396 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:33.610785 20255 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:33.675944 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.681933 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:33.687510 15642 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:33.688982 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.634744 20261 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:33.647785 20168 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.700366 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:33.650180 20161 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.702347 15716 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:33.700452 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66915.6us
I20260709 13:07:33.685698 20181 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.670924 19942 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.682107 20178 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:33.701031 20168 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:33.704834 20245 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.731055 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:33.707635 20181 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.709400 20149 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.686661 19946 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:33.727272 19882 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.695150 20255 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.709031 19935 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:33.735474 20181 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.729646 20168 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.720312 20178 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.707479 20120 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.721344 20156 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.766067 20241 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.808523 20149 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:33.811020 20258 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:33.813674 20268 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:33.813848 20187 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:33.808878 20145 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.809010 19907 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.819612 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.820722 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2330) took 1361 ms. Trace:
I20260709 13:07:33.826977 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.834364 15716 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:33.857663 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:33.794785 20072 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.783946 19946 consensus_queue.cc:1243] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:33.844974 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 114015us
I20260709 13:07:33.785312 20069 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:33.851951 15721 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:33.855458 15641 rpcz_store.cc:276] 0709 13:07:32.459805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.459945 (+   140us) service_pool.cc:224] Handling call
0709 13:07:32.475658 (+ 15713us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.859075 (+383417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.820416 (+961341us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540019bc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:33.820657 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857658752}
I20260709 13:07:33.870052 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.871002 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:33.874236 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.835877 20207 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:33.899905 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:33.846729 20258 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.795424 19935 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.906216 16298 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:33.909196 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:33.851537 20187 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:33.926080 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:33.852311 20145 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.920034 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.868221 20171 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.825023 20249 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:33.909798 20258 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.911156 20140 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.165691 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:33.899163 19907 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.967942 20145 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.841564 20241 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.217866 20282 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:34.230222 20263 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.239485 20284 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:34.047436 19918 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:33.907881 20207 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.607286 20290 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.608647 20207 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.050285 20264 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:34.482082 20118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.002s	sys 0.005s
W20260709 13:07:34.610123 20118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.003s	sys 0.006s
W20260709 13:07:34.481078 15759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.002s	sys 0.006s
W20260709 13:07:34.611039 15759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.002s	sys 0.006s
W20260709 13:07:34.500017 20190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.011s
W20260709 13:07:34.537369 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 861415us
W20260709 13:07:34.539947 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 620901us
I20260709 13:07:34.607882 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:34.613638 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:34.540294 20242 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.007s
W20260709 13:07:34.544176 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.620966 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.551877 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:34.552443 20244 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.002s
I20260709 13:07:34.555794 20269 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:34.167236 20149 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:33.901265 20001 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.561350 15716 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:34.658129 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2956) took 1035 ms. Trace:
I20260709 13:07:34.658618 15716 rpcz_store.cc:276] 0709 13:07:33.622729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.657093 (+1034364us) service_pool.cc:224] Handling call
0709 13:07:34.657416 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.657620 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.657660 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.657707 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:34.657873 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.657947 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.658065 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.659279 20292 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.659839 20292 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.575963 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2631) took 1139 ms. Trace:
I20260709 13:07:34.557654 19882 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.588871 15717 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:34.606135 19907 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:34.608721 20171 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.535346 20069 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.607870 20290 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.615377 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 823) took 1089 ms. Trace:
I20260709 13:07:34.683521 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 951) took 2565 ms. Trace:
W20260709 13:07:34.623023 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 85664.7us
I20260709 13:07:34.631466 19918 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:34.624285 20282 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:34.633237 20181 consensus_meta.cc:287] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.806s	user 0.005s	sys 0.005s
I20260709 13:07:34.633904 20241 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:34.620477 20190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.000s	sys 0.012s
I20260709 13:07:34.634398 20284 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:34.637434 20211 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 2.182s	user 0.010s	sys 0.000s
I20260709 13:07:34.640583 20178 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.645635 15715 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:34.711546 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2954) took 1089 ms. Trace:
I20260709 13:07:34.688228 19918 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.711938 15715 rpcz_store.cc:276] 0709 13:07:33.622021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.620188 (+998167us) service_pool.cc:224] Handling call
0709 13:07:34.645373 (+ 25185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.711252 (+ 65879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.711486 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.712618 19918 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:34.647004 20121 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.977s	user 0.015s	sys 0.000s
W20260709 13:07:34.648749 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 96936.1us
I20260709 13:07:34.714761 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:34.716337 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:34.718169 15788 raft_consensus.cc:2410] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:34.651021 20302 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.718776 20302 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:34.719226 20302 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.721954 20241 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.722795 20241 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:34.724985 20241 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:34.647887 20296 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:34.726128 20296 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.652549 20298 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:34.730039 19918 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.730825 20298 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.731388 20298 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.625692 20157 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.733713 20157 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.736495 20157 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:34.653992 20168 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.829s	user 0.006s	sys 0.006s
I20260709 13:07:34.737465 20168 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.740284 20168 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.655262 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1873) took 1079 ms. Trace:
I20260709 13:07:34.663255 15796 rpcz_store.cc:276] 0709 13:07:33.436057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.436205 (+   148us) service_pool.cc:224] Handling call
0709 13:07:33.436630 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.580132 (+143502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.580173 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.603605 (+ 23432us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.783531 (+179926us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.783785 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.783882 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.575730 (+791848us) raft_consensus.cc:1685] finished
0709 13:07:34.575753 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.575901 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37120,"raft.queue_time_us":4123,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8683,"thread_start_us":239404,"threads_started":2,"wal-append.queue_time_us":334780}
I20260709 13:07:34.692505 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:34.683635 16328 rpcz_store.cc:276] 0709 13:07:33.525934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.526051 (+   117us) service_pool.cc:224] Handling call
0709 13:07:33.527939 (+  1888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.528284 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.528312 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.528792 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.899745 (+370953us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:33.899783 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.899849 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.615119 (+715270us) raft_consensus.cc:1685] finished
0709 13:07:34.615150 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.615308 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4886,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5523,"thread_start_us":366404,"threads_started":1,"wal-append.queue_time_us":1073222}
I20260709 13:07:34.668373 20001 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.741894 20001 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.741080 15720 rpcz_store.cc:276] 0709 13:07:33.576225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.627660 (+ 51435us) service_pool.cc:224] Handling call
0709 13:07:33.659175 (+ 31515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.701316 (+ 42141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.701347 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.701803 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.849584 (+147781us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.849623 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.849690 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.654968 (+805278us) raft_consensus.cc:1685] finished
0709 13:07:34.655001 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.655187 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112001,"raft.queue_time_us":44578,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2678,"thread_start_us":125761,"threads_started":1,"wal-append.queue_time_us":922975}
I20260709 13:07:34.744215 20296 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.684077 16325 rpcz_store.cc:276] 0709 13:07:32.113188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.139963 (+ 26775us) service_pool.cc:224] Handling call
0709 13:07:32.140261 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.301381 (+161120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.301437 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.302636 (+  1199us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.481225 (+1178589us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800342e80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:33.647432 (+166207us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.647491 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.647586 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.655078 (+1007492us) raft_consensus.cc:1685] finished
0709 13:07:34.655103 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.678166 (+ 23063us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12130,"raft.queue_time_us":163105,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2630,"spinlock_wait_cycles":9066880,"thread_start_us":326639,"threads_started":2,"wal-append.queue_time_us":2290486}
I20260709 13:07:34.717470 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:34.746285 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 53860.2us
I20260709 13:07:34.751180 15685 leader_election.cc:400] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:34.751713 15685 leader_election.cc:403] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.725426 20241 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:34.690862 19907 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.757423 20278 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:34.759934 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:34.761075 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:34.764628 19935 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.765327 19935 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:34.765911 19935 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.769299 19907 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.770543 20278 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.669387 20242 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.655745 20187 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.669838 20244 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.690168 20171 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.750420 20121 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.678923 20269 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.793186 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:34.787348 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2951) took 1237 ms. Trace:
I20260709 13:07:34.758065 20255 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.797676 15714 rpcz_store.cc:276] 0709 13:07:33.547282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.547429 (+   147us) service_pool.cc:224] Handling call
0709 13:07:33.547847 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.696534 (+148687us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:33.770050 (+ 73516us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.707705 (+937655us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.711141 (+  3436us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.711447 (+   306us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:34.711501 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.711598 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.771558 (+ 59960us) raft_consensus.cc:1685] finished
0709 13:07:34.771590 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.784939 (+ 13349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":477128,"prepare.queue_time_us":69463,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":651118,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":33824,"thread_start_us":633806,"threads_started":4,"wal-append.queue_time_us":875446}
W20260709 13:07:34.789269 20072 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.902s	user 0.014s	sys 0.002s
I20260709 13:07:34.763156 20241 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.697108 20181 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.805475 20255 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.806178 20284 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.807308 20181 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.807940 20258 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.809171 20171 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.801223 20290 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.809783 20187 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.809899 20242 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.810864 20258 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:34.811591 19935 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.811729 20258 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:34.812445 20248 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.812389 20258 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.813090 20248 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.815982 20178 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:34.810789 20249 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.801080 20312 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:34.759405 20296 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:34.823016 20296 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.823165 19907 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:34.823020 20278 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.823733 20296 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.828147 20120 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.826833 20258 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:34.830395 20296 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:34.825984 20145 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:34.833084 20269 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:34.832687 20241 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.833978 20302 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.831259 19893 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.841439 15718 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 13:07:34.797017 20254 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.187s	user 0.018s	sys 0.004s
W20260709 13:07:34.854252 16331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 820) took 2392 ms (client timeout 2011 ms). Trace:
I20260709 13:07:34.852331 15718 pending_rounds.cc:85] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 9
I20260709 13:07:34.855270 15718 pending_rounds.cc:107] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:34.855674 15718 raft_consensus.cc:2889] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:34.854883 16331 rpcz_store.cc:269] 0709 13:07:32.461416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.461652 (+   236us) service_pool.cc:224] Handling call
0709 13:07:34.854049 (+2392397us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54005f2154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:34.854168 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417639296}
I20260709 13:07:34.871160 20190 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.871884 20190 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:34.787700 20307 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:07:34.844589 19935 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.850518 20255 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.841589 20141 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:34.863507 20312 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:34.950879 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.952589 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2959) took 1329 ms. Trace:
I20260709 13:07:34.953645 15716 rpcz_store.cc:276] 0709 13:07:33.623590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.659853 (+1036263us) service_pool.cc:224] Handling call
0709 13:07:34.660195 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.660412 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:34.660724 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.952165 (+291441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.952225 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:34.952277 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.952378 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.952530 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7795,"prepare.queue_time_us":1706,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"thread_start_us":282847,"threads_started":1}
I20260709 13:07:34.936791 20292 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.934880 19918 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:34.859045 20254 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.956151 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2960) took 1328 ms. Trace:
I20260709 13:07:34.958012 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:34.824052 20282 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:34.873131 20190 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:35.013134 15759 leader_election.cc:336] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): Timed out: RequestConsensusVote RPC to 127.14.45.4:41485 timed out after 1.599s (SENT)
I20260709 13:07:35.014274 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:34.950495 20255 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:35.016693 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 255560us
I20260709 13:07:35.013566 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:34.957592 15715 rpcz_store.cc:276] 0709 13:07:33.628139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.712928 (+1084789us) service_pool.cc:224] Handling call
0709 13:07:34.713300 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.713510 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:34.752494 (+ 38984us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.955649 (+203155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.955728 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.955786 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.955906 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.956077 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154,"prepare.queue_time_us":32045,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4236,"raft.queue_time_us":1798,"spinlock_wait_cycles":634752,"thread_start_us":202086,"threads_started":1}
I20260709 13:07:35.020562 15719 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.025123 20318 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:35.025275 20307 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:35.012789 20171 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.957193 20272 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:35.027685 15788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2632) took 1550 ms (client timeout 1737 ms). Trace:
W20260709 13:07:35.029601 15788 rpcz_store.cc:269] 0709 13:07:33.477242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.513974 (+ 36732us) service_pool.cc:224] Handling call
0709 13:07:35.027470 (+1513496us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400421dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:35.027622 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684334464}
I20260709 13:07:35.039923 16331 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:35.046180 20258 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.047113 20258 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.052129 20308 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.066293 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 2964) took 1193 ms. Trace:
I20260709 13:07:35.066779 15714 rpcz_store.cc:276] 0709 13:07:33.872863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.800539 (+927676us) service_pool.cc:224] Handling call
0709 13:07:34.801918 (+  1379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.802927 (+  1009us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:34.803250 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.065917 (+262667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.065974 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:35.066030 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.066102 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.066225 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33982,"prepare.queue_time_us":34005,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":228058,"threads_started":1}
I20260709 13:07:35.016703 20314 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.022239 20297 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:35.068567 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.025815 20318 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.026757 20121 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.033367 20310 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.052959 20308 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.080525 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.075857 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:35.081900 16325 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.062489 20290 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:35.074745 15714 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:35.026290 20171 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.084190 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.088312 15714 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.095938 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.096921 15715 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:35.089401 20292 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:07:35.072180 20244 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.070580 20269 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:35.073359 20141 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:35.099756 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:35.101387 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.116498 16330 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:35.033690 20272 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.114235 20145 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.086594 20310 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.099257 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.123937 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.133836 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.131256 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:35.137511 16330 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.138156 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.138984 20322 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:35.139567 20322 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.139999 20322 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.148840 16330 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:35.083287 20121 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.114256 20318 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:35.156656 16330 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.158043 20324 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:35.123586 20141 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.118530 20269 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.097853 20290 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.159286 20306 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:07:35.150168 20258 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:35.163031 20304 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:07:35.163537 20308 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:35.164132 20316 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:35.171262 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.228091 15715 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:35.172148 15714 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:35.230000 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.174966 20310 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.070438 20312 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.080636 20297 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.161545 20296 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.195338 20241 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.097774 20001 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.122665 20302 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.231148 15714 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.170915 20254 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:35.250530 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.206869 20171 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.274730 15715 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:35.115548 20255 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.264153 20322 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.276162 20297 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.259147 20296 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.278484 20269 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:35.278678 20296 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.262526 20121 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.278486 20322 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.288473 15714 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:07:35.289057 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 185406us
I20260709 13:07:35.300210 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.308149 15714 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:35.190901 20324 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.321309 20319 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.337273 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.440963 16325 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:35.441560 15641 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:35.338692 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1874) took 1762 ms. Trace:
I20260709 13:07:35.339262 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:35.325946 20325 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:07:35.341955 15640 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.339265 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.359443 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:35.507522 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:35.437449 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.508224 15645 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.509593 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.442643 15719 rpcz_store.cc:276] 0709 13:07:33.576502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.627835 (+ 51333us) service_pool.cc:224] Handling call
0709 13:07:33.628467 (+   632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.021010 (+1392543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.338432 (+317422us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540017acd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:35.338619 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200998656}
I20260709 13:07:35.510538 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.511111 15714 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:35.445338 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 60733.9us
I20260709 13:07:35.446213 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.522387 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:35.522881 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 163564us
I20260709 13:07:35.523054 15788 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:35.523885 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.524187 15787 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.524369 15788 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.511216 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.315171 20171 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:35.525971 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.526742 15792 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:35.512709 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.526325 20171 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.514693 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.527459 15789 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:35.527818 15792 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:35.293641 20224 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.528575 20171 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:35.529383 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.530833 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:35.444789 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.531801 15790 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:35.520888 15688 leader_election.cc:336] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.693s (SENT)
I20260709 13:07:35.526530 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.539808 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.540741 15791 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:35.546494 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:35.547865 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 409746us
I20260709 13:07:35.548036 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.549605 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.442281 20136 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.325033 20001 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:35.561911 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.556890 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.562798 15640 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:35.563640 15719 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:35.525552 20324 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.573227 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:35.564519 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.582185 15642 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:35.586861 20235 raft_consensus.cc:993] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:07:35.587759 20235 raft_consensus.cc:1081] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:07:35.589600 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.590533 20224 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:35.590973 20224 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:35.591342 20224 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.531471 20319 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.596211 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.596808 15719 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.556016 20121 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.570103 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.530906 20017 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.510124 20260 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:35.509930 20302 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:35.602484 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.606729 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.581579 15645 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:35.611616 15791 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:35.614182 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:35.568784 15790 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:35.608628 15788 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:35.607726 20001 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.606341 20121 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:35.583874 20136 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.623278 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:35.623293 15610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.005s	sys 0.029s
I20260709 13:07:35.634729 15719 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:35.637179 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.620961 20235 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:35.641027 15719 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.619796 20141 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.642554 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.644248 15640 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:35.644639 15645 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:35.664618 15714 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:35.666181 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:35.693096 15688 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.852s (SENT)
I20260709 13:07:35.693673 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:35.613533 20260 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.614961 20302 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.631001 20001 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:35.714357 16331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.011s	sys 0.004s
I20260709 13:07:35.699801 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:35.714735 16331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.004s
W20260709 13:07:35.708168 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 261046us
I20260709 13:07:35.710234 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.715386 15640 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:35.716977 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 193305us
I20260709 13:07:35.719060 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:35.694878 20269 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.721434 15719 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:35.715412 15714 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:35.701395 20156 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.730000 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.743157 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:35.755379 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.755505 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:35.757581 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.698097 20235 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.717084 20001 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.787819 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.791883 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.788743 15714 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:35.791903 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:35.794443 20260 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.802479 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.794876 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:35.804339 15714 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:35.761593 20224 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:35.803026 15685 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.045s	sys 0.055s
W20260709 13:07:35.807919 15685 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.045s	sys 0.056s
W20260709 13:07:35.808223 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 577621us
I20260709 13:07:35.809687 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:35.810324 15796 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:35.810592 15788 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:35.810913 15610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.005s	sys 0.030s
W20260709 13:07:35.811654 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.19797e+06us
I20260709 13:07:35.812649 15790 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:35.812965 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.813184 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:35.814257 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.819315 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:35.793774 20256 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.822069 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:35.823429 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 80194us
I20260709 13:07:35.761077 20017 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.731900 20269 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.830255 20171 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.830240 20282 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.862274 20282 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.830067 20255 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:35.862773 20282 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.840762 15645 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.865096 20282 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.865723 20141 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:35.866473 20141 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:35.866911 20141 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.844269 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.847038 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.870100 15638 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:35.847705 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:35.848623 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:35.859807 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45537.4us
I20260709 13:07:35.873023 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.731572 20121 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.849697 15640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42130
I20260709 13:07:35.875038 15640 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.875393 15640 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.854751 20224 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.856375 20235 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.873565 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:35.821659 20156 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:35.830547 20256 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:35.836052 20324 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:07:35.877349 20296 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.001s
I20260709 13:07:35.909818 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:35.913717 15640 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.877120 20017 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:35.886015 20310 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:35.888401 20224 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.897922 20121 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.922642 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:35.916267 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88053.9us
I20260709 13:07:35.907778 20156 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.914047 20256 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.878299 20255 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:35.932562 15640 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:35.885957 20260 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:35.933648 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:35.941934 20238 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:35.942135 20260 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:35.942652 20260 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:35.943686 20260 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:35.946852 15789 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.924479 20342 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.956579 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2327) took 3557 ms. Trace:
I20260709 13:07:35.956786 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:35.945071 20260 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.928164 20224 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.925356 20310 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.920797 20296 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.959122 15639 rpcz_store.cc:276] 0709 13:07:32.399259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.410940 (+ 11681us) service_pool.cc:224] Handling call
0709 13:07:32.411390 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.874227 (+462837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.956315 (+3082088us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540019b254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:35.956520 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030391680}
I20260709 13:07:35.959933 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.960235 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:35.977232 16334 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.961210 16333 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.961150 16329 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:35.933645 20156 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.982402 20296 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:35.983035 20337 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:35.983227 20288 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.984679 20288 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:35.985347 20288 consensus_queue.cc:1243] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:35.973222 20224 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.989965 20156 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:35.992638 20156 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:35.974686 20310 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.957445 20238 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.969157 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.962218 20342 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:35.963121 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.974246 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:35.959436 16331 raft_consensus.cc:2376] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 7. Re-sending same reply.
I20260709 13:07:35.967445 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.007616 15792 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:36.015355 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:35.974876 20255 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:36.019251 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 145739us
I20260709 13:07:36.020972 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.021915 16333 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:36.021492 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.030905 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.031352 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.032362 16329 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:36.034857 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.035753 15792 raft_consensus.cc:2410] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:36.036612 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.038213 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.040804 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:36.041303 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:36.041577 16329 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.043026 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.043759 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.048220 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.048019 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.019228 20255 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.017549 20342 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:36.068049 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 93385.1us
W20260709 13:07:36.071336 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 137745us
I20260709 13:07:36.044813 20277 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.072358 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:36.045127 20296 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:36.075960 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:36.047631 20170 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:36.047286 20332 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.081195 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.082036 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:35.998243 20017 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.050521 20334 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.066717 20255 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.089587 16325 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:36.065847 20324 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.080781 20354 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:36.097990 20324 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.100831 20324 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.102077 16334 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:36.074836 20277 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:36.106473 20277 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.113420 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.084574 20332 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.116882 20256 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.117576 20332 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.118273 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:36.119918 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3727986549999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26230000000000003s for a response
I20260709 13:07:36.084304 20156 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:36.089989 20296 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:36.094501 20334 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:36.134498 16330 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:36.090142 20170 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:36.145419 20348 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:36.145551 20170 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.151283 20296 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.126777 20350 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.162289 20350 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.142623 20334 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.169169 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:36.153578 16329 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:36.174660 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:36.127183 20358 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:36.132340 20362 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.178036 20358 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.195168 20355 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:36.200843 20256 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.201246 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:36.211510 15795 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.211879 15795 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:36.223989 20354 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:36.224542 20369 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:36.225152 20369 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.225291 20354 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:36.227195 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 106100us
I20260709 13:07:36.227896 15610 leader_election.cc:400] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:36.212613 15795 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.204272 20350 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.221308 20156 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:36.240738 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:36.203500 20224 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.202123 20001 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.250980 20156 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.251838 20369 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:36.253522 20285 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.677s	user 0.011s	sys 0.016s
I20260709 13:07:36.255139 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:36.256916 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:36.263154 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:36.267838 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 201264us
I20260709 13:07:36.269459 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.271818 16328 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.209969 20277 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.198722 20362 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.275307 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:36.271320 20245 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:36.277912 20245 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:36.278317 20245 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.278769 20245 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.285120 15640 pending_rounds.cc:85] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:36.285495 15640 pending_rounds.cc:107] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:36.285759 15640 raft_consensus.cc:2889] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.286402 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.286963 15643 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:36.289189 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:36.290995 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.248760 20141 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.281646 20371 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.305153 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.308601 20017 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.323750 15643 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.308833 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.309506 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.315428 20277 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.317191 20358 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.308657 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:36.319428 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.307302 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.327966 15641 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:36.298866 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.321946 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:36.321833 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:36.328102 15645 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.329310 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:36.333844 20371 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:36.323192 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.271975 20366 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:36.337507 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.338739 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:36.340199 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.340165 15720 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:36.348162 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:36.348796 15713 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.350346 20302 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.352134 20342 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.353639 16329 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:36.356464 15713 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:36.360312 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.360208 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:36.360225 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.358346 15794 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:36.361572 15641 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:36.361974 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:36.362159 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.334992 20371 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.342226 20256 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.363253 15794 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:36.362197 15645 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:36.342517 20358 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:36.357824 20368 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:36.384264 20342 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.385808 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.385985 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.386601 15793 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:36.386334 20255 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.387470 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:36.388159 15793 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:36.388909 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.389436 15793 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:36.370746 15643 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:36.430250 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.430809 15643 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.432482 20069 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.375291 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.334733 20017 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.434623 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:36.358237 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 276360us
I20260709 13:07:36.435930 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.436650 15641 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:36.405519 15790 pending_rounds.cc:85] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 6
I20260709 13:07:36.437564 15790 pending_rounds.cc:107] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:36.437983 15790 raft_consensus.cc:2889] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.403174 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.406980 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:36.408788 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:36.386693 15638 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:36.440723 15794 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:36.397056 20332 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.396608 20144 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:36.428093 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 680) took 1398 ms. Trace:
I20260709 13:07:36.428948 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.446141 15794 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:36.389495 20255 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.447412 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.449751 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.450335 15641 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:36.373090 20256 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:36.397823 20224 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.452301 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.439349 20358 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:36.408149 20362 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.394876 20298 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.445307 20017 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.399121 20290 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.452602 15643 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:36.396510 20141 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.453147 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.443933 15713 rpcz_store.cc:276] 0709 13:07:35.029949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.426900 (+1396951us) service_pool.cc:224] Handling call
0709 13:07:36.427348 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.427611 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.427652 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.427714 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:36.427776 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.427870 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.428013 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.443150 20144 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:36.359238 20334 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.454067 20256 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.457083 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.406458 20001 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.459714 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.461589 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1876) took 1431 ms. Trace:
I20260709 13:07:36.401660 20310 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.456804 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.466372 15713 rpcz_store.cc:276] 0709 13:07:35.031190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.460474 (+1429284us) service_pool.cc:224] Handling call
0709 13:07:36.460752 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.460886 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.460928 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.460982 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.461358 (+   376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.461418 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.461531 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.471132 15638 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:36.466814 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.469702 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.474519 15639 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:36.475519 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.473093 15722 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:36.473389 15644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 2042) took 3066 ms (client timeout 1708 ms). Trace:
W20260709 13:07:36.473516 15721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 677) took 2904 ms (client timeout 1942 ms). Trace:
I20260709 13:07:36.476550 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.478109 15640 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:36.477720 20358 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.479115 15640 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:36.480295 15640 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 13:07:36.477082 15721 rpcz_store.cc:269] 0709 13:07:33.568896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.569001 (+   105us) service_pool.cc:224] Handling call
0709 13:07:36.473314 (+2904313us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540026d9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:36.473448 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645882624}
I20260709 13:07:36.459758 20374 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:36.482582 15721 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [5.6-10.8]
I20260709 13:07:36.483304 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1882) took 1450 ms. Trace:
I20260709 13:07:36.483685 15721 rpcz_store.cc:276] 0709 13:07:35.038831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.481839 (+1443008us) service_pool.cc:224] Handling call
0709 13:07:36.482228 (+   389us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:36.482991 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.483238 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.463352 20144 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.396188 20245 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.469976 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.476565 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1877) took 1445 ms. Trace:
I20260709 13:07:36.487080 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.487367 15722 rpcz_store.cc:276] 0709 13:07:35.031495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.469639 (+1438144us) service_pool.cc:224] Handling call
0709 13:07:36.472910 (+  3271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.476307 (+  3397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.476509 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:36.476992 15644 rpcz_store.cc:269] 0709 13:07:33.407238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.407359 (+   121us) service_pool.cc:224] Handling call
0709 13:07:36.473191 (+3065832us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b540019c654. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:36.473293 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131724544}
I20260709 13:07:36.488829 15792 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:36.477181 15639 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.486362 15721 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 13:07:36.489557 15644 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.490173 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1885) took 1429 ms. Trace:
I20260709 13:07:36.490695 15721 rpcz_store.cc:276] 0709 13:07:35.060367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.484554 (+1424187us) service_pool.cc:224] Handling call
0709 13:07:36.484922 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.489788 (+  4866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.490085 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.494589 20144 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.495899 20245 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:36.496634 15645 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:36.506035 15638 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:36.522678 15641 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:36.620069 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.638993 15644 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:36.639819 20371 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.640578 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.657949 15644 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.641069 20310 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.648973 15641 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:36.664896 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.665728 15641 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.660586 15639 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:36.669203 15639 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:36.641575 20332 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.797001 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2026) took 3944 ms. Trace:
I20260709 13:07:36.797573 15646 rpcz_store.cc:276] 0709 13:07:32.852318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.856031 (+  3713us) service_pool.cc:224] Handling call
0709 13:07:32.856423 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.630862 (+774439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.796695 (+3165833us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54003aff54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:36.796937 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769011456}
I20260709 13:07:36.799856 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.803985 15646 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:36.802860 15717 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 678) took 3227 ms (client timeout 2071 ms). Trace:
W20260709 13:07:36.804628 15717 rpcz_store.cc:269] 0709 13:07:33.575809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.575966 (+   157us) service_pool.cc:224] Handling call
0709 13:07:36.802533 (+3226567us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54001e8554. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:36.802744 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249840000}
I20260709 13:07:36.810303 15717 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:36.811745 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1899) took 1256 ms. Trace:
I20260709 13:07:36.812462 15717 rpcz_store.cc:276] 0709 13:07:35.555684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.809375 (+1253691us) service_pool.cc:224] Handling call
0709 13:07:36.809839 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.811366 (+  1527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.811666 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.818974 15717 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:36.821899 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1900) took 1031 ms. Trace:
I20260709 13:07:36.822942 15717 rpcz_store.cc:276] 0709 13:07:35.790164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.813600 (+1023436us) service_pool.cc:224] Handling call
0709 13:07:36.818521 (+  4921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.820916 (+  2395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.821212 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.828558 15641 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:36.841862 20232 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:36.805227 20334 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:36.854811 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.857216 15646 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:36.865650 15719 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:36.863643 20232 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.870970 20232 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.874713 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1865) took 4224 ms. Trace:
I20260709 13:07:36.875135 15718 rpcz_store.cc:276] 0709 13:07:32.650661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.709549 (+ 58888us) service_pool.cc:224] Handling call
0709 13:07:32.735134 (+ 25585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.856334 (+2121200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.874482 (+2018148us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540003be54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:36.874659 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4835168128}
I20260709 13:07:36.882727 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:36.886230 20136 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.888062 15795 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.888317 20272 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:36.890110 20248 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:36.890390 20381 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:36.893361 15644 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:07:36.880375 20380 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
W20260709 13:07:36.895220 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 565930us
I20260709 13:07:36.900365 20017 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:36.907017 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.909451 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:36.910421 15644 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:36.910876 20371 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:36.914556 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.915613 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.916857 20231 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:36.917382 20231 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:36.907313 20373 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.530s	user 0.004s	sys 0.010s
I20260709 13:07:36.921872 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.924077 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.927122 15795 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:36.926529 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:36.920545 20334 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:36.925812 20310 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:36.921226 20371 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:36.928413 20069 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:36.923372 20296 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:36.947557 20224 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.922353 20231 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:36.947484 20334 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:36.927791 20256 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:36.952804 20136 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:36.962445 20224 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:37.052778 20388 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:37.062600 20224 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.069370 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1902) took 1210 ms. Trace:
I20260709 13:07:37.069952 15720 rpcz_store.cc:276] 0709 13:07:35.859425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.168856 (+309431us) service_pool.cc:224] Handling call
0709 13:07:37.069056 (+900200us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001e8054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:37.069271 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390848768}
I20260709 13:07:37.071364 15715 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:37.004058 20136 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.103286 20136 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:37.118571 20385 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:07:37.166692 20384 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:07:37.178081 20334 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:37.183534 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 287373us
I20260709 13:07:37.185207 20393 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:37.186321 20393 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:37.188491 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 293998us
I20260709 13:07:37.205399 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.205687 16331 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [5.6-10.8]
I20260709 13:07:36.977432 20371 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.286168 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2409) took 1773 ms. Trace:
I20260709 13:07:37.286924 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.286914 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.288344 15787 rpcz_store.cc:276] 0709 13:07:35.513111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.525082 (+ 11971us) service_pool.cc:224] Handling call
0709 13:07:35.525398 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.542882 (+ 17484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.542923 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.543400 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.897963 (+1354563us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b18003d2be0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:37.189328 (+291365us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:37.189395 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.189498 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.189542 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:37.189554 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.286106 (+ 96552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22800,"raft.queue_time_us":19860,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":17282,"spinlock_wait_cycles":10104576,"thread_start_us":291100,"threads_started":1,"wal-append.queue_time_us":1615710}
I20260709 13:07:37.288684 15789 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:37.292200 20120 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.295912 20120 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:37.297144 20120 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.299401 20120 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.303951 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:37.306030 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.287274 20263 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.310679 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.311585 15791 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 7.
I20260709 13:07:37.290814 20371 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.293282 20391 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:37.318513 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.319696 15791 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:37.316354 20358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.008s	sys 0.010s
W20260709 13:07:37.332264 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 405765us
I20260709 13:07:37.333719 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:37.336591 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:37.337409 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.310720 20263 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:37.338428 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.330188 20358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.009s	sys 0.010s
I20260709 13:07:37.322532 20297 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:37.343532 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.344602 15791 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:37.345417 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:37.321372 20310 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.347087 15640 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.348533 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.349690 20393 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.354622 15789 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:37.340622 20296 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.336266 20069 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.357384 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:37.361176 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.373243 16300 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.880s (SENT) [suppressed 22 similar messages]
I20260709 13:07:37.374047 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.323135 20391 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.379401 15644 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:37.391009 20263 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:37.374073 20296 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.343251 20297 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.381783 20396 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:37.382715 20256 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.413697 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 957) took 1454 ms. Trace:
I20260709 13:07:37.403117 20296 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.416352 16328 rpcz_store.cc:276] 0709 13:07:35.959272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.959411 (+   139us) service_pool.cc:224] Handling call
0709 13:07:35.962513 (+  3102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.274562 (+312049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.413337 (+1138775us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54002dee54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:37.413613 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708436224}
I20260709 13:07:37.419799 20235 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:37.426051 20069 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.415632 20252 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.427039 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 1886) took 2366 ms. Trace:
I20260709 13:07:37.406963 20300 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:37.403498 20310 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.429605 20397 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.427388 20252 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:37.459005 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 85805.7us
I20260709 13:07:37.447532 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 679) took 2418 ms. Trace:
I20260709 13:07:37.433830 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:37.441762 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 681) took 2411 ms. Trace:
W20260709 13:07:37.448112 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 1.12999e+06us
W20260709 13:07:37.429322 20326 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 2.270s	user 0.007s	sys 0.027s
I20260709 13:07:37.470788 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.427459 15719 rpcz_store.cc:276] 0709 13:07:35.060784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.794612 (+733828us) service_pool.cc:224] Handling call
0709 13:07:37.426858 (+1632246us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400384fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:37.426988 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441885056}
I20260709 13:07:37.465948 15715 rpcz_store.cc:276] 0709 13:07:35.030219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.439641 (+1409422us) service_pool.cc:224] Handling call
0709 13:07:37.071097 (+631456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.071872 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.441464 (+369592us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54001e8050. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:37.441658 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425206656}
I20260709 13:07:37.471652 15788 raft_consensus.cc:2410] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:37.469390 15789 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:37.471849 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:37.448858 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 69748us
I20260709 13:07:37.472572 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.472903 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:37.463878 20252 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.433720 20391 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:37.474865 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.03806e+06us
I20260709 13:07:37.458215 20136 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.476199 15759 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.446412 20297 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.457952 20254 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.482550 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:37.417729 20396 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:37.477346 20365 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.252s	user 0.005s	sys 0.020s
I20260709 13:07:37.409159 20398 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:07:37.490123 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1889) took 2428 ms. Trace:
I20260709 13:07:37.486742 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1881) took 2454 ms. Trace:
I20260709 13:07:37.484118 16297 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:37.490492 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:37.460086 15714 rpcz_store.cc:276] 0709 13:07:35.029589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.805221 (+775632us) service_pool.cc:224] Handling call
0709 13:07:35.805498 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.805690 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:35.976991 (+171301us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.260747 (+283756us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b1800348ee0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:07:36.261029 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.447030 (+1186001us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b1800348ee0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:37.447184 (+   154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.447232 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:37.447274 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.447345 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.447479 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183586,"prepare.queue_time_us":463870,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":5713,"raft.queue_time_us":1196930,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7015,"spinlock_wait_cycles":19077888,"thread_start_us":253821,"threads_started":2,"wal-append.queue_time_us":135154,"wal-append.run_cpu_time_us":2186,"wal-append.run_wall_time_us":1215435}
I20260709 13:07:37.492774 16334 raft_consensus.cc:2376] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13. Re-sending same reply.
I20260709 13:07:37.475924 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.494459 15788 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:37.491747 15722 rpcz_store.cc:276] 0709 13:07:35.061805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.488363 (+1426558us) service_pool.cc:224] Handling call
0709 13:07:36.558284 (+ 69921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.558576 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:36.635844 (+ 77268us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.489794 (+853950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.489854 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.489901 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.489970 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.490072 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":705213,"prepare.queue_time_us":77096,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":225207,"threads_started":1,"wal-append.queue_time_us":284723}
I20260709 13:07:37.495622 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.491995 15713 rpcz_store.cc:276] 0709 13:07:35.032602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.471095 (+1438493us) service_pool.cc:224] Handling call
0709 13:07:36.471389 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.471606 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:36.486169 (+ 14563us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.486325 (+1000156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.486377 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:37.486431 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.486516 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.486667 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":888516,"prepare.queue_time_us":14407,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":824458,"thread_start_us":177756,"threads_started":1,"wal-append.queue_time_us":353913}
I20260709 13:07:37.496392 15714 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:37.477082 20256 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.465278 20397 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.504462 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 540) took 1194 ms. Trace:
I20260709 13:07:37.489279 20241 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.468657 20354 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:37.507913 20269 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:37.508795 20334 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.508941 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.509219 20334 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.511878 15714 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.514047 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.505115 15645 rpcz_store.cc:276] 0709 13:07:36.310440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.449443 (+139003us) service_pool.cc:224] Handling call
0709 13:07:37.504201 (+1054758us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b540019cb54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:37.504387 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105777408}
I20260709 13:07:37.514199 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.515435 15713 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:37.517275 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.517992 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.518941 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2086) took 1122 ms. Trace:
I20260709 13:07:37.518730 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.519919 15713 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:37.521503 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.522400 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1892) took 1972 ms. Trace:
I20260709 13:07:37.523154 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.524020 15716 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:37.524829 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.525220 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.525498 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.526085 15718 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:37.530506 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.519424 15639 rpcz_store.cc:276] 0709 13:07:36.396591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.723230 (+326639us) service_pool.cc:224] Handling call
0709 13:07:36.743241 (+ 20011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.743482 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:36.776382 (+ 32900us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.845466 (+ 69084us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.435131 (+589665us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b180019a620. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f
0709 13:07:37.510117 (+ 74986us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180019a620. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:07:37.518378 (+  8261us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.518585 (+   207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.518636 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.518685 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.518747 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.518877 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8120,"prepare.queue_time_us":32767,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":3247,"raft.queue_time_us":1887,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":1992,"spinlock_wait_cycles":48070912,"thread_start_us":68212,"threads_started":1,"wal-append.queue_time_us":86223}
I20260709 13:07:37.489710 20377 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:37.502480 20256 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:37.544325 20256 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.500799 19893 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:07:37.518498 20263 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:37.487370 20136 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.550683 20136 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:37.551043 20396 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.552018 20190 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.555743 20371 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.500877 20393 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:37.561147 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.559698 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:37.567106 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 82133us
I20260709 13:07:37.566995 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:37.570899 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:37.571584 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.522782 15721 rpcz_store.cc:276] 0709 13:07:35.549901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.491760 (+941859us) service_pool.cc:224] Handling call
0709 13:07:36.492096 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.492365 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:36.848768 (+356403us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.522056 (+673288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.522110 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:37.522159 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.522226 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.522348 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":603531,"prepare.queue_time_us":143000,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":356504,"threads_started":2,"wal-append.queue_time_us":193968}
W20260709 13:07:37.569329 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 87871.5us
I20260709 13:07:37.572701 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.580658 15642 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:37.582731 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.541530 20397 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:37.588142 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:37.592381 15759 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:37.570065 20393 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.596525 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.597652 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:37.580466 20398 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 13:07:37.603112 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 120648us
I20260709 13:07:37.604864 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.606133 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.606819 16326 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:37.590296 20258 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:37.612332 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 101602us
I20260709 13:07:37.612509 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.613179 16330 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:37.580598 20332 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:37.598107 20393 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.631759 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.603400 20396 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:37.634018 15716 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:37.595628 20397 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.644109 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.588088 20069 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.597549 20354 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:37.605990 20377 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.652788 20377 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.654260 19907 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:37.654754 19907 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.655524 20377 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:37.614490 20323 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.616961 20319 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.655642 19907 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.656243 20323 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:37.656639 20323 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.656899 19907 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.598485 20253 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:37.603663 20322 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.618556 20262 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.619448 20296 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.658463 20322 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:37.658304 20262 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.658879 20322 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.659919 20296 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.659781 20322 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.660318 20262 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:37.660931 15794 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:37.661270 20322 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.661931 15721 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:37.620813 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.664332 15791 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.621601 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.622033 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.622282 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.670993 15789 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:37.622730 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.622903 20156 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:37.672266 20156 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:37.623414 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:37.624135 15647 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:37.627395 20334 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.627926 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.637009 20370 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.718740 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.628750 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:37.629383 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:37.609342 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 115835us
I20260709 13:07:37.635844 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:37.609010 20231 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:37.608829 20136 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:37.639370 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.647166 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:37.674189 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 50852.1us
I20260709 13:07:37.675340 15722 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:37.702852 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 70161.8us
I20260709 13:07:37.706355 15791 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:07:37.729254 15685 connection.cc:256] RPC call timeout handler was delayed by -1.2123675330000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:07:37.729763 15685 connection.cc:256] RPC call timeout handler was delayed by -1.0458675329999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 13:07:37.721556 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:37.724993 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89209.2us
I20260709 13:07:37.725523 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.725963 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.628512 15792 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:37.729233 20069 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:37.734457 20412 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.734974 20412 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.735311 20412 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.736006 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.736588 15715 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:37.736902 20398 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:37.737879 20332 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:37.738101 20398 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:37.738879 20332 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:37.739635 20398 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:37.740461 20332 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:37.740847 20332 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.741183 20262 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.729782 20258 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:37.731882 15721 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 7.
I20260709 13:07:37.646608 20396 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.706940 20242 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.673148 20156 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.709190 20397 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:37.765215 20397 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.765655 20397 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.766697 15718 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:37.769243 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.769933 20334 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.754436 20156 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.770298 15716 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:37.746433 15794 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:37.774019 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:37.742807 20409 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:07:37.748610 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.776607 16331 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:37.754382 20136 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.777038 20396 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.778136 20136 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.778570 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.756999 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.780347 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.746644 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:37.733494 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:37.753928 20069 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.751925 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:37.754153 20242 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.783344 20069 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:37.783947 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.741724 20262 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.754168 20231 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:37.785219 20231 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.742290 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:37.726780 20252 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.742302 20258 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:37.786927 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44718us
I20260709 13:07:37.788051 20258 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:37.788213 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:37.788264 20256 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.789937 20410 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.742616 20250 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:07:37.790891 20250 consensus_queue.cc:1243] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:07:37.742242 20404 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:07:37.747354 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.792752 20412 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.793942 16334 raft_consensus.cc:2368] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:37.794185 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:37.783042 15611 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:37.795361 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 61948.8us
I20260709 13:07:37.795511 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:37.796031 16328 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.762997 20323 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.785810 20262 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:37.799266 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:37.802968 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:37.803917 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:37.798671 20288 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.801932 20370 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.805850 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:37.807358 20310 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.807870 20354 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:37.809132 20197 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:37.814033 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:37.815002 16326 raft_consensus.cc:2376] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11. Re-sending same reply.
I20260709 13:07:37.816810 20296 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:37.820013 16331 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:37.821681 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:37.826309 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:37.829823 15714 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.788000 20252 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:37.801129 20245 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.833220 16326 pending_rounds.cc:85] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 8
I20260709 13:07:37.833549 16326 pending_rounds.cc:107] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:37.833841 16326 raft_consensus.cc:2889] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:37.818089 20350 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.830710 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.827800 20354 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:37.831154 20310 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.831954 20178 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.830931 20366 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.862712 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.828989 20244 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:07:37.832787 20190 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:37.890576 20354 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:37.741706 20332 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.864336 20310 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:37.838400 20351 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.907903 16328 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:37.839612 20252 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:37.911448 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48970.6us
I20260709 13:07:37.923543 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:37.895910 20366 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:37.837159 20410 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:07:37.865089 20178 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:37.930572 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.930995 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.932592 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.933257 15716 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:37.902556 20190 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:37.934409 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.935097 15718 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:37.915658 20310 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.915428 20296 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.936863 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:37.919674 20358 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:37.944052 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.947186 16328 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:37.954712 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:37.955435 15790 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.955963 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:37.929078 20370 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.958343 15791 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:37.927202 20256 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:37.935112 20178 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.961252 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:37.925860 20366 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.973294 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:37.959820 20120 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:07:37.951634 20358 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:37.976176 20358 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:37.968941 15790 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:37.977619 20358 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.957964 20377 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.958400 20412 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.014953 20253 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.015463 20253 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:38.016323 20253 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.017417 20253 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.018138 20342 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:37.992550 20256 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:37.965446 20250 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:38.027452 20254 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:38.031564 20371 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.010828 20396 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:38.033530 20342 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:38.044147 15793 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:38.036286 20254 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.012228 20377 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.038046 20396 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.005689 20190 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.037570 20256 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:38.035808 20393 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.034970 20250 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.054688 20396 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.085889 20366 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.088470 20366 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.080813 20342 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.091503 20250 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.099761 20393 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.101680 20397 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.103530 20256 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.091555 20342 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.112092 20397 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:38.127548 20377 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.132477 20396 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.134891 20396 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:38.178630 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.184377 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2351) took 1871 ms. Trace:
I20260709 13:07:38.186625 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:38.187152 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.185132 15643 rpcz_store.cc:276] 0709 13:07:36.312655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.487329 (+174674us) service_pool.cc:224] Handling call
0709 13:07:36.646211 (+158882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.434965 (+788754us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:37.434995 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.435528 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.605705 (+170177us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:37.605766 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.183064 (+577298us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540045f1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:38.183186 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.183416 (+   230us) raft_consensus.cc:1685] finished
0709 13:07:38.183453 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.184111 (+   658us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2739,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":1812908416,"thread_start_us":159549,"threads_started":1,"wal-append.queue_time_us":168833}
I20260709 13:07:38.189765 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.191038 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 2058) took 2760 ms. Trace:
I20260709 13:07:38.191721 15647 rpcz_store.cc:276] 0709 13:07:35.430843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.430993 (+   150us) service_pool.cc:224] Handling call
0709 13:07:38.190438 (+2759445us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b5400344c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:38.190724 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4821756672}
W20260709 13:07:38.203231 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.204272 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.204927 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.213136 20156 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:38.214440 20156 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.220943 15721 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:38.221066 20298 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.221598 15721 pending_rounds.cc:85] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 6
I20260709 13:07:38.222105 15721 pending_rounds.cc:107] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:38.222635 15721 raft_consensus.cc:2889] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.223264 20410 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:38.224436 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 387599us
I20260709 13:07:38.224236 20410 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.227301 20410 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:38.227917 15719 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.230533 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:38.231630 15715 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.193722 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.222030 20298 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.246199 20312 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:38.234414 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:38.251636 15718 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:38.252214 15718 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:38.253681 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.261209 20351 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.269994 20248 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:38.270545 20248 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:38.274129 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.275626 20393 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.276659 20393 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.282063 20426 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.290686 20298 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.291848 20358 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.304136 16326 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:38.302300 20248 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.256389 15718 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.311828 20248 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:38.314204 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 85608.1us
I20260709 13:07:38.318318 20434 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:38.319335 20434 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:38.320442 20434 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:38.320824 20434 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:38.320909 20323 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.319358 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.325057 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:38.326189 20350 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.328016 20434 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.329428 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:38.334132 15647 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.339190 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:38.331736 20393 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:38.332366 20425 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.312s	user 0.000s	sys 0.002s
I20260709 13:07:38.333004 15718 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.357028 20269 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.357615 20269 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:38.358716 20269 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.359949 20269 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.363232 20245 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:38.363868 20245 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:38.364343 20245 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.364663 20310 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.365424 20242 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:38.367522 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 174028us
I20260709 13:07:38.317193 20156 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.378716 20434 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.384150 20224 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.387234 20197 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:38.392402 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:38.408072 20224 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:38.394495 20397 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:07:38.393642 16298 connection.cc:256] RPC call timeout handler was delayed by -1.6189219120000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:07:38.413245 20197 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.413786 20197 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:38.415179 20190 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.415124 20197 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.416917 20197 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.417995 16326 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.420780 15715 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:38.426352 15719 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:38.424597 20156 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:07:38.426877 20332 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.432415 15643 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
W20260709 13:07:38.433449 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.452288 15642 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:38.434882 20224 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.435796 15722 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.436743 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:38.453969 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.454090 20224 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.456314 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.437812 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:38.439339 15645 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:38.440251 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:38.448945 15643 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:38.449493 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:38.459192 16334 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.450241 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:38.450335 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:38.450671 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:38.434397 20367 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.471074 15718 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:07:38.472865 15647 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:38.472554 15718 pending_rounds.cc:85] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 6
I20260709 13:07:38.479313 15718 pending_rounds.cc:107] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:38.479697 15718 raft_consensus.cc:2889] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.482049 15644 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:38.482172 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:38.483033 15719 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:38.488469 20366 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.489465 20366 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:38.491096 20366 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:38.494472 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44520.8us
I20260709 13:07:38.472455 20367 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:38.500984 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:38.501425 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.495143 20393 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:38.507246 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:38.507663 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:38.478391 20245 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.513383 15793 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:38.517490 20178 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.017s
I20260709 13:07:38.518687 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:38.520659 20263 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:38.520874 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:38.521423 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71316us
I20260709 13:07:38.517784 20393 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:38.525991 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54824.3us
I20260709 13:07:38.539976 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:38.545195 20178 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.526046 15545 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.546234 20254 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.547264 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:38.547792 20178 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:38.548648 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:38.548784 20263 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.551123 16334 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:38.533020 20245 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.539997 20310 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:38.544394 20242 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:38.562096 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.563941 20332 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:38.564513 20393 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:38.566601 20435 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:38.560316 20254 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:38.567144 20256 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:38.568131 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.558871 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:38.519009 20312 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:38.586787 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:38.587519 20426 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:38.588195 20426 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:38.591284 20253 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.592096 20256 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:38.598496 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43553.3us
I20260709 13:07:38.571570 20332 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.607453 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.593803 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:38.608551 20245 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:38.608887 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 129934us
I20260709 13:07:38.571450 20242 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.621657 20310 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.622036 20242 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.611565 20263 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.623122 20310 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:38.624508 20310 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.592736 20426 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.618031 20332 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.592119 20253 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:38.628567 20253 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.593302 20256 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.630586 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:38.619154 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:38.618031 20254 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.620923 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:38.600528 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:38.625847 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.632952 20254 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:38.633487 20254 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:07:38.634577 20441 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:38.634539 20254 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.576221 20367 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.636791 20367 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.637228 20426 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:38.641676 16330 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:38.644083 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:38.607501 20288 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:38.645797 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.656103 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.661118 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.674116 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.678795 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.702194 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.682060 20224 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:38.709226 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 253410us
I20260709 13:07:38.714226 15793 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 8.
I20260709 13:07:38.718746 20436 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.725262 20436 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.725543 16297 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:38.726347 20296 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.727147 20296 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.727869 20436 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.729525 20442 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:38.730332 20442 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:38.732174 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 131777us
I20260709 13:07:38.702519 20434 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:38.720106 20224 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:38.741782 15685 leader_election.cc:400] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9.
I20260709 13:07:38.744186 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:38.743711 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.745160 15722 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:38.703805 20269 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:07:38.748603 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118126us
I20260709 13:07:38.750344 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:38.743654 20069 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.755606 20069 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.758379 15790 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:38.759709 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:38.777263 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63274.6us
I20260709 13:07:38.757098 20314 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:38.782080 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.743716 20442 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.761143 20332 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.831750 20248 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:38.831804 20178 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.834746 20178 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.837082 20178 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:38.837926 20296 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:38.838856 20445 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:38.840111 20438 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:38.840234 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:38.841188 15722 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:38.825886 20253 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:38.785820 20254 consensus_queue.cc:1059] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:38.810132 20224 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.811865 20434 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:38.886066 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 132408us
W20260709 13:07:38.894676 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.893466 15762 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:38.926072 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 115528us
W20260709 13:07:38.865978 20443 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:07:38.880450 20446 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:38.964313 15722 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:38.862406 20434 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.856256 20254 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.960254 20269 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.978305 20241 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:38.981963 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76463.6us
I20260709 13:07:38.983565 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.962170 15793 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:38.985992 20245 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:38.986756 20245 consensus_queue.cc:1243] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:38.987864 20245 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.988644 20245 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:38.989014 20245 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:38.966230 20436 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.854784 20069 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:38.974357 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 161605us
I20260709 13:07:38.977957 20269 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.990599 16328 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:38.974479 20434 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.992615 20269 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:38.962487 15721 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.994020 20069 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:38.994490 16326 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:38.983573 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:38.995713 20069 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:38.996125 15722 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:38.975275 20254 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:38.925503 20178 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.998080 20254 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:38.998669 20178 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:38.999406 20254 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.002115 15721 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:39.002265 16330 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:07:38.996284 20263 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.002926 20263 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:39.003302 20263 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.004257 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.006556 15719 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:39.007988 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.009832 20178 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.011214 20367 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:39.011924 20248 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:39.012161 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:39.025334 16330 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:38.893937 20079 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
W20260709 13:07:39.027125 20447 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 13:07:39.028038 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:38.852830 20332 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.012665 20269 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.031798 20269 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.032187 20269 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:39.013965 20231 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:38.882390 20444 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:38.517597 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:39.033201 20269 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.037618 20269 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.020375 20296 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:39.044291 20190 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.044802 20190 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:38.990270 20436 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.046422 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:39.047794 20436 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.047905 20197 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:39.021979 20245 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.048566 20197 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.925848 20156 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.049113 20197 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.049626 20156 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.052394 20156 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.053192 20190 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.054881 20245 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.055382 20190 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:39.056126 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.058888 20262 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:39.059547 20262 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:39.012245 20256 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.063220 20310 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.033095 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.028952 20248 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:38.985414 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:38.888496 20314 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:39.076241 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.077549 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:38.849697 20242 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:39.085850 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.997363 20069 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:07:39.093531 15545 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.098146 20263 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.101603 20263 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:39.102222 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 116955us
I20260709 13:07:39.102854 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:39.096324 15545 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.103189 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:39.076283 20248 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.854359 20253 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.121765 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:39.106494 20248 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.108837 20069 consensus_queue.cc:1243] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:39.134096 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:39.154366 16328 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.134939 15545 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:39.135716 20253 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.138502 20241 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.119989 20197 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:39.141142 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.165997 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.142623 15540 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 248) took 39289 ms (client timeout 15000 ms). Trace:
I20260709 13:07:39.122685 16326 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:39.118505 20178 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:39.143416 20351 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:39.107945 20156 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.090605 20434 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.152169 20242 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.061221 20262 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.162761 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:39.190268 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.195514 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.196262 15718 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.198596 16334 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:39.164291 20397 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:07:39.204052 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.204589 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.205017 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.201364 15545 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.209291 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:39.210896 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:39.194288 20178 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:39.228426 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:39.200819 20314 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.228631 15792 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:39.233117 16326 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:39.236342 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.197304 20156 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.227218 20310 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:39.242221 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.241094 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 247654us
W20260709 13:07:39.245538 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.228196 20241 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:39.229219 20393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.032s	sys 0.063s
I20260709 13:07:39.258009 15545 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.233705 20262 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.270462 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:39.278977 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:39.289674 20224 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:39.264470 20393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.032s	sys 0.063s
I20260709 13:07:39.266750 15545 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 7, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 7 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:39.259621 20310 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.264998 20241 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.296845 16328 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:39.302011 15718 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:39.315793 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.316438 15719 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.303640 20310 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.305562 20241 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.321224 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:39.279771 20314 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.328042 15545 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 9, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.305815 20332 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.327903 20351 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:39.341711 15714 raft_consensus.cc:2410] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:07:39.341943 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 71599.1us
I20260709 13:07:39.342976 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:39.344262 15792 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:39.345542 20351 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:39.347251 20463 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:39.347973 20463 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:39.348814 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:39.346773 20351 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:39.351548 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.351046 15545 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 9, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.351887 15794 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 8: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:39.358901 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.359179 20178 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:39.361851 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 242885us
I20260709 13:07:39.363494 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.364187 15713 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.313973 20224 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.373445 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.374294 15718 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:39.375016 20224 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.337850 20197 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.361899 20156 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.369613 15715 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:39.370981 15545 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 12, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.388870 15545 catalog_manager.cc:5697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:07:39.166592 15540 rpcz_store.cc:269] 0709 13:06:59.853256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.866831 (+ 13575us) service_pool.cc:224] Handling call
0709 13:07:39.142331 (+39275500us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:29.725566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:29.726315 (+   749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:29.726370 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:29.726390 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:29.727675 (+  1285us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:29.727781 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:29.727812 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:29.902627 (+174815us) tablet.cc:701] Row locks acquired
0709 13:07:29.902689 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:07:29.902892 (+   203us) write_op.cc:270] Start()
0709 13:07:29.903042 (+   150us) write_op.cc:276] Timestamp: P: 1783602449902814 usec, L: 0
0709 13:07:29.903071 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:07:29.982776 (+ 79705us) log.cc:844] Serialized 4718 byte log entry
0709 13:07:31.250865 (+1268089us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:31.490212 (+239347us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.651305 (+161093us) write_op.cc:301] APPLY: starting
0709 13:07:31.670962 (+ 19657us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.911555 (+240593us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.911607 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:32.514462 (+602855us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:32.514863 (+   401us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:07:32.514908 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:32.515301 (+   393us) log.cc:844] Serialized 113 byte log entry
0709 13:07:32.515524 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.515657 (+   133us) write_op.cc:454] Released schema lock
0709 13:07:32.515733 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:32.516226 (+   493us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.516255 (+    29us) write_op.cc:454] Released schema lock
0709 13:07:33.814664 (+1298409us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b18004369c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319557 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
Metrics: {"mutex_wait_us":1093717,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":153236,"apply.run_cpu_time_us":28254,"apply.run_wall_time_us":870552,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48024,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":29774,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":12,"prepare.queue_time_us":109005,"prepare.run_cpu_time_us":85416,"prepare.run_wall_time_us":377694,"raft.queue_time_us":186477,"raft.run_cpu_time_us":22151,"raft.run_wall_time_us":52049,"replication_time_us":1586889,"spinlock_wait_cycles":38710656,"thread_start_us":341958,"threads_started":4,"wal-append.queue_time_us":1448184,"wal-append.run_cpu_time_us":37160,"wal-append.run_wall_time_us":3340015}]]}
I20260709 13:07:39.349007 20463 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.401172 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:39.392243 20314 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.391649 15545 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 6, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 6 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:07:39.408798 20458 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:07:39.397505 20252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.018s
W20260709 13:07:39.411839 20252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.013s	sys 0.019s
I20260709 13:07:39.393254 20322 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:39.411085 15545 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 8, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 8 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:07:39.416857 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74002.5us
I20260709 13:07:39.400306 20434 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.436161 15794 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:39.440229 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:39.442587 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.443271 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:39.437839 20366 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:39.444473 20366 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.428365 20242 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.429952 20245 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:39.454694 15713 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:39.456003 15791 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.456220 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.457137 15722 raft_consensus.cc:2393] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:39.457870 20241 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.458998 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.459995 20241 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:39.456162 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 117695us
I20260709 13:07:39.464205 15545 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:39.473393 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.473873 20248 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.462271 15790 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:39.437600 20434 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:39.476682 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.426015 20322 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:39.486311 15688 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.663s (SENT)
I20260709 13:07:39.486836 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:39.487600 20322 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.490015 20245 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.492200 20245 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.492724 20242 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.493912 20434 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.495154 20288 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.495937 20434 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.496910 15792 pending_rounds.cc:85] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 10
I20260709 13:07:39.497303 15792 pending_rounds.cc:107] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:39.497562 15792 raft_consensus.cc:2889] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.497625 20256 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:39.499585 20190 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:39.500198 20190 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:39.501412 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.502274 20190 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.504025 20242 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.504227 20262 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:39.505074 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.505106 20323 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.504032 20322 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.506285 20322 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.505674 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:39.507555 15790 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:39.515643 15791 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.516009 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.516933 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.518110 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.505689 20323 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:39.519567 20323 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.519919 20322 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:39.516511 16300 leader_election.cc:336] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.880s (SENT)
I20260709 13:07:39.512130 15545 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 9, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.521593 15719 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:39.528630 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:39.524925 20436 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.534720 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.547703 15715 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:39.555881 15545 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:39.532591 20436 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.560868 20248 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:39.561430 20470 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:39.561784 20190 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.562134 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:39.562345 20412 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:39.563057 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.558319 15610 connection.cc:256] RPC call timeout handler was delayed by -1.4000435429999243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:07:39.572872 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3749183720000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:07:39.573424 15610 connection.cc:256] RPC call timeout handler was delayed by -1.0445435429999179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 13:07:39.526664 20366 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.564020 15545 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:39.565804 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:39.568738 15791 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.570577 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.574587 15790 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:39.562206 20426 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.528276 20393 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:39.568099 20241 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.588119 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.588956 15644 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:39.589552 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.590529 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.590793 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.591244 15645 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.591650 15639 raft_consensus.cc:2410] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:39.592931 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.589107 15545 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 6, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 6 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:39.600011 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.602970 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.604014 15644 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.608031 20190 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.609311 20426 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.611621 20426 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.600340 15545 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.585942 20366 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:39.614288 15794 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:39.614933 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 98477.9us
I20260709 13:07:39.617169 15791 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.615495 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.617277 20366 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:39.619396 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.619184 20366 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.596593 20241 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.624464 20436 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.598095 20323 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.626590 16330 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.602269 20332 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:39.635416 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.635440 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.631659 20248 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:07:39.643007 20190 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:39.660903 20473 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:07:39.644714 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.632967 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.672387 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.649497 15715 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:39.693424 15717 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:39.671821 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.653296 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.654398 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:39.695233 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:39.695613 15788 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.695897 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.696760 15715 pending_rounds.cc:85] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 8
I20260709 13:07:39.697190 15715 pending_rounds.cc:107] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:39.698698 15715 raft_consensus.cc:2889] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.653776 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.699712 15787 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:39.671634 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.701156 15647 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.671303 15639 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [9.3-9.3]
I20260709 13:07:39.648689 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.648023 20310 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.673471 15638 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:39.704609 15789 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:39.672083 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.705643 15640 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:39.705857 20310 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:39.663815 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:39.670457 20178 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.707259 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 43616.3us
I20260709 13:07:39.698237 20426 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:39.707964 20426 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.708400 20426 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.708911 20190 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.709460 20190 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.711192 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:39.711778 20190 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.713949 20332 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.714509 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:39.694257 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:39.707033 20178 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.719488 20178 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.720546 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:39.721462 20463 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.721276 15715 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:39.722126 20463 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.722909 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:39.723299 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.723615 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.724031 20178 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.724499 20178 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.724911 20178 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.724846 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.725092 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.725127 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.726248 15642 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.726259 15638 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:39.727105 15639 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:39.728188 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.728968 15644 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
I20260709 13:07:39.649353 15721 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:39.726336 20463 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.730460 15640 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 14. Ops: [9.6-12.7]
I20260709 13:07:39.670044 20262 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.644459 20241 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.731333 16330 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:39.739439 15792 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:39.634505 15545 catalog_manager.cc:5697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 9, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:39.741822 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.741660 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.742004 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.694653 15645 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:39.743199 15788 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:39.746471 15545 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 12, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.747726 15647 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:39.744459 15642 raft_consensus.cc:2376] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11. Re-sending same reply.
I20260709 13:07:39.761467 15793 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.763345 15545 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 10, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.768205 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.768908 15639 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:39.769906 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.769990 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:39.771140 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.771921 15640 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:39.772594 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.773337 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.774024 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.775086 15640 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: [4.4-9.5]
I20260709 13:07:39.775192 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.775893 15645 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:39.776320 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.776736 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.777271 15645 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.777849 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.778592 15641 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:39.779481 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.780019 15641 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:39.780870 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.781055 20463 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:39.781437 15641 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.781682 20463 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.782538 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.786691 15643 raft_consensus.cc:2393] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:39.744256 20248 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:07:39.792543 15640 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.796377 15642 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:39.793512 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.797344 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.799939 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.791812 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:39.801277 15688 leader_election.cc:336] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.675s (SENT)
I20260709 13:07:39.749181 20310 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.795279 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:39.802461 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.806305 15647 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 9: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.804207 15545 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 9, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:39.806371 16300 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.942s (SENT)
I20260709 13:07:39.807330 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.809273 15643 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.812659 15645 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:39.824139 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:39.825083 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.813812 20332 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:39.821043 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.820766 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.822896 15545 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 6, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 6 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:39.828713 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.829394 15639 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:39.827051 15645 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:39.830662 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.831403 15642 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.832235 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.833021 15645 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:39.833808 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.838356 20426 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.749920 20262 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.820811 20310 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.846673 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.847887 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:39.848683 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.850417 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.851441 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.851733 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.852088 15721 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.850275 20332 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:39.852268 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.852548 15645 raft_consensus.cc:2368] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12.
I20260709 13:07:39.852988 15640 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:39.853514 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:39.854179 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 83384.6us
I20260709 13:07:39.855012 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:39.854254 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 82732.9us
I20260709 13:07:39.855785 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:39.856526 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.856474 15638 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.854519 15645 raft_consensus.cc:2410] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:39.860755 20463 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.861294 15645 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:39.847646 20156 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:39.868938 20310 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:39.870242 15645 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.872054 20178 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:39.873353 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.873945 15646 raft_consensus.cc:2368] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:39.874771 15645 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:39.875792 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.876151 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.877208 15646 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.874056 15647 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:39.852574 20241 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:39.869119 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:39.877635 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:39.879279 20069 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.846840 15643 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:39.901795 15641 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:39.881218 20262 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.864797 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:39.882304 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:39.882416 15688 leader_election.cc:336] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.731s (SENT)
I20260709 13:07:39.905982 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:39.855806 15640 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.880388 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.907306 15638 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.907509 15647 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:39.877038 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:39.897727 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.903533 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:39.909407 15716 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.910845 15645 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.885246 15721 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:07:39.918334 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 53620.2us
I20260709 13:07:39.919898 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:39.922431 15646 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:39.921041 15644 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:39.879561 20241 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:39.927117 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:39.929200 15638 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.903178 20412 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.932950 15638 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:07:39.933300 15644 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:39.935216 15639 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:39.936959 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.926672 20366 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:39.940186 15647 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:39.929857 20156 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:39.929884 20248 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.927855 20426 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.950562 15640 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:07:39.951582 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:39.952919 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 154796us
W20260709 13:07:39.951740 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 95515.8us
I20260709 13:07:39.932818 20178 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:39.955793 15644 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:39.955142 15640 pending_rounds.cc:85] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 9
I20260709 13:07:39.958256 15640 pending_rounds.cc:107] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:07:39.958647 15640 raft_consensus.cc:2889] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.919071 20069 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:39.969456 15638 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:39.969914 15638 pending_rounds.cc:85] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 6
I20260709 13:07:39.970207 15638 pending_rounds.cc:107] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:39.970559 15638 raft_consensus.cc:2889] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.954070 20366 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:39.972298 15688 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.827s (SENT)
I20260709 13:07:39.974781 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:39.958968 20156 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:39.947265 20288 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:39.991986 15640 pending_rounds.cc:85] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 5
I20260709 13:07:39.992409 15640 pending_rounds.cc:107] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:39.992726 15640 raft_consensus.cc:2889] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.994197 15639 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:39.994230 16300 leader_election.cc:336] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.945s (SENT)
I20260709 13:07:39.994691 15639 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:40.008425 15642 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:40.010758 15644 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.019105 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:40.016119 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:40.018967 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:40.022285 15642 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:39.993345 20248 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 9.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:40.031366 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:40.032055 15645 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:40.033267 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:40.045470 15638 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:40.028442 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:40.024178 15639 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:40.039448 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:40.023515 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:40.048974 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:40.047803 15644 raft_consensus.cc:2376] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9. Re-sending same reply.
I20260709 13:07:40.111016 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:40.111840 15644 raft_consensus.cc:2376] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12. Re-sending same reply.
I20260709 13:07:40.080090 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:40.115315 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 75931.5us
W20260709 13:07:40.058524 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 85779.1us
I20260709 13:07:40.109455 15645 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14. Re-sending same reply.
I20260709 13:07:40.119145 15647 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:40.120234 15645 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:07:40.129711 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 161078us
I20260709 13:07:40.133409 15639 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:40.080641 20482 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:07:40.023994 20262 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.138049 20397 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.138978 20397 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.139328 20397 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.139645 20397 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.142568 15638 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:40.143174 20310 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:40.146956 20484 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:07:40.147950 20483 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:40.150327 20323 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:40.150871 20323 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:40.151825 20323 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.152954 20323 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.153062 15716 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:40.040652 20486 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.118321 20248 consensus_queue.cc:1243] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:40.118521 20436 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.178033 16300 leader_election.cc:336] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.023s (SENT)
W20260709 13:07:40.184571 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.203321 15688 leader_election.cc:336] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.838s (SENT)
I20260709 13:07:40.203944 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:40.173062 20248 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:40.225919 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 146052us
I20260709 13:07:40.031147 20241 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:40.131796 20366 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.208058 20426 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.176246 20486 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:40.232025 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65332.2us
I20260709 13:07:40.211895 20262 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.209008 20248 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:40.196118 20436 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.244016 15791 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:40.254386 16300 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.071s (SENT)
I20260709 13:07:40.254972 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:40.205931 20156 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:40.263944 15688 leader_election.cc:336] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.922s (SENT)
I20260709 13:07:40.247499 20178 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.272199 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.250861 20426 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:40.260993 20442 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:40.308394 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54047.6us
W20260709 13:07:40.311746 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 308376us
I20260709 13:07:40.256280 20256 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:07:40.283039 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 151458us
I20260709 13:07:40.289283 20310 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:40.284332 20178 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.322568 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:40.324379 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 68592.8us
I20260709 13:07:40.314538 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:40.329015 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 69752.5us
W20260709 13:07:40.330227 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.332935 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.336431 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:40.403364 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 71560.4us
I20260709 13:07:40.404927 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:40.412962 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84174us
I20260709 13:07:40.421116 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:40.334506 20224 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:40.340611 20069 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:40.332715 20190 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.440325 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:40.435940 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.443938 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.444396 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.435710 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 119881us
I20260709 13:07:40.334420 20436 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:40.339056 20262 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.454687 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.456562 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.457307 15716 raft_consensus.cc:2368] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11.
I20260709 13:07:40.435107 20224 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.451797 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:40.463021 15715 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:40.443739 20288 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.467017 15717 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:07:40.487200 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.495271 15717 pending_rounds.cc:85] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 10
I20260709 13:07:40.495735 15717 pending_rounds.cc:107] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:07:40.495955 15714 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:07:40.496104 15717 raft_consensus.cc:2889] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.434533 20461 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:40.498917 16330 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:40.341734 20248 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.500120 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.462524 20224 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.502514 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:40.450368 20487 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:07:40.502178 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:40.503751 15720 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:40.506096 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:40.510952 15642 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:40.504475 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.445997 20190 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.516464 15639 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:40.518030 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.466601 20314 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:40.519150 15715 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:40.495224 20463 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.533165 15641 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:40.546918 20463 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.547472 20463 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.549181 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:40.550201 20495 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:07:40.551296 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:40.552083 20493 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:07:40.556870 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.494484 20288 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:40.558241 20288 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.558647 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.505329 20436 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:40.494954 20509 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:40.550108 16330 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:40.552189 15720 raft_consensus.cc:2410] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:40.492570 20508 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.490778 20069 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:40.567498 15713 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:40.509260 20486 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:40.524230 15722 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:40.467046 20253 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:40.568919 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:40.571998 15715 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:07:40.481855 20492 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:40.543762 20412 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.578469 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.579799 16328 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:07:40.561806 20497 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:07:40.549638 20502 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:40.521080 20514 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.574512 16330 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:40.585320 15720 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:40.585568 16326 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.587221 20190 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:40.588668 20500 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:07:40.589411 20510 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:40.593891 20496 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.580935 20508 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:40.599207 15713 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:40.611435 15720 pending_rounds.cc:85] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 7
I20260709 13:07:40.624135 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:40.498646 20499 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:07:40.518478 20490 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:07:40.672605 15720 pending_rounds.cc:107] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:40.678367 15720 raft_consensus.cc:2889] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.611863 20486 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:40.676254 15717 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:40.598896 20412 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:40.674764 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50727.7us
I20260709 13:07:40.678428 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:40.682401 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.674055 20514 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.685639 20397 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.000s
I20260709 13:07:40.707316 16326 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:40.683517 20492 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.678730 20323 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.583515 20509 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:40.715571 15720 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.715560 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:40.695508 20491 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 13:07:40.683828 20486 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:40.721504 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:40.513588 20426 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:40.695591 20178 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:40.737416 16330 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:40.696696 20513 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.743369 15759 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:40.719789 20492 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.709544 20314 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:40.679342 20496 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.746549 16334 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:40.762676 15760 leader_election.cc:400] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11.
I20260709 13:07:40.780395 15760 leader_election.cc:403] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.745339 20461 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.756363 20492 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.723448 20397 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.733099 20323 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:40.735883 20322 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:40.718698 20514 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.761070 20310 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.802138 20489 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:07:40.801970 20486 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.803192 20486 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.807808 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:40.793327 15688 connection.cc:256] RPC call timeout handler was delayed by -1.0364187569999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:07:40.822793 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.838477 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 398220us
I20260709 13:07:40.835052 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.800706 20310 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.843742 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.843742 16328 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:40.852337 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:40.751008 20412 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:40.862563 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:40.831017 20442 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.752074 20508 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:40.873229 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.887487 16300 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.894s (SENT)
I20260709 13:07:40.892256 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:40.893573 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.759600 20513 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:40.807572 20253 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 13:07:40.915109 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.851711 20310 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.830789 20454 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:07:40.958299 15688 leader_election.cc:336] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.988s (SENT)
I20260709 13:07:40.921271 20498 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:40.925845 20256 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.957612 20412 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.900555 20314 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:07:40.958765 20442 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.935067 20248 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:41.002537 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44270.8us
I20260709 13:07:40.944500 20436 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.936169 20499 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:41.004885 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 225167us
W20260709 13:07:41.005275 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.017831 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:41.007897 15641 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:40.944269 20190 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.981283 20498 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:41.048528 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:41.049896 16297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.013s
I20260709 13:07:40.950137 20342 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.181s
W20260709 13:07:41.050266 16297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.010s	sys 0.013s
I20260709 13:07:41.016414 20487 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 13.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:40.926749 20517 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.199s
I20260709 13:07:40.980958 20224 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:41.051088 15688 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.058s (SENT)
I20260709 13:07:41.071484 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.022599 20509 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:41.067523 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.012s	sys 0.014s
I20260709 13:07:41.082129 15791 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:41.089182 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.015s
W20260709 13:07:41.089864 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 668796us
I20260709 13:07:41.090740 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:41.096048 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.096696 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.068744 20322 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.068305 20397 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.026772 20442 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.051468 20190 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.081825 20156 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.084420 20323 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.079368 20496 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:41.113255 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 261001us
I20260709 13:07:41.062444 20252 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:41.120922 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 93759.9us
I20260709 13:07:41.110970 20322 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:41.129658 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:41.140208 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 49556.1us
W20260709 13:07:41.142273 15688 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.094s (SENT)
I20260709 13:07:41.142944 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:41.154291 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 391725us
I20260709 13:07:41.217047 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:41.218452 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76475.3us
I20260709 13:07:41.218743 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.223635 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.224573 16330 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 9: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:41.226753 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.227792 16326 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:41.120250 20252 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.157851 20436 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.241979 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:41.154685 20514 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.245141 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.249145 15790 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:41.250324 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.250541 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.246421 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.150066 20524 raft_consensus.cc:2764] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:41.247366 15721 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:41.254371 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.269927 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.270561 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.270748 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.272837 15721 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:41.272558 15796 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:41.228865 20501 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:41.279464 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 137233us
W20260709 13:07:41.282945 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.181260 20241 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:07:41.276225 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.239913 20513 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.313174 16331 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:07:41.308710 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.238497 20536 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:41.253516 20253 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.231513 20397 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 13:07:41.304359 20288 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.746s	user 0.007s	sys 0.006s
W20260709 13:07:41.326826 15688 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.105s (SENT)
I20260709 13:07:41.278348 20521 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.343374 20224 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.345583 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.348155 20442 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:41.353229 15688 leader_election.cc:336] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.136s (SENT)
I20260709 13:07:41.353758 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.348445 20310 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.355029 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.357755 20310 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:41.358197 20535 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:07:41.353585 20534 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.220s	user 0.002s	sys 0.003s
W20260709 13:07:41.359509 20532 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:07:41.364106 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.334556 20521 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.370371 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.373028 20256 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.374826 20332 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:41.375262 20332 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:41.376227 20332 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.377322 20332 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.377990 20190 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.378405 20487 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.393159 20487 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:41.394737 20537 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:41.394544 20487 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.395833 20537 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.396024 20499 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11.
I20260709 13:07:41.340091 20288 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.369995 20521 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.398672 20288 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.325402 20536 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.401239 20536 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.402230 15715 raft_consensus.cc:2410] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:41.403066 20498 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:41.379355 20526 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:07:41.370129 20442 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:41.405706 20442 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:41.406081 20442 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:41.406986 20442 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:41.379992 20531 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:41.380416 20527 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.387522 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.392447 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.412194 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:41.378453 20538 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:07:41.396243 20537 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:41.404243 20498 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.370446 20486 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:07:41.414752 20442 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.415205 20503 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:41.415712 20342 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:41.416385 20527 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:41.389631 20492 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.590s	user 0.004s	sys 0.007s
W20260709 13:07:41.424110 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 151352us
I20260709 13:07:41.396377 20487 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.442235 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.410009 20241 consensus_queue.cc:1243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:41.432606 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 177380us
I20260709 13:07:41.344326 20322 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.449584 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.455950 20527 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:41.456676 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 103488us
I20260709 13:07:41.442924 20178 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:41.458235 20156 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.499261 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.458381 20492 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.432199 20454 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.460222 20547 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:41.462841 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.511813 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.466071 20252 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.469997 15716 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:07:41.470300 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 45402.8us
W20260709 13:07:41.463819 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.472654 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60541.8us
W20260709 13:07:41.516912 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.517189 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:41.495625 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:41.496137 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.518877 15643 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:41.521289 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:41.521427 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:41.504374 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:41.523075 15642 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:41.526825 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:41.522135 15644 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.509400 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:41.528443 15642 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.532524 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:41.532730 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.538669 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:41.502925 20489 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.559250 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:41.515481 20527 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:41.570606 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 61724.7us
W20260709 13:07:41.573005 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.576004 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.570041 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:41.576617 15795 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.537958 20156 raft_consensus.cc:2764] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:41.586351 15646 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:41.584039 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.594782 15722 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:41.580874 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63776.1us
I20260709 13:07:41.581965 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:41.595953 15715 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.582201 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.583047 15721 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:41.584398 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.585419 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:41.509059 20241 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:41.597194 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:41.597609 15647 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:41.601991 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:41.602937 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:41.605677 20454 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:41.616452 15719 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.617365 20454 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.621974 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.625828 20523 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.625926 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.626392 20523 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.579222 20499 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.626889 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.627188 20499 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.627287 20571 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.627724 15791 raft_consensus.cc:2368] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:41.627880 20571 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.589088 20524 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.628794 20524 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.629252 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.630020 15713 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:41.631201 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.631347 20524 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.594539 20503 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.632184 20503 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:41.632794 20563 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:41.577302 20248 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.634429 20503 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:41.635088 20463 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 1.087s	user 0.014s	sys 0.000s
I20260709 13:07:41.470608 20537 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.636608 20537 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.602955 20342 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.623279 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:41.640235 15718 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:41.628230 15793 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:41.635144 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.626807 20523 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.645097 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:41.616410 15714 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.631796 15713 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:41.627195 20540 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.650321 20540 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.653074 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.627717 20499 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.654021 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.645344 15642 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:41.631902 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.659255 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.659665 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.665027 15789 raft_consensus.cc:2368] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10.
I20260709 13:07:41.669987 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.576046 20069 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:41.682199 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.682864 15795 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:41.687932 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.663851 20540 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.670248 20524 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.670996 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 80803.5us
I20260709 13:07:41.693297 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.699110 15789 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:07:41.694681 15688 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.160s (SENT)
I20260709 13:07:41.638984 20463 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.702965 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:41.704458 15719 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:41.707495 15715 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:41.718600 20342 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:41.755089 20178 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:41.755316 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:41.756006 15638 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.755725 20178 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.756090 20342 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.726415 15794 raft_consensus.cc:2368] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13.
W20260709 13:07:41.759172 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 138854us
I20260709 13:07:41.752381 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 1965) took 1196 ms. Trace:
I20260709 13:07:41.758530 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:41.719652 15644 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
W20260709 13:07:41.758064 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 262502us
I20260709 13:07:41.722435 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.751935 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:41.720069 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:41.759159 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2147) took 1026 ms. Trace:
I20260709 13:07:41.745936 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.732849 15796 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 9.
W20260709 13:07:41.768157 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48160.1us
W20260709 13:07:41.772616 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 88065.5us
I20260709 13:07:41.760931 15716 rpcz_store.cc:276] 0709 13:07:40.555774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.555905 (+   131us) service_pool.cc:224] Handling call
0709 13:07:40.556206 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.515687 (+959481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.752065 (+236378us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54003bb354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:41.752280 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100652416}
I20260709 13:07:41.697237 20571 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.779768 15793 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:41.764815 15640 rpcz_store.cc:276] 0709 13:07:40.732476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.734003 (+  1527us) service_pool.cc:224] Handling call
0709 13:07:40.734488 (+   485us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:40.750367 (+ 15879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.750408 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:40.754364 (+  3956us) log.cc:844] Serialized 52 byte log entry
0709 13:07:40.943798 (+189434us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180042eaa0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2a32f328 00007fad2a326901 00007fad2a3268a7 00007fad2a41e288 00007fad2a41df37 00007fad2a43255c 00007fad2a432508
0709 13:07:41.072166 (+128368us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:41.252122 (+179956us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.539825 (+287703us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.742685 (+202860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.742786 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.758888 (+ 16102us) raft_consensus.cc:1685] finished
0709 13:07:41.758914 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.759094 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383492,"prepare.queue_time_us":279123,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":409702,"raft.run_cpu_time_us":4452,"raft.run_wall_time_us":198715,"spinlock_wait_cycles":25894656,"thread_start_us":569155,"threads_started":3,"wal-append.queue_time_us":606072}
I20260709 13:07:41.784766 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:41.789266 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:41.739753 20556 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:41.726064 20501 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.740625 20436 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:41.771811 20426 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.754161 20543 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:41.719197 20575 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:41.792281 20069 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.804332 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:41.810457 15789 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:41.777034 20492 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.776077 20514 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.701084 20524 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.788101 20536 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.816543 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.719190 20454 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:07:41.822001 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:41.829504 16329 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.832098 15795 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:41.741869 20521 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:41.840763 15688 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.223s (SENT)
I20260709 13:07:41.797834 20580 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.801842 20241 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:41.809496 20426 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.801672 20509 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:41.865161 20224 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:41.867867 20560 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:41.865458 20580 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.808806 20178 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.853919 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.810806 20069 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:41.872385 20069 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.844888 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:41.857383 15790 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 4.
I20260709 13:07:41.818089 20514 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.860174 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:41.860870 16326 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:41.861850 20521 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.862999 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.864583 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.884800 15796 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:41.882876 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:41.866485 20515 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.866899 20568 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.867576 20509 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.859997 20463 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.874683 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:41.887548 15639 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:07:41.877772 15638 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:41.857582 16329 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:41.809333 20436 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.873553 20580 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.892846 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:41.894075 15638 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.874406 20426 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.823863 20543 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.883603 20514 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.885349 20224 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:41.900940 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 92929.5us
I20260709 13:07:41.890445 20568 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.885417 20540 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:41.893359 20503 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.915359 15638 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:41.906194 20436 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.921031 20509 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.916852 20568 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.931423 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:41.932144 20503 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:41.933238 20503 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.891788 20523 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.890694 20575 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:41.936102 20523 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:41.936947 20575 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.923641 20543 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.898038 20241 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:41.928285 20524 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:41.942194 20241 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.943259 20568 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.944677 15793 raft_consensus.cc:2393] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:41.946449 20585 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:41.950500 15688 leader_election.cc:336] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.256s (SENT)
I20260709 13:07:41.953729 15714 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:07:41.964730 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66282us
I20260709 13:07:41.965562 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:41.966722 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:41.889680 20499 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:41.890630 20515 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.969957 20252 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:41.970752 20253 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:41.974777 20224 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.949929 20514 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:41.984659 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:41.985327 15787 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.985888 20515 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:41.979004 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62014.2us
I20260709 13:07:41.969363 20397 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:41.991308 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:41.991947 15639 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.992100 16334 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:41.993376 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:41.978082 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:41.977329 20498 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.005s
I20260709 13:07:41.975183 20568 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:41.995397 15715 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:41.979049 16325 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:41.999194 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 122739us
I20260709 13:07:42.011077 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:42.013983 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.983727 20499 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:42.036494 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.017577 20397 consensus_queue.cc:1243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:42.037593 15787 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:41.993674 20524 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:42.041141 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:42.037640 15639 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:42.007217 20253 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:42.041141 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:42.048697 15791 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.046597 16330 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.047642 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:42.040069 20514 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.055930 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:42.033876 20069 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.045401 20252 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:42.054090 20442 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.003s
I20260709 13:07:42.063802 20332 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.069497 20253 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.081661 16330 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:42.074071 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.058684 20156 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.083524 20156 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:42.083910 20252 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.087090 20069 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:42.087164 20426 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.088368 15796 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.084801 20156 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.105365 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:42.105798 15791 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:42.115211 20524 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.116437 20533 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:42.116879 20533 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:42.117713 20533 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.080333 20514 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:42.094802 20332 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:42.120890 20332 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.123119 20533 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:42.125342 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.097095 20503 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:42.131966 20503 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.134747 20514 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.150878 20426 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:42.151324 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53738.9us
I20260709 13:07:42.143771 20503 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.157161 20156 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.157943 20156 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.160907 20156 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:42.172927 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:42.176468 20523 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:42.177898 20323 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.178548 20323 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.166165 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:42.165444 20516 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.203601 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.190266 20523 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.172127 20514 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.180408 20515 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:42.207774 20288 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:42.218997 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:42.221508 15792 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.227058 20514 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:42.218695 20523 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.196928 20516 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.225025 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:42.237917 20527 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:42.227856 20069 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:42.237691 20252 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.244880 20527 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:42.253192 20256 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.274314 20256 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.258853 20523 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.290496 20256 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.279671 20252 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:42.291405 20252 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.292160 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.292878 15794 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:42.294486 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:42.294240 20527 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.267300 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.267335 20548 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:42.267199 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 515327us
W20260709 13:07:42.267925 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.279019 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:42.274781 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:42.298693 16325 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:42.288062 15640 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.299068 15640 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:42.300239 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.300513 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.300892 15795 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:42.232420 20606 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:42.290588 20516 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:42.298066 15642 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.302191 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.315001 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:42.218792 20332 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:42.299880 15640 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.317409 15640 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.315485 20524 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.314204 20256 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.318120 20580 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:42.357302 15642 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:42.320737 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.358793 15789 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:07:42.361690 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.306404 20523 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:42.305433 20489 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.392346 15789 pending_rounds.cc:85] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 4
W20260709 13:07:42.392591 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 72454.1us
I20260709 13:07:42.393023 15789 pending_rounds.cc:107] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 13:07:42.373883 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:42.393329 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.396154 15722 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.397308 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.397967 15719 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:42.393363 15789 raft_consensus.cc:2889] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.402324 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.405241 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:42.361472 20256 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:42.463553 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58438.5us
W20260709 13:07:42.463999 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 68630.8us
W20260709 13:07:42.465124 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71885.1us
I20260709 13:07:42.304836 20503 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.394032 20314 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.317235 20543 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:07:42.478307 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.478813 15714 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:42.321264 20551 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.486941 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.489965 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.463137 20256 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.464246 20156 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.398056 20501 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.401719 20523 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:42.478343 20509 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.484661 20366 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.511569 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.490787 20580 consensus_queue.cc:1243] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:42.488821 20426 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.489878 20536 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:42.517097 20487 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:42.549505 20503 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.500216 20156 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.554230 20523 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.555202 20156 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.488409 20314 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.517666 20190 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:42.523233 20572 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:42.527928 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:42.528599 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.574572 15715 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:42.529358 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:42.529713 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:42.575615 15716 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.530658 15720 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.532896 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:42.492681 20522 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:42.578614 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 64988.9us
I20260709 13:07:42.542270 15610 leader_election.cc:400] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:42.579303 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:42.492213 20551 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.467191 20516 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:42.496809 20574 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:42.569906 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.571686 20487 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:42.579674 15610 leader_election.cc:403] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:42.585758 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:42.588002 15718 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:07:42.596676 15719 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.567934 20509 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.515791 20366 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.585446 20069 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.568565 20536 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.406872 20489 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:42.599980 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57827.1us
I20260709 13:07:42.613536 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.596851 20241 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:42.513729 20501 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.616912 15610 leader_election.cc:400] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10.
I20260709 13:07:42.628783 15610 leader_election.cc:403] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:42.629992 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.640180 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.601927 20069 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.604684 20190 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:07:42.596014 20487 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:42.642208 15714 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:42.602464 20366 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.673075 20487 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.674317 20487 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.676651 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.608409 20533 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:42.677522 15714 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:42.647282 15716 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:42.654824 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.660724 15719 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:42.648339 20069 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.627799 20178 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:42.666766 20551 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.666857 20426 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:42.646301 20241 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:42.670843 20256 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.612581 20253 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.678392 15640 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:42.682590 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.694407 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:42.641669 20522 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.739970 15640 pending_rounds.cc:85] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 8
I20260709 13:07:42.747182 15640 pending_rounds.cc:107] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:07:42.747474 15640 raft_consensus.cc:2889] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.730587 16327 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:42.740569 15716 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:42.733896 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:42.736023 20190 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:42.736781 20612 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:42.721933 20489 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:42.750499 16329 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:07:42.759454 20607 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:42.759555 20256 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.638025 20574 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:07:42.752120 15793 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:42.752816 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70297.3us
I20260709 13:07:42.756233 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:42.764340 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.737263 20314 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:42.724442 20342 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:42.735587 20608 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:07:42.765640 15610 leader_election.cc:400] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13.
I20260709 13:07:42.776439 15610 leader_election.cc:403] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:42.776166 15714 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:42.722307 20587 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.784076 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.784864 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.775772 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:42.644625 20509 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10.
I20260709 13:07:42.771552 15794 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.735718 20501 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.696695 20527 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.779281 15716 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:42.780488 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.780591 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.781410 15642 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 13. Ops: []
I20260709 13:07:42.800825 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.759550 20288 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.789888 15638 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:42.790874 15787 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:42.792018 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:42.796471 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.802227 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.812240 15645 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:42.782232 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.763950 20572 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.801661 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:42.804456 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:42.772888 20342 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:42.804694 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.823558 15647 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.804512 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.824326 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.813424 15641 raft_consensus.cc:2376] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13. Re-sending same reply.
I20260709 13:07:42.697719 20533 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.818025 15792 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.786281 20190 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.821957 15639 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:42.757618 20252 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.797726 20514 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.830040 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.827958 15642 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.836699 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.836822 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.855232 15645 raft_consensus.cc:2368] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:42.856105 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.752185 20253 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.802325 20587 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:42.838980 15688 leader_election.cc:336] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.883s (SENT)
I20260709 13:07:42.873435 20253 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:42.873883 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:42.839660 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.874666 15646 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:42.875620 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.876384 15646 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:42.877173 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.877997 15646 raft_consensus.cc:2376] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12. Re-sending same reply.
I20260709 13:07:42.857627 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.818799 20288 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.826352 20574 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13.
I20260709 13:07:42.880676 20548 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.881242 20548 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:42.881531 20224 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:42.854643 20523 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:42.862295 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:42.884011 15714 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.863518 20342 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.841885 20241 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.886448 15722 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:42.867381 20588 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.827908 20156 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:42.886855 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 47908.4us
W20260709 13:07:42.892009 15688 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.968s (SENT)
I20260709 13:07:42.892409 15688 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:42.794836 20461 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:42.881613 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.885691 15647 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:42.896304 15642 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:42.896538 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.804976 20527 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.903285 15714 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:42.856849 20514 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:42.911921 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.828884 20509 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:07:42.900484 20588 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.898977 20314 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:42.880714 20288 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.853088 20442 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:07:42.852901 20501 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:42.898011 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.902491 20523 consensus_queue.cc:1243] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:42.935388 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.939713 20587 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.940634 20619 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:42.940840 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.941186 20619 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:42.942253 20619 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.943956 20619 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.927829 20548 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:42.945603 20548 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.952683 20522 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.953198 20522 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:42.954165 20522 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.955096 20252 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:42.952685 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.957752 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.958740 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.958950 20527 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:42.959404 15643 raft_consensus.cc:2368] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12.
I20260709 13:07:42.960173 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.961634 20342 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.966015 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.966818 15643 raft_consensus.cc:2368] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:42.968734 20533 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:42.930783 20366 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.977106 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:42.955528 20522 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.980207 20323 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:42.982738 20617 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.985831 20523 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.986241 20523 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:42.986549 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:42.987067 20523 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:42.988193 20523 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.915467 20514 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.993937 15646 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 8: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:42.996407 15792 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:42.997550 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.003628 15647 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:43.012764 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:43.017592 15646 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:43.006667 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:43.042879 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.034046 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.050432 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.052803 15641 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:43.009416 20536 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:43.076893 16300 leader_election.cc:336] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.137s (SENT)
I20260709 13:07:43.087569 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:43.088274 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:43.090354 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.089309 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.091418 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.089851 15646 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:43.091081 15647 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:07:43.092535 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.089180 20489 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:07:43.095500 15647 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:43.096607 20366 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:43.045161 20606 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.102407 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.103477 15646 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:43.099677 15638 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.091324 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:43.098220 15647 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:43.055198 20616 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:43.107775 15716 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [5.6-11.8]
I20260709 13:07:43.107681 20616 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.110316 20606 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.113009 20606 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:43.114210 16300 leader_election.cc:336] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.912s (SENT)
I20260709 13:07:43.044574 20253 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:07:43.115272 16300 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.179s (SENT)
I20260709 13:07:43.115729 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:43.115862 20253 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:43.103374 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:43.117494 15793 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:43.105762 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:43.124409 15638 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:43.094596 20442 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.116390 20253 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:43.092109 20522 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.090641 20588 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:43.133246 20537 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:43.133875 20587 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.137573 15645 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:43.091930 20069 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.101750 20499 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:43.142282 20616 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:43.143252 16300 leader_election.cc:336] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.999s (SENT)
I20260709 13:07:43.096967 20540 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.190251 20540 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.191397 20499 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.192708 20540 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:43.151091 20536 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:43.194442 15796 raft_consensus.cc:2368] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:43.195464 20069 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:43.157883 15642 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.197805 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:43.198297 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.198906 15647 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:43.159993 20178 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:43.200412 15645 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:43.201100 20178 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:43.160691 15643 raft_consensus.cc:2368] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11.
I20260709 13:07:43.165218 20521 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:43.187827 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:43.122416 20509 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:43.202994 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.176988 20574 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:43.216552 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.189399 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:43.216992 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 73773.3us
I20260709 13:07:43.171654 20572 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:43.217410 15790 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:43.212095 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.169706 20522 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.223383 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:43.230136 16326 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:43.214424 20342 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:43.250886 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 61618.4us
I20260709 13:07:43.249369 16326 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:43.213622 20509 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:43.272351 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 241072us
I20260709 13:07:43.258705 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:43.291277 16325 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:43.214668 20537 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.283844 15759 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:43.275193 20397 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.239892 20178 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.228461 20521 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.246649 20572 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:43.219761 20499 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:43.288401 20156 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.258119 20342 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:43.277278 20509 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.308534 20514 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.202383 20587 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.294695 16334 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:43.335753 16334 pending_rounds.cc:85] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 8
I20260709 13:07:43.336045 16334 pending_rounds.cc:107] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:43.336344 16334 raft_consensus.cc:2889] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.276562 20069 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:07:43.330109 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46389.8us
I20260709 13:07:43.337393 20587 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:43.234582 20574 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.358341 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:43.359522 20522 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:43.361150 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:43.361939 15718 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:43.363574 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:43.364419 20522 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.364805 20522 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.365124 20522 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.365527 20521 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:43.294176 20397 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.366237 20397 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.275568 20536 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:43.372674 20342 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.319065 20572 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:43.379052 15643 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:07:43.383570 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 88784.9us
I20260709 13:07:43.382463 20156 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.381058 20436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.031s	sys 0.051s
W20260709 13:07:43.389397 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.358465 20606 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:43.219384 20253 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:43.397428 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 74051.7us
I20260709 13:07:43.399042 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:43.419911 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.377588 20572 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.387228 20574 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:43.430716 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.433837 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.437860 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.438446 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.469029 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:43.470713 15791 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:43.471231 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:43.466053 15793 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
W20260709 13:07:43.390987 20436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.031s	sys 0.052s
I20260709 13:07:43.460071 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:43.459998 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 75266.8us
I20260709 13:07:43.478222 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.486253 15788 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:43.486720 15789 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:43.479664 15794 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:43.481040 15796 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:07:43.488066 15796 pending_rounds.cc:85] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 6
I20260709 13:07:43.488384 15796 pending_rounds.cc:107] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:07:43.488684 15796 raft_consensus.cc:2889] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.387024 20314 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:43.397712 20606 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:43.426719 20517 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.389335 20156 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:43.514226 16331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.015s	sys 0.029s
W20260709 13:07:43.514997 16331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.015s	sys 0.029s
I20260709 13:07:43.484920 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:43.502465 15720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.023s	sys 0.017s
W20260709 13:07:43.515745 15720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.023s	sys 0.017s
W20260709 13:07:43.505504 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.012s	sys 0.028s
W20260709 13:07:43.516553 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.012s	sys 0.028s
I20260709 13:07:43.516423 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:43.518105 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:43.518935 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 604170us
W20260709 13:07:43.521512 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.523478 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:43.524935 15688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.011s	sys 0.033s
W20260709 13:07:43.526813 15688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.034s
I20260709 13:07:43.485616 20253 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.538225 15646 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.545398 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:43.550027 15788 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:07:43.491173 20241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.017s
I20260709 13:07:43.505256 20606 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.505028 20547 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.475880 20224 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:07:43.559805 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.381940 20522 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.534723 20551 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.524883 20572 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.523205 20618 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:43.556900 20241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.017s
W20260709 13:07:43.426965 20252 consensus_queue.cc:1175] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fec10611791a4ab384f86b212249410e" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 14 index: 8 } }
I20260709 13:07:43.527799 20517 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:43.586885 15646 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
W20260709 13:07:43.563498 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 671450us
I20260709 13:07:43.592633 15713 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:43.593292 15718 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:07:43.639252 15688 leader_election.cc:336] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.000s (SENT)
I20260709 13:07:43.593808 20522 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:43.595098 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:43.501014 15643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:43.640928 15717 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.641031 15643 raft_consensus.cc:606] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:43.641418 15643 raft_consensus.cc:614] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:43.535112 20619 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:07:43.648875 15639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.029s	sys 0.055s
W20260709 13:07:43.649412 15639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.029s	sys 0.055s
W20260709 13:07:43.649504 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 398571us
W20260709 13:07:43.633126 20501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.018s	sys 0.031s
I20260709 13:07:43.663393 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:43.683723 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.675809 20501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.019s	sys 0.031s
W20260709 13:07:43.702638 15638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.003s
W20260709 13:07:43.703033 15638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.010s	sys 0.003s
W20260709 13:07:43.668505 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.660660 15688 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.097s (SENT) [suppressed 47 similar messages]
I20260709 13:07:43.666807 16297 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:43.738296 20626 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:43.739030 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 72298.5us
W20260709 13:07:43.734567 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 191490us
I20260709 13:07:43.748332 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:43.696554 20630 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:43.753391 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.755743 15790 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:43.756604 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:43.758301 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:43.759792 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:43.759843 20618 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:43.761061 20551 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.761508 20551 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:43.762317 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:43.762959 16327 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:43.762532 20551 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.764307 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:43.765043 16300 leader_election.cc:336] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.183s (SENT)
I20260709 13:07:43.765033 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:43.761521 16325 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:43.770680 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:43.733619 20614 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:43.777633 20630 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:43.754880 20627 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 13:07:43.787091 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.745900 20626 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.791977 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:43.792654 15642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.012s
I20260709 13:07:43.773658 20547 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:43.794636 15642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.010s	sys 0.012s
I20260709 13:07:43.801110 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:43.810673 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:43.813654 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2006) took 1177 ms. Trace:
I20260709 13:07:43.794299 20626 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.808036 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:43.818065 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.814105 15719 rpcz_store.cc:276] 0709 13:07:42.636633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.698736 (+ 62103us) service_pool.cc:224] Handling call
0709 13:07:42.699075 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.760116 (+ 61041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.760149 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.761099 (+   950us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.173462 (+412363us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.285699 (+112237us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.286009 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.286107 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.813443 (+527336us) raft_consensus.cc:1685] finished
0709 13:07:43.813462 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.813595 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119005,"prepare.queue_time_us":134373,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":17405,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":46484,"spinlock_wait_cycles":1033600,"thread_start_us":359703,"threads_started":1,"wal-append.queue_time_us":600096}
I20260709 13:07:43.818529 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:43.831004 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.833478 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:43.834206 15790 raft_consensus.cc:606] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:43.802203 20156 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:43.805001 20521 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.791320 20614 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.815876 20575 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.818367 20547 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.832260 20314 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:43.828279 20366 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:43.860445 20629 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:07:43.890571 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:43.845824 20521 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:43.852860 20156 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.855594 20314 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.827967 20224 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:43.855775 20342 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.775272 20517 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:43.833060 20533 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:07:43.819312 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 315501us
I20260709 13:07:43.947002 15685 leader_election.cc:400] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:43.947495 15685 leader_election.cc:403] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:43.897130 20637 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:07:43.893803 20516 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.953418 20635 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:43.953328 20631 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:07:43.954442 20640 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:07:43.958837 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.959604 20644 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:43.962191 20632 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:43.963505 20639 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:07:43.964291 20633 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:07:43.964953 20638 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:07:43.952464 20641 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:43.892649 20461 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.904479 20521 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.862320 20547 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:43.905938 20314 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:43.978685 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 165896us
I20260709 13:07:43.890992 20442 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:07:43.899883 20575 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:07:43.992532 15717 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:44.023206 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:43.995172 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 224662us
I20260709 13:07:43.949164 20645 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.028455 20645 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.028892 20645 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.031774 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:43.986933 20629 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:07:44.034257 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.038805 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:44.039448 15645 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:43.990685 20397 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.003s
I20260709 13:07:44.042351 20397 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.043584 15796 raft_consensus.cc:2368] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13.
I20260709 13:07:44.008217 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.008366 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.046136 15790 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:44.051322 20547 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.052561 20547 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:44.053120 20514 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.053145 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2439) took 1252 ms. Trace:
I20260709 13:07:44.054055 20618 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:44.054296 15639 rpcz_store.cc:276] 0709 13:07:42.805142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.084556 (+279414us) service_pool.cc:224] Handling call
0709 13:07:43.092533 (+  7977us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.094651 (+  2118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.094683 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.118127 (+ 23444us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.652466 (+534339us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:43.676324 (+ 23858us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.676767 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.678652 (+  1885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.678724 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.963350 (+284626us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18003d1c20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f
0709 13:07:43.964931 (+  1581us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:44.052943 (+ 88012us) raft_consensus.cc:1685] finished
0709 13:07:44.052964 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.053093 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7561,"prepare.queue_time_us":49634,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":5003,"raft.run_cpu_time_us":4016,"raft.run_wall_time_us":299577,"spinlock_wait_cycles":57711488,"thread_start_us":517401,"threads_started":1,"wal-append.queue_time_us":709748}
I20260709 13:07:44.056746 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:44.057528 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 574) took 1180 ms. Trace:
I20260709 13:07:44.057914 15638 rpcz_store.cc:276] 0709 13:07:42.877549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.125369 (+247820us) service_pool.cc:224] Handling call
0709 13:07:43.130799 (+  5430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.171717 (+ 40918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.171748 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.172209 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.711367 (+539158us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:43.986382 (+275015us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.987094 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.987172 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.057359 (+ 70187us) raft_consensus.cc:1685] finished
0709 13:07:44.057377 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.057482 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58352,"raft.queue_time_us":39457,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3436,"spinlock_wait_cycles":8130304,"thread_start_us":757754,"threads_started":2,"wal-append.queue_time_us":690307}
I20260709 13:07:44.059303 20618 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.061235 15685 leader_election.cc:400] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13.
I20260709 13:07:44.061558 15685 leader_election.cc:403] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:44.062160 20514 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.066437 20642 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:44.013895 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:43.985072 20426 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.068197 15794 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:43.917200 20156 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.071177 20156 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.011919 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.072023 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2005) took 1454 ms. Trace:
I20260709 13:07:44.022838 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.072633 20575 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.072510 15720 rpcz_store.cc:276] 0709 13:07:42.617616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.645224 (+ 27608us) service_pool.cc:224] Handling call
0709 13:07:42.707558 (+ 62334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.753942 (+ 46384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.753972 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.950133 (+196161us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b18002690e0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a
0709 13:07:42.950558 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.516202 (+565644us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.516255 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.516350 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.071746 (+555396us) raft_consensus.cc:1685] finished
0709 13:07:44.071767 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.071966 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32237,"raft.queue_time_us":51094,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":8646,"spinlock_wait_cycles":12603136,"thread_start_us":565231,"threads_started":1,"wal-append.queue_time_us":781057}
W20260709 13:07:44.074200 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.074308 20551 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.000403 20624 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.078704 20630 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.080557 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1007) took 1350 ms. Trace:
I20260709 13:07:44.081975 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.024678 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:43.988257 20548 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.010262 20461 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.068958 15645 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
W20260709 13:07:44.071973 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60183.6us
I20260709 13:07:43.979080 20516 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.024012 15793 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:44.097121 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:44.097874 16326 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:44.087097 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 62476.5us
I20260709 13:07:44.098865 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:44.087070 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2413) took 1307 ms. Trace:
W20260709 13:07:44.013691 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 205707us
W20260709 13:07:44.020195 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.097023 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.102644 15796 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:44.099633 15640 rpcz_store.cc:276] 0709 13:07:42.779395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.779532 (+   137us) service_pool.cc:224] Handling call
0709 13:07:42.779816 (+   284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.261439 (+481623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.261490 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.279388 (+ 17898us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.785044 (+505656us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:43.981595 (+196551us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.004115 (+ 22520us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.004421 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.004523 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.086836 (+ 82313us) raft_consensus.cc:1685] finished
0709 13:07:44.086859 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.087002 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26806,"raft.queue_time_us":125136,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":17539,"thread_start_us":1055489,"threads_started":3,"wal-append.queue_time_us":593464}
I20260709 13:07:44.081028 16331 rpcz_store.cc:276] 0709 13:07:42.730067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.733821 (+  3754us) service_pool.cc:224] Handling call
0709 13:07:42.734177 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.886546 (+152369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.886598 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.973728 (+ 87130us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b2c00047568. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:42.974166 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.515609 (+541443us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.515698 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.036869 (+521171us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002440d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:44.036930 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.080337 (+ 43407us) raft_consensus.cc:1685] finished
0709 13:07:44.080357 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.080480 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1073,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4737,"spinlock_wait_cycles":353856000,"thread_start_us":540918,"threads_started":1,"wal-append.queue_time_us":804355}
W20260709 13:07:44.092006 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 431340us
I20260709 13:07:44.112581 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:44.115702 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.116117 15645 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:44.117532 15645 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:44.118242 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:44.120446 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:44.123407 20397 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:44.123587 20643 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:07:44.124892 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2441) took 1318 ms. Trace:
I20260709 13:07:44.091689 20624 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:44.128257 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1052140959999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:07:44.130744 15796 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:44.093716 20575 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:44.125229 15644 rpcz_store.cc:276] 0709 13:07:42.806017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.089990 (+283973us) service_pool.cc:224] Handling call
0709 13:07:43.117064 (+ 27074us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.160232 (+ 43168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.160270 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.174124 (+ 13854us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.703655 (+529531us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:43.983227 (+279572us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.983644 (+   417us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.983885 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.983988 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.071316 (+ 87328us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b180043aaa0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:44.124696 (+ 53380us) raft_consensus.cc:1685] finished
0709 13:07:44.124717 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.124840 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90859,"prepare.queue_time_us":422242,"raft.queue_time_us":28652,"raft.run_cpu_time_us":3246,"raft.run_wall_time_us":24904,"spinlock_wait_cycles":25272448,"thread_start_us":677476,"threads_started":2,"wal-append.queue_time_us":709072}
I20260709 13:07:44.148195 16326 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:44.168056 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.168265 15793 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:07:44.175158 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43790.4us
I20260709 13:07:44.175182 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.111018 20522 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.115832 20514 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13.
I20260709 13:07:44.127017 20630 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.125990 20156 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.191322 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:44.145117 20547 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.142818 20503 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.163061 20426 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.239477 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:44.209465 20499 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.253052 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:44.255280 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 196498us
I20260709 13:07:44.174894 20648 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:07:44.181079 20632 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:07:44.210300 20503 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.170509 20575 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.285177 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:44.294162 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.327514 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:44.207587 20156 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.238162 20426 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.283322 20499 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:44.334437 20499 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.261837 20618 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:44.282992 20503 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.324822 20616 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.340157 20606 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.001s
I20260709 13:07:44.341121 20632 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.321523 20668 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:44.348805 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.352068 20616 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:44.354517 20634 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.546s	user 0.000s	sys 0.003s
W20260709 13:07:44.355916 20650 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:07:44.356956 20489 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.357373 20489 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:44.368031 20489 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.368827 20521 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.369709 20489 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.358127 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2438) took 1557 ms. Trace:
I20260709 13:07:44.370772 15641 rpcz_store.cc:276] 0709 13:07:42.800798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.087137 (+286339us) service_pool.cc:224] Handling call
0709 13:07:43.095572 (+  8435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.096041 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.096076 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.253526 (+157450us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.739128 (+485602us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.984737 (+245609us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.993564 (+  8827us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.999283 (+  5719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.999458 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.069406 (+ 69948us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:44.357915 (+288509us) raft_consensus.cc:1685] finished
0709 13:07:44.357938 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.358068 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32238,"prepare.queue_time_us":609957,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":66,"raft.queue_time_us":42402,"raft.run_cpu_time_us":1065,"raft.run_wall_time_us":106550,"spinlock_wait_cycles":18139392,"thread_start_us":625702,"threads_started":2,"wal-append.queue_time_us":722997}
I20260709 13:07:44.372931 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:44.373314 20572 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
W20260709 13:07:44.358258 20659 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:07:44.374143 20645 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.325892 20614 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.384629 16331 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:44.364312 20509 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.018s	user 0.009s	sys 0.004s
I20260709 13:07:44.364429 20631 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:44.365473 20516 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:44.366117 20606 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.366895 20632 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.408306 20632 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:44.359074 20647 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:07:44.410086 20618 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.373495 15641 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:44.414565 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.415900 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.355772 20616 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.418038 16326 raft_consensus.cc:2368] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12.
I20260709 13:07:44.381839 20668 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.382366 20503 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.382736 20314 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.394065 20575 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:44.394953 20461 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:44.398224 20426 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.339354 20241 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:44.403824 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.408366 20606 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.331158 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:44.445083 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 114014us
I20260709 13:07:44.446540 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.419134 15641 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:44.439683 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 237425us
W20260709 13:07:44.439957 20253 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.886s	user 0.013s	sys 0.001s
I20260709 13:07:44.455955 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:44.416929 20509 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.460760 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:44.465471 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.463676 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.464005 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.449419 20631 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.470806 15641 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:44.442884 20616 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.485726 15644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76331ca323724c289906034e280e8274"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:44.487233 15644 raft_consensus.cc:606] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:44.487886 15644 raft_consensus.cc:614] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:44.504869 15647 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:44.469511 20680 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:44.509090 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:44.510635 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.484344 20614 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.515959 15688 leader_election.cc:400] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 pre-election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:44.517467 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:44.520771 20677 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:44.522806 20645 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.531955 20509 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.533018 20515 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.471397 20606 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:44.534514 20503 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.461480 20241 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.536844 20241 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.507346 20156 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.504376 20524 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:44.541234 20638 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.535s	user 0.004s	sys 0.000s
I20260709 13:07:44.541126 20524 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.514060 20631 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:44.542238 20631 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.542588 20631 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.543758 20524 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.508106 20514 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.551254 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.561216 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.484582 20616 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.561264 20524 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.563661 20679 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.582707 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 576) took 1662 ms. Trace:
W20260709 13:07:44.583415 15821 heartbeater.cc:646] Failed to heartbeat to 127.14.45.62:37417 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.45.62:37417 timed out after 15.000s (SENT)
I20260709 13:07:44.584242 20606 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.585530 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 399530us
I20260709 13:07:44.586367 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:44.586845 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.511669 20680 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.584805 20606 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.573971 20524 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.602694 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:44.603564 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.583125 15642 rpcz_store.cc:276] 0709 13:07:42.920400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.199673 (+279273us) service_pool.cc:224] Handling call
0709 13:07:43.199983 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.202159 (+  2176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.202192 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.217599 (+ 15407us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.798420 (+580821us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:44.183689 (+385269us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.582143 (+398454us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b1800389da0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:44.582320 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.582392 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.582442 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:44.582522 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.582652 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22206,"prepare.queue_time_us":399129,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":16277,"raft.queue_time_us":456,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":10531584,"thread_start_us":851929,"threads_started":2,"wal-append.queue_time_us":893678}
I20260709 13:07:44.566887 20503 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:44.611188 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 354829us
I20260709 13:07:44.622880 15721 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:44.562564 20514 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.572019 20521 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:44.626770 15721 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:44.625241 20156 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.732136 20503 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.611292 20679 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.625029 20178 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.770290 20673 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.623867 20524 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.730863 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:44.766793 20665 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:44.769271 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.943783 20665 consensus_queue.cc:1243] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:44.755781 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:44.946159 15719 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:44.946372 20698 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:44.947031 20698 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.947417 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:44.948163 15638 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.949496 20695 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:44.950143 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.951848 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:44.952661 15646 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
W20260709 13:07:44.720813 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118190us
I20260709 13:07:44.955477 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.798563 20509 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.620431 20547 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:07:44.958552 20509 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.798094 20624 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.959461 20624 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.960645 20509 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:44.961421 20624 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.799031 20618 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.729872 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:44.962109 20618 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.962936 20687 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.757447 20658 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 13:07:44.963943 20658 consensus_queue.cc:1243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:44.964104 20618 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:44.797612 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.886284 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43547.8us
W20260709 13:07:44.850248 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 116792us
I20260709 13:07:44.968051 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:44.968824 15644 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:44.802990 20574 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:44.970005 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.970055 20574 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.970738 15794 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:44.819406 20668 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:44.932533 15720 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:44.957525 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:44.979219 15717 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.934399 20675 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.935828 20680 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.938861 20606 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:44.970793 15795 pending_rounds.cc:85] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 6
I20260709 13:07:44.986794 15795 pending_rounds.cc:107] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:44.972849 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:44.901962 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.987126 15795 raft_consensus.cc:2889] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.826601 20572 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:44.969596 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:44.988895 15644 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.975060 15610 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:44.975194 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:44.976104 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.980202 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:44.991477 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:44.993834 15793 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:44.971119 20624 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:44.997076 15688 leader_election.cc:400] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 9 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 9. Current term is 10.
I20260709 13:07:44.998157 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:44.999692 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:45.001618 15638 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:44.963151 20616 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.003449 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:07:44.987098 20679 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.995636 20626 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.153s	user 0.010s	sys 0.004s
I20260709 13:07:45.005831 15646 raft_consensus.cc:606] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:44.901782 20156 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.015133 15717 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:45.200644 15644 raft_consensus.cc:2410] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:45.159710 20547 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.073822 20626 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.131434 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.062695 20679 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.011593 20616 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.130664 20178 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.228096 20178 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.998245 20572 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.178712 20514 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.103166 20574 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.003485 20314 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.008013 20631 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.233785 20631 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.101269 20665 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:45.234725 20665 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.237634 20501 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:45.237703 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.238324 20501 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:45.240708 20665 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.241950 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 886) took 1064 ms. Trace:
I20260709 13:07:45.244382 20572 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.246116 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.246228 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.247037 15791 raft_consensus.cc:2393] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:45.247974 20178 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.248230 15791 pending_rounds.cc:85] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 5
I20260709 13:07:45.248595 15791 pending_rounds.cc:107] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:45.248838 15791 raft_consensus.cc:2889] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.178687 20698 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.250571 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1013) took 2029 ms. Trace:
I20260709 13:07:44.988202 20675 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:44.981709 20618 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:45.062834 20461 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:45.005775 20509 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:45.179447 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.007074 20253 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:45.069454 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 69800.2us
I20260709 13:07:45.064749 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.219617 15646 raft_consensus.cc:614] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:45.266669 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:45.246259 20697 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:07:44.973109 20673 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:44.998581 20680 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:45.247058 15716 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:45.251122 16329 rpcz_store.cc:276] 0709 13:07:43.221680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.221873 (+   193us) service_pool.cc:224] Handling call
0709 13:07:43.222299 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.792002 (+569703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.792032 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.800649 (+  8617us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.101535 (+300886us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:44.101575 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.250107 (+1148532us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54005f2b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:45.250159 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.250207 (+    48us) raft_consensus.cc:1685] finished
0709 13:07:45.250225 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.250506 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33671,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":238899072,"thread_start_us":729808,"threads_started":2,"wal-append.queue_time_us":422475}
I20260709 13:07:45.242405 16326 rpcz_store.cc:276] 0709 13:07:44.177354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.239252 (+ 61898us) service_pool.cc:224] Handling call
0709 13:07:45.241683 (+1002431us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400730d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:45.241856 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408753920}
I20260709 13:07:45.009784 20524 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.267530 15794 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:45.071666 20658 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:45.270505 20679 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.272423 15688 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:45.258361 20461 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.265452 20509 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.287885 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:45.281962 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 301833us
I20260709 13:07:45.252813 20547 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.300170 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.254195 20501 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.267532 20253 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.311169 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:45.281703 20658 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:45.290140 20461 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.290063 20509 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.291471 20657 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.292245 20686 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:45.301105 20680 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.297529 20588 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.321470 15688 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:45.319509 20501 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.296924 20178 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:45.317481 20679 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.332273 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:45.328157 20686 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.349527 20686 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.330897 20515 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.323863 20631 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:07:45.325131 20657 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.331650 20178 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.355090 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:45.359012 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67778.8us
I20260709 13:07:45.342936 20707 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:45.370643 15792 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.374944 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:45.343195 20626 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.328482 20588 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.403680 20522 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.412034 20522 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.413707 20588 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.413894 20224 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:45.403178 20687 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:45.384485 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.416349 15794 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:45.363015 20540 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.462646 20540 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:45.463152 20540 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.370329 20178 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.466055 15721 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:45.468220 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.469096 15721 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:45.432636 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.470160 15714 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:45.434551 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.438177 20707 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.471000 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.472074 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.472616 15714 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:45.472705 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:45.439077 20224 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:45.414784 20156 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.345244 20658 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.474090 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:45.474040 20224 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.474740 20436 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.475294 20673 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.475598 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:45.475994 20673 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.477155 20547 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:45.477635 20663 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.457525 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.430205 20679 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:45.482645 20679 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:45.482833 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:45.462076 15713 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:45.485469 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:45.486040 15713 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.487304 20657 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:45.488530 20253 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:45.451267 20708 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:45.489842 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:45.490463 15646 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:45.491312 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:45.491382 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.491851 15646 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.492607 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.473644 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:45.474705 20658 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.475243 20436 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.493707 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:45.520884 15789 raft_consensus.cc:606] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:45.521232 15789 raft_consensus.cc:614] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:45.493920 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:45.494216 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:45.523200 15638 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.500188 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.524606 16326 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:45.502089 15722 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:45.498229 16332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 893) took 1169 ms. Trace:
I20260709 13:07:45.528400 15646 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:45.506688 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 888) took 1290 ms. Trace:
I20260709 13:07:45.519506 15719 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:45.502035 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.520229 16325 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:45.532786 15721 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:45.506258 15611 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:45.534466 15721 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:45.534605 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:45.534854 15721 pending_rounds.cc:85] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 7
I20260709 13:07:45.535210 15721 pending_rounds.cc:107] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:45.535502 15721 raft_consensus.cc:2889] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.528136 16332 rpcz_store.cc:276] 0709 13:07:44.328484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.340607 (+ 12123us) service_pool.cc:224] Handling call
0709 13:07:44.340964 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.442445 (+101481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.442474 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.442519 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:44.442560 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.497917 (+1055357us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54006cfcd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:45.497962 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.498070 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232905472}
I20260709 13:07:45.537096 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.539026 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:45.530164 16327 rpcz_store.cc:276] 0709 13:07:44.216883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.217915 (+  1032us) service_pool.cc:224] Handling call
0709 13:07:44.218301 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.328312 (+110011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.328348 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.328392 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:44.328430 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.506444 (+1178014us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54007805d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:45.506506 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.506635 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252540672}
I20260709 13:07:45.540285 15713 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:45.538801 15611 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:45.541695 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:45.542258 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.542692 15714 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:45.508985 15717 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:45.543992 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.547159 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.548974 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:45.488541 20676 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.126s	user 0.000s	sys 0.003s
I20260709 13:07:45.546602 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.570459 15715 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:07:45.503659 20688 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.538s	user 0.001s	sys 0.000s
W20260709 13:07:45.496560 20696 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.560s	user 0.000s	sys 0.001s
I20260709 13:07:45.554884 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:45.572248 15721 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:45.576213 15638 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:45.577453 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:45.556108 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.578421 15713 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:45.504318 20631 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.587797 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.588702 16334 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:45.472519 20707 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.579650 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:45.510856 20663 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:45.591641 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.592826 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.504416 20687 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.541471 20673 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:45.516945 20436 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.596534 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:45.598344 15790 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:45.517213 20626 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.594282 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:45.546296 20571 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.599524 15721 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:45.634467 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:45.604355 15719 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:45.618422 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:45.637588 15644 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:45.620842 15789 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:45.639675 15717 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:45.626974 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:45.643496 15715 raft_consensus.cc:2410] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:45.654107 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:45.655603 15721 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:45.618209 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:45.491878 20178 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:45.591066 20536 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:45.595216 20679 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.692924 15714 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:07:45.661691 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 291483us
I20260709 13:07:45.707232 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.618944 20698 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.810007 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2490) took 1633 ms. Trace:
I20260709 13:07:45.626364 20687 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.631186 20571 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.619055 20522 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.768250 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.602059 20699 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.601186 20366 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.619019 20524 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:45.621016 20588 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:45.733572 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:45.646818 20673 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:45.602944 20631 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.646569 20626 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.042461 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:45.983124 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2228) took 1966 ms. Trace:
I20260709 13:07:46.049468 20707 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:46.053015 20707 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.053577 20707 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.813144 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:45.967291 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.053684 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 413970us
I20260709 13:07:46.060263 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 587) took 1896 ms. Trace:
I20260709 13:07:46.060708 15645 rpcz_store.cc:276] 0709 13:07:44.163893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.169177 (+  5284us) service_pool.cc:224] Handling call
0709 13:07:44.169604 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.184026 (+ 14422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.184056 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.238666 (+ 54610us) log.cc:844] Serialized 52 byte log entry
0709 13:07:44.568491 (+329825us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.568557 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.568652 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.503106 (+934454us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:46.013758 (+510652us) raft_consensus.cc:1685] finished
0709 13:07:46.013803 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.060191 (+ 46388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383931,"raft.queue_time_us":26816,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7896,"spinlock_wait_cycles":32734464,"thread_start_us":240037,"threads_started":1,"wal-append.queue_time_us":518858}
I20260709 13:07:45.810609 15796 rpcz_store.cc:276] 0709 13:07:44.104050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.104250 (+   200us) service_pool.cc:224] Handling call
0709 13:07:44.104580 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.139883 (+ 35303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.736321 (+1596438us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b54003a34d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:45.736619 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58518272}
I20260709 13:07:45.655256 20503 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.116796 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:46.052554 15643 rpcz_store.cc:276] 0709 13:07:44.016965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.073068 (+ 56103us) service_pool.cc:224] Handling call
0709 13:07:44.073397 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.073726 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.073775 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.074259 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.232602 (+158343us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:44.232641 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.232706 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.488000 (+1255294us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:45.952804 (+464804us) raft_consensus.cc:1685] finished
0709 13:07:45.952833 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.982871 (+ 30038us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1203,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":33841536,"thread_start_us":157980,"threads_started":1,"wal-append.queue_time_us":287468}
I20260709 13:07:46.122848 16333 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:46.123235 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:46.123538 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:46.132174 15790 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:46.128842 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:46.130164 20522 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:46.123966 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 463224us
I20260709 13:07:46.118628 15789 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:46.045982 20699 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.994239 20710 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:07:46.137490 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:46.146450 15638 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:46.141551 15685 leader_election.cc:400] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12.
I20260709 13:07:46.148815 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:46.043550 20533 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:46.150552 20680 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.662156 20547 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.471s
W20260709 13:07:46.117681 20630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.878s	user 0.004s	sys 0.015s
I20260709 13:07:46.139537 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:46.156484 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:45.739177 20572 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:45.951901 20426 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.147492 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:46.162563 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:46.183980 16328 raft_consensus.cc:2368] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:45.847026 20663 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.117334 20571 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.165534 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:46.190439 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:46.190289 15790 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:46.191102 16331 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:46.118340 20503 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.135366 20617 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.775254 20536 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:46.181181 15639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.010s	sys 0.022s
W20260709 13:07:46.201802 15639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.010s	sys 0.023s
I20260709 13:07:46.049340 20673 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.144657 20699 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.050942 20366 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:45.827797 20679 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:46.176502 20630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.947s	user 0.004s	sys 0.015s
I20260709 13:07:46.195201 15719 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:46.161710 20680 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.061982 20588 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.166239 20533 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:46.170138 20224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.002s	sys 0.019s
I20260709 13:07:46.204424 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:46.269131 16331 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.191838 20514 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.227188 20366 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.227262 20536 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:46.198444 20540 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260709 13:07:46.279484 20540 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.280874 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:46.230491 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:46.232537 20547 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.234753 20687 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.194487 20426 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.239735 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:46.157593 20522 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.188584 20572 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.162770 20524 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:46.289067 20366 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:46.197479 20503 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.266173 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.301019 15719 raft_consensus.cc:2376] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13. Re-sending same reply.
W20260709 13:07:46.203390 20461 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.876s	user 0.003s	sys 0.006s
I20260709 13:07:46.287186 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.302613 15714 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
W20260709 13:07:46.270102 20224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.002s	sys 0.019s
I20260709 13:07:46.265202 20680 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.251579 20720 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.197997 20663 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.266655 20178 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:46.253449 20630 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:46.316902 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.317243 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.318120 15714 raft_consensus.cc:2393] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:46.297147 20426 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.297672 20572 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:46.203184 20509 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.000s
I20260709 13:07:46.290962 20551 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.298218 20687 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:46.309563 20540 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.282290 20514 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.290474 20547 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.306262 20461 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:46.304324 20486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.010s	sys 0.041s
I20260709 13:07:46.351791 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:46.303510 20366 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.342001 20509 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:46.389869 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 198065us
W20260709 13:07:46.389582 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 147339us
I20260709 13:07:46.401678 15719 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:46.338490 20687 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:46.348261 20178 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:46.440191 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:46.401463 20636 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 2.590s	user 0.014s	sys 0.007s
W20260709 13:07:46.405366 20486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.010s	sys 0.041s
I20260709 13:07:46.443957 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:46.457119 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.407685 20631 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.405961 20726 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:46.409636 20626 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.346161 20551 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.475809 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:46.493685 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.497104 15638 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:46.493096 20536 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:46.471911 20540 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:46.481082 20658 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.971s	user 0.011s	sys 0.000s
W20260709 13:07:46.514542 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 86790.2us
I20260709 13:07:46.451213 20178 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.515033 20536 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:46.509140 20722 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:46.502064 20631 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.524111 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2252) took 1018 ms. Trace:
I20260709 13:07:46.538774 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2726) took 1278 ms. Trace:
I20260709 13:07:46.458709 20630 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.467125 20725 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:46.482050 20726 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.505589 20720 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:46.621541 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2242) took 1656 ms. Trace:
I20260709 13:07:46.647599 15641 rpcz_store.cc:276] 0709 13:07:44.964910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.965105 (+   195us) service_pool.cc:224] Handling call
0709 13:07:44.965390 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.965711 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.965760 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.461403 (+495643us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c000014c8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:45.477116 (+ 15713us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.086072 (+608956us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:46.086129 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.086230 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.621234 (+535004us) raft_consensus.cc:1685] finished
0709 13:07:46.621255 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.621481 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13559,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5525,"spinlock_wait_cycles":27818368,"thread_start_us":487957,"threads_started":1,"wal-append.queue_time_us":724486}
I20260709 13:07:46.621832 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.626183 20725 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.546002 20631 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:46.516279 20588 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.540560 15638 rpcz_store.cc:276] 0709 13:07:45.505803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.498042 (+992239us) service_pool.cc:224] Handling call
0709 13:07:46.498297 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.498476 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:46.498704 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.523542 (+ 24838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.523610 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:46.523760 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.523845 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.524037 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1485,"prepare.queue_time_us":125,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":148608,"thread_start_us":22912,"threads_started":1}
I20260709 13:07:46.639945 20536 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:46.628562 15796 rpcz_store.cc:276] 0709 13:07:45.260590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.175261 (+914671us) service_pool.cc:224] Handling call
0709 13:07:46.175663 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.175933 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:46.344633 (+168700us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.538432 (+193799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.538485 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.538536 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.538600 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.538718 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168824,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":307,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9135,"thread_start_us":333671,"threads_started":2}
W20260709 13:07:46.632300 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 55318.2us
I20260709 13:07:46.715652 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:46.659626 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2247) took 1155 ms. Trace:
I20260709 13:07:46.716615 15644 rpcz_store.cc:276] 0709 13:07:45.504488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.128414 (+623926us) service_pool.cc:224] Handling call
0709 13:07:46.132938 (+  4524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.299061 (+166123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.299106 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.299162 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.299217 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.659284 (+360067us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400345654. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:46.659355 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.659546 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381475712}
I20260709 13:07:46.511931 20540 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.726241 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2702) took 3211 ms. Trace:
I20260709 13:07:46.726418 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2012) took 1213 ms. Trace:
I20260709 13:07:46.638056 20734 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.505699 20687 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.727312 15792 rpcz_store.cc:276] 0709 13:07:43.436753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.436934 (+   181us) service_pool.cc:224] Handling call
0709 13:07:43.465393 (+ 28459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.433694 (+1968301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.647682 (+1213988us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:46.647892 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4381051648}
I20260709 13:07:46.730733 15796 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:46.736716 16331 raft_consensus.cc:2410] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:07:46.747009 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 226941us
W20260709 13:07:46.622359 20724 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:07:46.727473 15718 rpcz_store.cc:276] 0709 13:07:45.433153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.434297 (+  1144us) service_pool.cc:224] Handling call
0709 13:07:46.646692 (+1212395us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540017a7d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:46.646871 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862702848}
I20260709 13:07:46.537896 20658 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:46.620539 20723 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:07:46.756667 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:46.555660 20533 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:46.769469 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:46.665714 20522 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:46.763547 15789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.007s
I20260709 13:07:46.756839 15644 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:46.729429 20663 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.726900 20631 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.737272 20540 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.790697 20514 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:46.793913 20704 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.481s	user 0.003s	sys 0.026s
I20260709 13:07:46.795624 20551 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:46.797554 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.783504 15644 pending_rounds.cc:85] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:46.801023 15644 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:07:46.801110 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:46.801380 15644 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.783207 20732 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.834321 20732 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:46.834882 20732 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:46.835651 15794 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2728) took 1567 ms (client timeout 1666 ms). Trace:
W20260709 13:07:46.836100 15794 rpcz_store.cc:269] 0709 13:07:45.268320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.286033 (+ 17713us) service_pool.cc:224] Handling call
0709 13:07:46.835456 (+1549423us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540047b8d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:46.835568 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265637248}
W20260709 13:07:46.838488 20721 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.441s	user 0.004s	sys 0.004s
I20260709 13:07:46.798223 20547 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.807749 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.811244 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.813171 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2010) took 1380 ms. Trace:
I20260709 13:07:46.809993 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:46.823288 20509 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.824753 20698 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.826050 20679 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:46.882758 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:46.829238 20707 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.000s
I20260709 13:07:46.799135 20687 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:46.832636 20701 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.608s	user 0.006s	sys 0.018s
I20260709 13:07:46.758714 20734 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.799050 20461 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:46.833822 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3072) took 1770 ms. Trace:
I20260709 13:07:46.892957 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.820505 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2256) took 1312 ms. Trace:
I20260709 13:07:46.893287 15720 rpcz_store.cc:276] 0709 13:07:45.063350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.067823 (+  4473us) service_pool.cc:224] Handling call
0709 13:07:45.112497 (+ 44674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.290501 (+178004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.290528 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.290569 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.290598 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.833507 (+1542909us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003bc254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:46.833555 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.833732 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408908672}
W20260709 13:07:46.783710 15789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.018s	sys 0.007s
W20260709 13:07:46.865358 20699 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.002s
I20260709 13:07:46.842020 15722 rpcz_store.cc:276] 0709 13:07:45.432662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.432777 (+   115us) service_pool.cc:224] Handling call
0709 13:07:45.433045 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.525781 (+ 92736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.812892 (+1287111us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540017acd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:46.813099 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157971840}
I20260709 13:07:46.900822 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:46.901364 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:46.903405 15720 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:07:46.877334 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.907985 15718 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:46.871965 20736 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:46.909108 20736 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.911268 20736 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:46.912743 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 585) took 2765 ms. Trace:
I20260709 13:07:46.913125 15640 rpcz_store.cc:276] 0709 13:07:44.148165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.403138 (+254973us) service_pool.cc:224] Handling call
0709 13:07:44.403460 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.769690 (+366230us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:44.769719 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.770284 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.004192 (+233908us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:45.004235 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.004298 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.831915 (+1827617us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:46.912484 (+ 80569us) raft_consensus.cc:1685] finished
0709 13:07:46.912504 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.912668 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378169,"raft.queue_time_us":367065,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":21133,"spinlock_wait_cycles":62294784,"thread_start_us":233290,"threads_started":1,"wal-append.queue_time_us":382709}
I20260709 13:07:46.915424 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:46.916155 15640 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
W20260709 13:07:46.922487 20571 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
I20260709 13:07:46.923127 20571 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.870011 20663 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.925952 20663 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.778898 20658 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.894212 15644 rpcz_store.cc:276] 0709 13:07:45.506829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.739930 (+1233101us) service_pool.cc:224] Handling call
0709 13:07:46.752138 (+ 12208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.802548 (+ 50410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.819062 (+ 16514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.892971 20509 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.932742 20509 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.804486 20522 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.934235 20522 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.803690 20514 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:46.936967 20514 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:46.937970 20671 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 2.575s	user 0.007s	sys 0.015s
I20260709 13:07:46.939612 20514 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:46.936395 20436 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.278s	user 0.011s	sys 0.003s
I20260709 13:07:46.940281 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2709) took 3501 ms. Trace:
I20260709 13:07:46.940506 20436 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.940824 15787 rpcz_store.cc:276] 0709 13:07:43.438916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.477760 (+ 38844us) service_pool.cc:224] Handling call
0709 13:07:43.478159 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.478602 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.478639 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.479239 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.966017 (+486778us) spinlock_profiling.cc:243] Waited 875 us on lock 0x7b18000e0740. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:44.198091 (+232074us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:44.478072 (+279981us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.492278 (+ 14206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.492354 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.771296 (+2278942us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:46.940001 (+168705us) raft_consensus.cc:1685] finished
0709 13:07:46.940031 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.940205 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":367658,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":67548,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":13671,"spinlock_wait_cycles":29739776,"thread_start_us":471785,"threads_started":2,"wal-append.queue_time_us":861780}
I20260709 13:07:46.943019 15638 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:46.945299 20734 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.946707 20178 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:46.883782 20547 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:46.891618 20707 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:46.950201 20547 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.952680 20707 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:46.953033 20547 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:46.884065 20698 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:46.899320 20680 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260709 13:07:46.954396 20680 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:46.957067 20680 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:46.962837 20726 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:46.967382 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2718) took 1997 ms. Trace:
I20260709 13:07:46.968761 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.967769 15795 rpcz_store.cc:276] 0709 13:07:44.970149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.970271 (+   122us) service_pool.cc:224] Handling call
0709 13:07:44.970593 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:45.004275 (+ 33682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.004303 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.004874 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 13:07:45.327462 (+322588us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.333115 (+  5653us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.350899 (+ 17784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.350970 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.965181 (+1614211us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b1800472f00. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:46.967103 (+  1922us) raft_consensus.cc:1685] finished
0709 13:07:46.967197 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.967328 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21929,"prepare.queue_time_us":7484,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":31866,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":67741,"spinlock_wait_cycles":16567552,"thread_start_us":208604,"threads_started":1,"wal-append.queue_time_us":283458}
I20260709 13:07:46.970085 15715 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:07:46.970432 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2257) took 1463 ms. Trace:
I20260709 13:07:46.971019 15640 rpcz_store.cc:276] 0709 13:07:45.507525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.917129 (+1409604us) service_pool.cc:224] Handling call
0709 13:07:46.917475 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.917682 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.917721 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.970073 (+ 52352us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:46.970131 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.970215 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.970350 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.971800 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.980955 15644 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:46.983994 15722 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:46.990682 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2224) took 2974 ms. Trace:
I20260709 13:07:47.013031 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:46.986171 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.006846 20736 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:47.083627 20725 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.169281 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.171689 15721 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
W20260709 13:07:47.172345 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 498072us
I20260709 13:07:47.088994 15647 rpcz_store.cc:276] 0709 13:07:44.015923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.059127 (+ 43204us) service_pool.cc:224] Handling call
0709 13:07:44.059396 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.508649 (+449253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.990359 (+2481710us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54002684d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:46.990604 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024063360}
I20260709 13:07:47.044812 20687 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.125236 20680 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.178308 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:46.978763 20699 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.181155 15647 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:47.171962 20547 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:47.002672 20732 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.192641 20749 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:47.196758 20749 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.186264 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.186887 20514 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.198208 20514 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.198943 20749 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:47.187188 16334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1020) took 1593 ms. Trace:
I20260709 13:07:47.189905 20750 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.006680 20540 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.185307 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.178960 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2253) took 1672 ms. Trace:
I20260709 13:07:47.199680 16334 rpcz_store.cc:276] 0709 13:07:45.594168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.594739 (+   571us) service_pool.cc:224] Handling call
0709 13:07:45.624764 (+ 30025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.126905 (+502141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.126935 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.126978 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.127015 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.186969 (+1059954us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54002b8ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.187017 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.187138 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154308992}
I20260709 13:07:47.183476 20734 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.204790 15641 rpcz_store.cc:276] 0709 13:07:45.506081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.726121 (+1220040us) service_pool.cc:224] Handling call
0709 13:07:46.726521 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.726719 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:46.769106 (+ 42387us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.178619 (+409513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.178669 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:47.178716 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.178783 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.178897 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44922,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":1345,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3366,"thread_start_us":408755,"threads_started":1,"wal-append.queue_time_us":427380}
I20260709 13:07:47.174882 20736 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.227641 15721 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:47.183002 20687 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.184536 20680 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.236231 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.237277 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:47.238291 20747 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:07:47.242023 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1030) took 1002 ms. Trace:
I20260709 13:07:47.246765 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.250476 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.254878 15646 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:47.195761 20547 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.255716 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.252677 16330 rpcz_store.cc:276] 0709 13:07:46.239935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.240046 (+   111us) service_pool.cc:224] Handling call
0709 13:07:46.240325 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.288058 (+ 47733us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:46.383115 (+ 95057us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.666675 (+283560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.666754 (+    79us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.666826 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.241722 (+574896us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54002dee54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.241803 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.241960 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55859,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":143208,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8496,"spinlock_wait_cycles":110461568,"thread_start_us":369223,"threads_started":3,"wal-append.queue_time_us":204896}
I20260709 13:07:47.256577 15646 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:47.257462 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.258605 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.259430 15646 raft_consensus.cc:2368] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12.
I20260709 13:07:47.260308 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.260862 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.262607 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:47.264613 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.264988 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:47.265134 15646 raft_consensus.cc:2376] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13. Re-sending same reply.
I20260709 13:07:47.266080 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:47.226195 20734 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.266110 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.268715 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.269577 15641 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.271888 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.273202 15647 raft_consensus.cc:2410] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:47.209473 20750 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.255090 20366 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.277150 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.273725 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.273202 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:47.280756 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.281607 16329 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:47.274343 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.290218 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.292008 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:47.292337 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:47.246814 20631 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.295229 16329 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:47.297067 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.300072 16325 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:47.300117 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.298218 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.283291 15644 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:47.266999 20726 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.302475 15646 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:07:47.293546 20503 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.976s	user 0.011s	sys 0.003s
I20260709 13:07:47.306180 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.267220 20673 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:47.306587 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.304469 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.294462 20524 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:47.300015 20679 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.322952 15644 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:47.288944 20540 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.273254 20755 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:47.276352 20426 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.317014 15714 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:47.305171 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.309044 15646 pending_rounds.cc:85] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 3
I20260709 13:07:47.463769 15646 pending_rounds.cc:107] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:47.463796 16334 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:47.464108 15646 raft_consensus.cc:2889] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.464908 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.294711 20746 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:47.310945 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.301136 20514 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.321919 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.320503 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.303617 20630 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.309487 20720 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:47.332536 15641 raft_consensus.cc:2410] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:47.333096 20755 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.334213 20750 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.335260 20736 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.336978 20698 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.538658 20750 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.342439 20732 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:47.539301 20750 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.540091 20732 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:47.540625 20732 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:47.346629 20687 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.350441 20680 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.318050 20503 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.543809 20503 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.363453 20719 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:47.544574 20719 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.366561 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.546063 15644 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:47.547045 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.547623 15644 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.438737 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2246) took 1934 ms. Trace:
I20260709 13:07:47.548084 15645 rpcz_store.cc:276] 0709 13:07:45.504203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.127821 (+623618us) service_pool.cc:224] Handling call
0709 13:07:46.128102 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.339701 (+211599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.339745 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.339803 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.339855 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.377360 (+1037505us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000a9e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.438516 (+ 61156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.438671 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486013824}
I20260709 13:07:47.374933 20631 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.328706 20524 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.438799 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1029) took 1199 ms. Trace:
W20260709 13:07:47.316385 20619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.807s	user 0.006s	sys 0.038s
I20260709 13:07:47.465673 15796 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:47.466480 15794 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:07:47.466331 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.467211 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.438966 20699 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:47.582168 20619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.069s	user 0.006s	sys 0.043s
I20260709 13:07:47.445922 20540 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.490356 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.582502 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:47.376384 20679 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.583464 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2254) took 2077 ms. Trace:
I20260709 13:07:47.575085 16333 rpcz_store.cc:276] 0709 13:07:46.239664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.240274 (+   610us) service_pool.cc:224] Handling call
0709 13:07:46.240581 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.240808 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:46.390974 (+150166us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.374827 (+983853us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18004a5c60. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287
0709 13:07:47.438402 (+ 63575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.438466 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:47.438531 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.438604 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.438741 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12433,"prepare.queue_time_us":102566,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":110470,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":10676,"spinlock_wait_cycles":27140480,"thread_start_us":411414,"threads_started":3,"wal-append.queue_time_us":127219}
I20260709 13:07:47.583840 15638 rpcz_store.cc:276] 0709 13:07:45.506329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.737821 (+1231492us) service_pool.cc:224] Handling call
0709 13:07:46.738229 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.943542 (+205313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.583223 (+639681us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540028a854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.583412 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470381440}
I20260709 13:07:47.503952 20755 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.584949 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.586413 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2505) took 1953 ms. Trace:
I20260709 13:07:47.586796 15789 rpcz_store.cc:276] 0709 13:07:45.632588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.198840 (+566252us) service_pool.cc:224] Handling call
0709 13:07:46.199180 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.250233 (+ 51053us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:46.900232 (+649999us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.207210 (+306978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.207286 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.207358 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.586188 (+378830us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54001f77d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.586236 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.586361 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94756,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":5575,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13510,"spinlock_wait_cycles":391279744,"thread_start_us":944750,"threads_started":2,"wal-append.queue_time_us":405750}
I20260709 13:07:47.588441 20719 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.504441 20630 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.590445 20630 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.502060 20720 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:47.591354 20720 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.592216 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56118 (request call id 100) took 2630 ms. Trace:
I20260709 13:07:47.592576 15788 rpcz_store.cc:276] 0709 13:07:44.962005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.962219 (+   214us) service_pool.cc:224] Handling call
0709 13:07:47.591967 (+2629748us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54001f90d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540c735 00007fad254049fa 00007fad2a3cc4c9 00007fad23948c54 00007fad23948be2 00007fad23948b11 00007fad23948a8c 00007fad23947d42 00007fad2374148c 00007fad237408c6
0709 13:07:47.592130 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083897728}
I20260709 13:07:47.584887 20679 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.594391 20689 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.593385 20755 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.595067 20689 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.596756 20755 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.596863 20547 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:47.518515 20758 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:07:47.598469 20675 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.531927 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2243) took 2565 ms. Trace:
I20260709 13:07:47.600322 20509 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:47.371047 20748 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.508s	user 0.003s	sys 0.000s
I20260709 13:07:47.549862 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.602098 15645 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:47.602510 20663 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.526731 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2237) took 2581 ms. Trace:
I20260709 13:07:47.603229 15639 rpcz_store.cc:276] 0709 13:07:44.945337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.953457 (+  8120us) service_pool.cc:224] Handling call
0709 13:07:44.961421 (+  7964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.287015 (+325594us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:45.547097 (+260082us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.392608 (+845511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.392673 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.392738 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.795341 (+402603us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18003859c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:47.247958 (+452617us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:47.526346 (+278388us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540028ad54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.526418 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.526640 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69656,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":123791,"raft.run_cpu_time_us":5058,"raft.run_wall_time_us":452619,"spinlock_wait_cycles":800573440,"thread_start_us":1071400,"threads_started":3,"wal-append.queue_time_us":774595}
I20260709 13:07:47.590479 20524 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.585630 15638 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.606307 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.610112 20698 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.599409 15642 rpcz_store.cc:276] 0709 13:07:44.966356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.974570 (+  8214us) service_pool.cc:224] Handling call
0709 13:07:44.974822 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.271849 (+297027us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:45.357203 (+ 85354us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.593550 (+236347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.593600 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.593641 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.894084 (+1300443us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b1800365f80. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419
0709 13:07:47.531606 (+637522us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400289954. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.531676 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.531843 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11014,"prepare.queue_time_us":84554,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1563,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":23013,"spinlock_wait_cycles":696527872,"thread_start_us":310184,"threads_started":2,"wal-append.queue_time_us":833879,"wal-append.run_cpu_time_us":1353,"wal-append.run_wall_time_us":1039658}
W20260709 13:07:47.621620 20706 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 2.191s	user 0.009s	sys 0.015s
I20260709 13:07:47.541527 20750 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:47.632351 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 326963us
I20260709 13:07:47.633262 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.597573 20689 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:47.611239 20734 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.640343 15644 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:07:47.642974 15688 leader_election.cc:400] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12.
I20260709 13:07:47.643339 15688 leader_election.cc:403] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:47.645578 15638 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:07:47.665270 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.667122 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.668601 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.675129 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.677528 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:47.679786 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 214021us
I20260709 13:07:47.680771 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.683969 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2723) took 2704 ms. Trace:
I20260709 13:07:47.684563 15791 rpcz_store.cc:276] 0709 13:07:44.979343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.247706 (+268363us) service_pool.cc:224] Handling call
0709 13:07:45.248031 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:45.253447 (+  5416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.253506 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:47.188146 (+1934640us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:47.188660 (+   514us) log.cc:844] Serialized 52 byte log entry
0709 13:07:47.417434 (+228774us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:47.635009 (+217575us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.664510 (+ 29501us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.674128 (+  9618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.674215 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.683614 (+  9399us) raft_consensus.cc:1685] finished
0709 13:07:47.683648 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.683885 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9322,"raft.queue_time_us":21027,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":46254,"spinlock_wait_cycles":15548928,"thread_start_us":425015,"threads_started":2,"wal-append.queue_time_us":317016}
I20260709 13:07:47.737751 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:47.741093 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.744592 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.744439 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.745901 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.746757 15644 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:47.746523 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.669946 20514 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.741886 15719 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:47.751171 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:47.751181 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 430723us
I20260709 13:07:47.752564 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.679584 20679 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.679241 20503 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.753170 15719 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:47.670580 20524 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:47.686906 20630 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:47.765444 20763 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.767328 20746 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:47.767639 20769 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.774909 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.827162 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:47.735246 20663 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.699621 20314 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:47.700122 20631 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:07:47.680296 20734 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.679039 20540 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.804589 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:47.806708 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:47.846256 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 164042us
W20260709 13:07:47.808398 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.809849 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.810726 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.811544 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.850343 15641 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:47.699908 20698 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.815786 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2248) took 2311 ms. Trace:
I20260709 13:07:47.851392 15643 rpcz_store.cc:276] 0709 13:07:45.504741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.130963 (+626222us) service_pool.cc:224] Handling call
0709 13:07:46.131246 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.252846 (+121600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.252885 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.252943 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.252991 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.815456 (+1562465us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000aa354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.815528 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.815711 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279083264}
I20260709 13:07:47.819083 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3076) took 2478 ms. Trace:
I20260709 13:07:47.738833 20619 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:47.737617 20687 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.779326 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:47.750006 20501 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.789083 20760 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:47.844051 20499 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:47.865617 15715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2045) took 1318 ms (client timeout 1692 ms). Trace:
I20260709 13:07:47.541566 20732 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.833724 20314 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.794800 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.834980 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:47.870600 15760 connection.cc:256] RPC call timeout handler was delayed by -1.8524131489999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 13:07:47.762948 20514 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.853114 15716 rpcz_store.cc:276] 0709 13:07:45.311216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.311341 (+   125us) service_pool.cc:224] Handling call
0709 13:07:45.316147 (+  4806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.346240 (+ 30093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.346274 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.346327 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.346367 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.789461 (+2443094us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54001e7b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.789534 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.789758 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68741376}
I20260709 13:07:47.849244 15639 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:47.821599 20744 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.866279 20687 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.889871 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2501) took 2388 ms. Trace:
I20260709 13:07:47.889546 20744 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.890313 15790 rpcz_store.cc:276] 0709 13:07:45.501896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.191819 (+689923us) service_pool.cc:224] Handling call
0709 13:07:46.192152 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.292042 (+ 99890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.292085 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.292143 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.292193 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.889584 (+1597391us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b5400152554. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.889639 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.889810 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229106560}
I20260709 13:07:47.891350 20687 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.892634 20744 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.867724 20501 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.874567 20314 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.894945 20571 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.826408 20749 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.829171 20766 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.898036 20766 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.900285 20514 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.900527 20766 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:47.841136 20769 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.901455 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:47.902235 15716 raft_consensus.cc:2376] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11. Re-sending same reply.
I20260709 13:07:47.903188 20769 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.742529 20680 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.840619 20663 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.904215 20719 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:47.904129 20680 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.904808 20719 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.905453 20663 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.906351 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.907567 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:47.908027 20761 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.458s	user 0.005s	sys 0.002s
I20260709 13:07:47.908934 20509 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:47.909376 20509 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.909775 20509 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.863435 20698 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.913905 20749 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:47.903159 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.916587 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:47.862502 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 83330.5us
W20260709 13:07:47.866117 15715 rpcz_store.cc:269] 0709 13:07:46.547621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.547783 (+   162us) service_pool.cc:224] Handling call
0709 13:07:47.865435 (+1317652us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540003d254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:47.865558 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736593152}
I20260709 13:07:47.834156 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.867954 20366 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:47.839643 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3078) took 2383 ms. Trace:
I20260709 13:07:47.859035 20619 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.871917 15760 connection.cc:256] RPC call timeout handler was delayed by -1.5789464800000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 13:07:47.939810 15760 connection.cc:256] RPC call timeout handler was delayed by -1.5779837529998986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:07:47.940258 15760 connection.cc:256] RPC call timeout handler was delayed by -1.241446480000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
W20260709 13:07:47.940675 15760 connection.cc:256] RPC call timeout handler was delayed by -1.1259252410000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:07:47.941051 15760 connection.cc:256] RPC call timeout handler was delayed by -1.0650155939999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:07:47.873560 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.942145 15719 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:47.943440 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:47.944164 15719 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.918367 15721 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:47.770174 20767 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:07:47.946311 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.949295 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.949579 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.950318 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:47.950789 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.952392 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:47.919551 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.906891 20719 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:47.947721 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.960625 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.965199 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:47.966800 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:47.968441 20426 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:47.968933 20426 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:47.969376 20426 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.973083 20755 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:47.973644 20755 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:47.974121 20755 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.977990 20699 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:47.978955 20699 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.960661 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.988440 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:47.990756 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.991568 15646 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:47.993005 15639 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:47.994833 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:47.995735 15639 raft_consensus.cc:2393] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:47.998627 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.006687 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:48.007479 15639 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:47.901407 20705 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.010846 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.015343 15794 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:48.011786 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:48.016695 15646 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:48.022935 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.023697 20698 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.024281 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.025533 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.027794 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:48.028931 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.029671 15715 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:48.030977 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.031559 20501 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.033404 20514 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.033896 20514 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.034288 20514 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.034600 20503 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:48.035429 20503 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.037400 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:47.870026 20499 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.037696 20503 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.039755 20499 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:47.919063 20764 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.041625 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.042135 20764 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.043406 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.044030 15715 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:48.044286 20764 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.044955 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.046126 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:47.958032 20366 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.081897 20366 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.959817 20619 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.049463 20749 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.091467 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2034) took 1960 ms. Trace:
I20260709 13:07:48.091903 15717 rpcz_store.cc:276] 0709 13:07:46.130782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.130916 (+   134us) service_pool.cc:224] Handling call
0709 13:07:46.131411 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.276990 (+145579us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:46.484495 (+207505us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.877263 (+392768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.877334 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:46.877403 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.628329 (+750926us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b1800296b00. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419
0709 13:07:48.091207 (+462878us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540026d9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:48.091260 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.091407 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":262616,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":19751,"raft.queue_time_us":108,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5684,"spinlock_wait_cycles":350661248,"thread_start_us":582821,"threads_started":2,"wal-append.queue_time_us":541858}
I20260709 13:07:48.095293 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:48.096494 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:48.097687 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:48.097596 20366 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.100723 20366 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.049378 20426 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.052943 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:48.101784 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48922.1us
I20260709 13:07:48.053464 20699 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.103785 20699 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.104175 20699 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.104523 20699 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.963681 20624 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.106061 20624 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.106524 20624 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.107549 20658 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.008261 20675 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.109968 20675 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:48.110402 20675 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.110824 20680 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:47.939035 20663 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.113955 20663 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.114359 20663 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.073967 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.080667 15719 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:48.127606 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.131901 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.136818 16330 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:47.959618 20547 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.145610 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.146597 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.147810 15719 raft_consensus.cc:2376] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14. Re-sending same reply.
I20260709 13:07:48.149089 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.150373 15719 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:48.152349 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.143662 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.153440 15715 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:48.157326 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:48.072947 20760 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:07:48.158950 20547 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.164549 20509 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:48.168587 20720 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.003s
I20260709 13:07:48.014281 20746 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.174590 15720 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:48.174408 15714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2043) took 1715 ms (client timeout 1671 ms). Trace:
I20260709 13:07:48.174940 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:48.175392 15714 rpcz_store.cc:269] 0709 13:07:46.459599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.459735 (+   136us) service_pool.cc:224] Handling call
0709 13:07:48.174146 (+1714411us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540011a3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:48.174331 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887528704}
I20260709 13:07:48.176319 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.176586 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.177099 15788 raft_consensus.cc:2368] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:07:48.177163 15714 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:48.146916 20658 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:48.178102 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:48.178987 20658 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:48.179242 15791 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:48.179375 15793 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.179804 15791 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:48.180176 20658 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.180773 15791 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.179270 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:48.182715 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.183095 15791 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.183391 15796 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:48.184934 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 724) took 1287 ms. Trace:
I20260709 13:07:48.185335 15722 rpcz_store.cc:276] 0709 13:07:46.899647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.900592 (+   945us) service_pool.cc:224] Handling call
0709 13:07:48.184769 (+1284177us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b5400439254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:48.184875 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137061632}
I20260709 13:07:48.186553 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.187162 15793 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:48.187789 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.193859 15722 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.183106 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.178190 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.189038 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:48.189360 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.196915 15794 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.197009 15789 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
I20260709 13:07:48.190976 20436 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.198200 15714 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.198989 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.210012 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.212253 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.213308 15715 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:48.215195 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:47.939293 15713 rpcz_store.cc:276] 0709 13:07:45.455922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.597887 (+141965us) service_pool.cc:224] Handling call
0709 13:07:45.598224 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.162397 (+564173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.162445 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.171485 (+  9040us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.426346 (+254861us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.426389 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.819740 (+1393351us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540026c0d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:47.819787 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.819829 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:47.819842 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.839564 (+ 19722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10702,"raft.queue_time_us":13393,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":2610,"spinlock_wait_cycles":1271555968,"thread_start_us":220713,"threads_started":1,"wal-append.queue_time_us":726959,"wal-append.run_cpu_time_us":1946,"wal-append.run_wall_time_us":1019641}
W20260709 13:07:48.219761 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 62618.4us
I20260709 13:07:48.220793 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.222085 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.221382 15713 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.221364 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:48.229586 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:48.230551 16331 raft_consensus.cc:2410] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:48.233106 15722 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:48.235456 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.234833 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.236829 15722 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:48.237708 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.238384 15721 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.238523 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.228782 20674 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.235164 20734 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:48.241606 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.244696 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:48.256006 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:48.256836 15715 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:48.258664 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.259657 15791 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:48.070312 20314 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.250320 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.231949 20551 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:48.250924 20674 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.235358 20749 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.309954 15759 connection.cc:256] RPC call timeout handler was delayed by -1.4795736819999092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:07:48.312125 15759 connection.cc:256] RPC call timeout handler was delayed by -1.3256736819998878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:07:48.144518 20588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.005s	sys 0.054s
W20260709 13:07:48.323467 20588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.006s	sys 0.055s
I20260709 13:07:48.323961 16331 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.249425 15794 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
W20260709 13:07:48.267249 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 445974us
I20260709 13:07:48.326947 20524 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:48.327348 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.327961 20524 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:48.328404 20524 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:48.328258 20499 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:48.328846 20606 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:48.169106 20720 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.228607 20673 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.330327 20673 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.330385 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:48.330911 20673 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.331162 16331 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:48.329407 20524 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.161576 20547 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.332952 20744 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:48.270443 15792 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:48.333385 20744 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:48.334095 20744 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.271095 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:48.336899 20426 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:48.337177 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 481844us
I20260709 13:07:48.337961 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.228977 20630 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.261411 20501 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.241039 20618 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:48.341140 20618 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:48.342284 20618 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.343995 20719 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:48.344230 20744 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.262874 20436 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.073942 20705 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.298614 15714 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:48.319257 15759 leader_election.cc:400] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:48.387360 15759 leader_election.cc:403] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:07:48.388073 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 68963us
I20260709 13:07:48.388639 15715 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:48.203334 20619 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.332341 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:48.333325 20524 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.338375 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.331089 20720 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:48.391682 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.348075 15790 raft_consensus.cc:2368] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:07:48.348254 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:48.395848 15717 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 16: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:48.399575 20619 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.361021 15721 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:48.276294 15713 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:48.253187 20663 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.276582 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:48.382505 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44616.6us
I20260709 13:07:48.319505 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:48.425849 15722 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:48.309392 20674 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:48.435595 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46416.7us
W20260709 13:07:48.435614 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 97294.6us
I20260709 13:07:48.436928 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:48.421114 15713 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:48.285336 20551 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:48.421849 15761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.034s	sys 0.063s
W20260709 13:07:48.446547 15761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.034s	sys 0.064s
I20260709 13:07:48.386374 20436 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.388444 20630 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.445398 20764 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.420343 20619 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:48.446434 20551 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.308410 20777 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 13:07:48.450412 20766 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.389338 20499 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:07:48.322603 20749 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.485205 20777 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:48.479871 20766 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.481314 20699 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.486346 20766 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.487253 20624 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.487960 20699 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.455127 20436 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.490317 20744 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:48.492897 20540 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.000s
I20260709 13:07:48.472860 20764 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.493368 20540 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12.
I20260709 13:07:48.483786 20509 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.465564 20630 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:48.457041 20626 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.008s	sys 0.030s
I20260709 13:07:48.471989 20784 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.483866 20691 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:48.493832 20719 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:07:48.518774 20755 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:07:48.519467 20755 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.522454 20755 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:48.507617 20689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.027s	sys 0.039s
W20260709 13:07:48.523552 20689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.028s	sys 0.039s
I20260709 13:07:48.495183 20776 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.509872 20775 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.510293 20777 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:48.532902 20705 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.532455 20777 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.538415 20749 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:48.541185 20757 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.198s	user 0.006s	sys 0.007s
W20260709 13:07:48.548513 20759 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.206s	user 0.014s	sys 0.009s
I20260709 13:07:48.525530 20784 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:48.549319 20784 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.499864 20780 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:07:48.563282 20784 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:47.868649 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:48.603833 15610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.014s
W20260709 13:07:48.604736 15610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.003s	sys 0.014s
W20260709 13:07:48.605232 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 550819us
I20260709 13:07:48.606750 15541 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 8, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 8 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:48.615164 15541 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 6 to 9, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 9 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.632366 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.634745 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.636718 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:48.649081 15541 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:48.656565 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 715) took 1906 ms. Trace:
I20260709 13:07:48.657204 15720 rpcz_store.cc:276] 0709 13:07:46.750056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.904334 (+154278us) service_pool.cc:224] Handling call
0709 13:07:48.174331 (+1269997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.175104 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.656053 (+480949us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540011a3d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:48.656364 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2919699712}
I20260709 13:07:48.652269 15541 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.461023 16298 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.021s
W20260709 13:07:48.666064 16298 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.005s	sys 0.021s
W20260709 13:07:48.665953 16325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.000s	sys 0.013s
W20260709 13:07:48.666831 16325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.001s	sys 0.014s
W20260709 13:07:48.666957 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 754696us
I20260709 13:07:48.661023 15541 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 3 to 5, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 5 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.704424 20501 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:48.705889 20503 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:48.710397 20314 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:48.670961 16332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.017s	sys 0.013s
I20260709 13:07:48.716902 20509 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.718365 20547 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.718601 20524 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.473728 20619 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:48.509225 20626 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.009s	sys 0.032s
I20260709 13:07:48.723272 20630 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.723578 20522 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.780584 20619 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.489668 20624 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.727819 20663 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.725000 20588 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:07:48.728595 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:48.739109 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:48.746323 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.726805 20426 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:48.768610 20797 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:48.772300 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 62723.8us
I20260709 13:07:48.749922 20501 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.723765 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:48.746532 20675 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.001s
I20260709 13:07:48.771384 20524 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:48.788522 16332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.018s	sys 0.021s
I20260709 13:07:48.798974 20732 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:07:48.796772 20501 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.799475 20524 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.807924 16325 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:48.813809 20514 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.008s
I20260709 13:07:48.829329 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:48.830658 15646 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:48.835659 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:48.835963 20426 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.836056 20436 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.838343 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:48.839471 20780 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:48.841033 20780 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:48.841181 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:48.842607 20780 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.844560 20780 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.848762 20674 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.851938 20764 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.808142 20503 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.856377 20503 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.801795 20675 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.861690 15639 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.815254 20547 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.863415 20784 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:48.865219 20547 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.866370 20768 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.866878 20768 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.867264 20768 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.869500 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:48.814144 20509 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.860270 20514 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.872424 20509 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.870545 15647 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:48.821969 20797 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.879952 20797 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:48.880399 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:48.881542 15644 raft_consensus.cc:2410] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:48.882786 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:48.883551 15645 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:48.886420 15685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.554s (SENT) [suppressed 20 similar messages]
I20260709 13:07:48.889822 16332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 675) took 1082 ms. Trace:
I20260709 13:07:48.902305 16325 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:48.901834 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:48.872428 20514 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:48.908006 15611 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.016s
I20260709 13:07:48.889878 20750 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.906855 15716 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:48.915745 16330 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:48.916379 15541 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 8, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.912444 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 382665us
I20260709 13:07:48.910992 20763 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:48.923282 20509 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:48.923678 20763 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.923982 20509 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.925640 20675 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.926754 20426 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.927259 20509 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.935014 20626 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:48.935667 20626 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:48.935585 20777 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.937311 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:48.947124 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 73592us
I20260709 13:07:48.900348 16332 rpcz_store.cc:276] 0709 13:07:47.807688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.807843 (+   155us) service_pool.cc:224] Handling call
0709 13:07:47.829895 (+ 22052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.911019 (+ 81124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.911048 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.914660 (+  3612us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.816879 (+902219us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:48.816967 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.889189 (+ 72222us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b54004ef054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:48.889272 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.889371 (+    99us) raft_consensus.cc:1685] finished
0709 13:07:48.889390 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.889720 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3505,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":185652096,"thread_start_us":886246,"threads_started":1,"wal-append.queue_time_us":635171}
W20260709 13:07:48.948197 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 646893us
I20260709 13:07:48.950213 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:07:48.945652 20436 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.960604 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3086) took 1188 ms. Trace:
W20260709 13:07:48.957392 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 486783us
I20260709 13:07:48.958688 15541 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.961484 20675 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.966449 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:48.967607 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.968391 15720 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.968567 20763 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.970325 20626 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.971421 20626 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.973863 20806 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:48.974676 20806 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.974911 20551 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.975353 20524 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:48.977115 20806 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:48.977201 20763 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:48.978796 20540 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:48.979225 20540 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:48.980595 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:48.980361 20540 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.987169 15720 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:48.987700 20674 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:48.982101 20540 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.991418 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.992439 15717 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:48.986809 20551 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:48.998148 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 561137us
W20260709 13:07:48.998481 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 95655.2us
I20260709 13:07:48.998317 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:48.999505 15715 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.999795 20750 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:49.000171 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.001207 20750 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:49.001760 20750 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:49.002832 20691 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.003382 20776 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:49.003089 20750 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.000168 16298 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.008008 20746 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.008078 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.009188 20674 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:49.009357 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.011349 20746 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.010061 20674 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.012705 20691 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:49.014356 20691 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:49.014861 20691 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:49.016105 20806 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.016709 20806 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:49.017122 20806 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.018419 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:49.020366 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.021080 15715 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:49.021585 20802 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.022267 20801 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:49.029589 20802 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:49.030114 20802 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.031845 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.033079 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.033895 15790 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.020859 20674 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.024077 20768 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:48.962212 15718 rpcz_store.cc:276] 0709 13:07:47.742573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.742749 (+   176us) service_pool.cc:224] Handling call
0709 13:07:47.812541 (+ 69792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.261817 (+449276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.261851 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.324827 (+ 62976us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.902700 (+577873us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:48.905970 (+  3270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.908185 (+  2215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.930375 (+ 22190us) raft_consensus.cc:1685] finished
0709 13:07:48.930393 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.930517 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3880,"raft.queue_time_us":18906,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11692,"thread_start_us":806919,"threads_started":2,"wal-append.queue_time_us":574548}
I20260709 13:07:49.006599 20750 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.025400 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.039665 15720 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.026216 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.026705 20426 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.027468 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:48.998133 20673 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.016s
I20260709 13:07:49.042042 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.037590 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.016184 20691 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.054821 20673 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:49.061981 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48330.9us
I20260709 13:07:49.044893 20426 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.065543 20674 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:49.068333 20673 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.068717 20426 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:49.063308 20775 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.028440 20501 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.076866 15720 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:07:49.078071 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 43668.5us
W20260709 13:07:49.078253 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69055.3us
I20260709 13:07:49.070670 20775 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:49.074715 20674 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:49.081634 20775 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.081804 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.082336 20674 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.086179 20551 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:49.086699 20801 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:49.086935 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.088459 20801 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:49.088840 20801 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:49.090030 20784 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.090473 20784 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:49.090880 20784 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.095789 20801 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.096549 20746 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:49.097523 20801 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.097872 20746 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:49.098296 20746 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:49.099436 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.102327 15790 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:49.099404 20746 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.103549 15611 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.103113 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:49.104097 20746 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.104897 15714 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:49.106015 15715 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:49.110338 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.111780 20797 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:49.112377 20797 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:49.113142 15791 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:49.113528 20797 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.126991 20551 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:49.128409 20551 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.114205 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.131110 20776 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:49.131629 20776 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:49.132514 20776 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.113512 20691 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.134941 20806 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.137307 20806 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:49.141043 20766 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.005s
I20260709 13:07:49.156605 20766 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.119792 20501 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.169441 15541 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: leader changed from <none> to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 10 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.120612 20768 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.122558 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.125260 15789 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:49.141280 15716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3092) took 1247 ms (client timeout 1528 ms). Trace:
W20260709 13:07:49.143064 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.143545 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 67224.6us
I20260709 13:07:49.144228 20673 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:49.148069 20802 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.148919 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.150246 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.151238 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.068739 20524 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.152621 15646 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:49.183188 15640 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:49.152866 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.154901 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:49.155929 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.156967 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:49.158447 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:07:49.118331 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52241.3us
W20260709 13:07:49.173806 15716 rpcz_store.cc:269] 0709 13:07:47.893997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.916261 (+ 22264us) service_pool.cc:224] Handling call
0709 13:07:49.141047 (+1224786us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540017a7d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:49.141201 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865684224}
I20260709 13:07:49.171720 15541 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 6, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 6 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:49.176798 15717 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:07:49.191803 15718 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:49.192960 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.190346 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.194689 16298 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:49.193794 15714 raft_consensus.cc:2376] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 12. Re-sending same reply.
I20260709 13:07:49.190449 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.206940 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:49.207441 20766 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.207849 15714 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:49.210702 20780 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:49.212837 15720 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:49.213912 15721 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:49.215224 15715 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:49.219118 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:49.217902 15722 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:49.220324 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.224155 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.224747 15792 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.225505 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.227166 15713 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:49.227532 20809 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:07:49.201043 20673 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:49.228298 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.227344 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:49.230744 15647 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.176582 20775 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.235399 15714 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.228932 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:49.212594 20780 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:49.238792 15720 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.239887 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.240260 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.240512 15646 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.240886 15645 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.244180 15717 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:49.242061 15541 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 8, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.245571 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.248092 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:49.257562 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.259545 15644 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:07:49.265583 15639 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.266631 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.273542 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.274354 15640 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.278143 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.280696 15541 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:49.287302 15541 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:49.297926 15720 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:07:49.298899 20814 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:07:49.299906 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.298928 15641 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 13:07:49.509447 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54947.2us
W20260709 13:07:49.330891 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.330714 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.527315 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.459652 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.301931 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.302103 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:49.468452 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.490487 20815 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:07:49.537139 15713 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:49.434710 20780 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.396641 15792 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:49.402200 15790 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:49.331609 15794 raft_consensus.cc:1240] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:49.333312 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:49.300326 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.536166 15720 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.274751 20784 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.544795 15715 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:07:49.554200 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 271851us
I20260709 13:07:49.555935 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.417717 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.558176 20806 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:49.558811 20806 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:49.558923 20426 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:49.559502 20426 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:49.560425 20426 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.559785 20806 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.562748 20777 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:49.564064 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 230903us
I20260709 13:07:49.567377 20777 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:49.568449 20540 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:49.568898 20540 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:49.569370 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.273188 20746 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.582190 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:49.586637 15541 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 8, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.593225 20775 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:49.498034 20673 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.596637 15639 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:49.588585 15541 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 7 to 10, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 10 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:49.602922 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.610183 15645 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:07:49.607060 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:49.587870 20746 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:49.630995 20746 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.632735 20540 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.634438 20540 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:49.637516 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.638049 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.337872 20571 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.384s
I20260709 13:07:49.639581 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:49.639986 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.640180 20750 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:49.640724 20766 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:49.641600 20768 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:49.646930 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.622211 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.648288 15639 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:49.623263 15642 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.648660 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.624339 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.649050 20675 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.649592 15640 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:49.650039 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.652205 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.652315 20675 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:49.652652 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.653007 20675 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:49.653306 15795 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.509830 20785 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:07:49.653467 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.653959 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.654722 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:49.655259 20626 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.002s
I20260709 13:07:49.654237 20675 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.655907 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:49.656641 15545 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 275) took 20147 ms (client timeout 15000 ms). Trace:
I20260709 13:07:49.626084 15541 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 5 to 8, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.659142 15541 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 2 to 6, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 6 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:49.657058 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.665752 15646 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:49.601171 20802 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:49.671475 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.672418 15644 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.672470 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.662405 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.663902 15788 raft_consensus.cc:2376] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12. Re-sending same reply.
I20260709 13:07:49.671267 20509 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:49.674098 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.663197 15796 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:49.691113 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:49.707922 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.708233 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:49.673273 20801 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:07:49.708923 15792 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:49.709167 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.707962 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.711050 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.667848 20775 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.711417 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:49.711201 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.715857 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.718755 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.719118 15639 raft_consensus.cc:2393] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:49.716952 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 134931us
I20260709 13:07:49.675405 20436 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.722421 15795 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
W20260709 13:07:49.723812 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:49.724610 15646 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.724943 20436 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:49.657058 15545 rpcz_store.cc:269] 0709 13:07:29.509332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.509912 (+   580us) service_pool.cc:224] Handling call
0709 13:07:49.656385 (+20146473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:40.563807 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:40.799735 (+235928us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:40.801454 (+  1719us) write_op.cc:435] Acquired schema lock
0709 13:07:40.801471 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:40.928057 (+126586us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:40.928133 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:40.928166 (+    33us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:07:41.109395 (+181229us) tablet.cc:701] Row locks acquired
0709 13:07:41.118960 (+  9565us) write_op.cc:260] PREPARE: finished
0709 13:07:41.143586 (+ 24626us) write_op.cc:270] Start()
0709 13:07:41.216435 (+ 72849us) write_op.cc:276] Timestamp: P: 1783602461129611 usec, L: 0
0709 13:07:41.216473 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:07:41.327897 (+111424us) log.cc:844] Serialized 9282 byte log entry
0709 13:07:41.948764 (+620867us) op_driver.cc:464] REPLICATION: finished
0709 13:07:42.025425 (+ 76661us) write_op.cc:301] APPLY: starting
0709 13:07:42.025552 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:42.673723 (+648171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:42.673855 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:43.194795 (+520940us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:43.195184 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:07:43.195231 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:43.195736 (+   505us) log.cc:844] Serialized 212 byte log entry
0709 13:07:43.681073 (+485337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.776360 (+ 95287us) write_op.cc:454] Released schema lock
0709 13:07:43.796209 (+ 19849us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:43.867041 (+ 70832us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.869262 (+  2221us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":597880,"reported_tablets":50,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":76278,"apply.run_cpu_time_us":51553,"apply.run_wall_time_us":1823334,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104351,"num_ops":24,"prepare.queue_time_us":349264,"prepare.run_cpu_time_us":19896,"prepare.run_wall_time_us":831050,"raft.queue_time_us":144330,"raft.run_cpu_time_us":17752,"raft.run_wall_time_us":137012,"replication_time_us":672583,"thread_start_us":722086,"threads_started":5,"wal-append.queue_time_us":1098485,"wal-append.run_cpu_time_us":29043,"wal-append.run_wall_time_us":2310534}]]}
I20260709 13:07:49.694538 20571 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.726066 20571 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:49.726552 20571 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.728564 15791 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:49.730494 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:49.725543 20436 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.730016 16332 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:49.734368 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.738255 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:49.739116 16328 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:49.739970 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:49.740486 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 128411us
I20260709 13:07:49.743080 15787 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.743531 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:49.745196 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.746032 20801 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.709920 20551 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:49.749950 20802 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.751132 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.752812 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.753680 20801 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.754393 20801 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:49.755218 20540 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.755818 20540 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.758170 20777 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.758671 20777 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.761445 20777 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:49.762846 20540 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:49.769140 15646 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:49.740586 16331 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.778137 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.735709 20784 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:49.779040 15793 raft_consensus.cc:2393] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:49.718010 20775 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:49.779568 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.779903 20775 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.777529 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.787317 16331 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
W20260709 13:07:49.788662 15714 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 13:07:49.789109 15714 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:49.791406 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.792177 15793 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:49.792869 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.793679 15790 raft_consensus.cc:2393] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:49.793955 15791 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:49.794118 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.795956 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:49.797108 20775 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.797907 20540 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:49.798997 20540 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:49.799043 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:49.799363 20775 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:49.799458 20540 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:49.799896 16329 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:49.800594 20540 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.802326 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.803025 15792 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:49.804015 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.804407 20775 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:49.805289 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:49.805768 20784 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:49.806260 20784 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:49.807426 20784 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.808867 20784 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.810168 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.811017 15794 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:49.812052 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.812865 20571 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:49.814360 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.818341 20540 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.821111 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.820197 20436 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:49.824136 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.825681 15610 connection.cc:256] RPC call timeout handler was delayed by -1.0007363210000904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:07:49.830054 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:49.774078 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:49.829011 20766 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:49.830732 20436 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.834234 15641 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:49.834944 15646 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:49.835604 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.839948 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.841711 15642 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.842496 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.874960 15641 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:49.862847 20571 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:49.877530 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.873287 20775 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:49.901218 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.919384 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.933040 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.933902 15794 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:49.934110 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:49.934696 15795 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.935031 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:49.938380 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 179435us
I20260709 13:07:49.892136 20746 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:49.945055 15795 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:49.947062 20780 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.947286 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.947643 20780 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:49.948171 20780 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.949959 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.951059 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:49.952621 15641 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:49.947064 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:49.954852 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.956589 15639 raft_consensus.cc:2368] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:49.958895 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:49.963630 15789 raft_consensus.cc:2393] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:49.975309 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.997310 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.011046 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.008153 20540 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:07:49.923857 20766 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.019168 20775 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.021253 20802 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:50.022475 20801 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:50.022876 20785 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:50.023244 20776 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:50.024784 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.035133 20768 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.035645 20768 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:50.036712 20768 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:50.040936 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 169504us
I20260709 13:07:50.043088 20823 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:50.044757 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 303281us
I20260709 13:07:50.048560 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.088760 15644 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:50.060817 20768 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:50.092196 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 294822us
I20260709 13:07:50.085851 20509 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:50.103381 20509 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:50.108671 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 212219us
W20260709 13:07:50.113415 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 422095us
I20260709 13:07:50.124257 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.141844 20806 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:50.142285 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:50.147167 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 98681.4us
W20260709 13:07:50.157850 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 285853us
I20260709 13:07:50.159891 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.162894 20846 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.156522 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:50.168503 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 103710us
W20260709 13:07:50.176697 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.149129 20828 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.190264 15642 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
W20260709 13:07:50.177938 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 153253us
I20260709 13:07:50.142315 20806 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:50.186628 20673 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:50.196513 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.195308 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.187453 20801 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.166365 20829 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:50.209578 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:50.196136 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:50.196118 20806 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.208184 20834 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.208475 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.208817 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.187028 20828 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:50.217897 15714 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:50.187582 20797 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.219000 15720 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.230510 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:50.215478 20802 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:50.240007 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:50.240427 20827 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:07:50.240641 15716 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.223225 20540 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.241995 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:50.241631 20540 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.242655 16332 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.244204 20540 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:50.231864 20777 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:50.246120 20777 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.248776 20777 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:50.251035 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:50.216311 20673 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:50.251782 20824 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
I20260709 13:07:50.212235 20626 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:50.252653 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.257251 20776 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.257803 20776 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.223789 20829 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:50.212376 20801 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.252656 20673 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.264717 20780 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.265879 16331 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.267247 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:50.268123 20838 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:50.268734 20838 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.270292 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.239420 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:50.271389 15715 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:50.262537 16330 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:50.224632 20797 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.264161 20801 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:50.271252 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89487.5us
I20260709 13:07:50.276031 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:07:50.277536 15610 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.666s (SENT)
I20260709 13:07:50.282368 15762 leader_election.cc:400] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:50.282743 15762 leader_election.cc:403] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:50.283136 20844 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:50.259336 20436 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.290683 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:50.294685 15713 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.257331 20846 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.290999 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:50.287138 15611 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.261648 20777 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.294476 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:50.302587 20436 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.270483 20829 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.274581 20802 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.346342 15714 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:50.291359 20847 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:50.325398 20746 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:50.227254 20834 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:50.339241 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52189.6us
W20260709 13:07:50.354696 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 194909us
I20260709 13:07:50.303871 20840 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:50.364327 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 80710.8us
W20260709 13:07:50.370107 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 95974.9us
I20260709 13:07:50.263279 20776 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:50.372133 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 137952us
I20260709 13:07:50.355073 20846 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.357707 20675 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:50.357380 20674 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.411240 15720 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
W20260709 13:07:50.398729 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.364140 20840 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.411201 15716 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:50.411808 15644 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:07:50.414825 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:50.416042 15713 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:50.416733 15718 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:50.419965 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 64107.5us
I20260709 13:07:50.356910 20839 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:50.423282 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 147328us
I20260709 13:07:50.427385 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:50.428023 15792 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:50.429020 16332 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:50.338835 20777 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.431049 16297 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:50.450187 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:50.464012 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:50.455248 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:50.272636 20838 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:50.456453 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 162060us
I20260709 13:07:50.412439 20674 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:50.462008 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 100074us
I20260709 13:07:50.460748 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:50.432034 20540 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.427188 20840 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.466476 15789 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:50.401005 20785 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:50.468608 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:50.477221 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.478710 15638 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:50.474596 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:50.481137 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:50.472755 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:50.486809 15639 raft_consensus.cc:2410] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:50.370541 20797 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.465220 20775 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.492050 20775 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.492337 20822 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:50.492947 20822 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:50.493297 20775 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.493842 20822 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.495152 20775 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.495697 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:50.496784 20853 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:50.498330 20785 consensus_queue.cc:1243] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:50.499629 20785 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.500141 20785 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.471503 20674 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.471401 20746 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.516744 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:50.487552 20776 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.518909 15718 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
W20260709 13:07:50.528291 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97495.2us
I20260709 13:07:50.488107 20837 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.524542 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.504508 20750 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.534739 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.537346 20847 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:50.474516 20802 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.532328 20797 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.549675 20859 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:50.578002 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 82415.5us
I20260709 13:07:50.551805 20571 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:50.531759 20746 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.515751 20509 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:50.568485 20861 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:50.567229 20854 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:07:50.571066 20825 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:50.575170 20828 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.525465 20857 raft_consensus.cc:2764] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:07:50.600061 20832 consensus_queue.cc:1059] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:50.601061 20777 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:50.604157 20780 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:50.606010 20540 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:50.547027 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:50.623831 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.554975 20673 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:50.541779 20750 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.606055 20866 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.646677 20866 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:50.646962 20832 raft_consensus.cc:3055] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:50.647377 20832 raft_consensus.cc:740] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:50.647781 20866 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.648298 20832 consensus_queue.cc:260] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.649403 20673 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:50.649415 20862 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:50.624826 20571 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.650501 20673 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.652391 20571 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:50.649539 20852 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:07:50.642678 20540 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:50.653461 20540 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.646134 20846 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:50.645042 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 128423us
W20260709 13:07:50.655089 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 230913us
W20260709 13:07:50.644079 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 101409us
I20260709 13:07:50.539983 20785 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.658169 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.659267 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.669341 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:50.625039 20746 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.670733 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.671418 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:50.669986 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:50.642354 20834 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:50.675015 15722 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:50.678433 20426 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:50.678993 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.679350 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:50.679046 20426 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:50.680007 15718 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.680521 20426 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.683063 20750 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:50.684126 15713 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:50.675644 20832 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.686160 15716 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:50.687549 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.688612 15720 raft_consensus.cc:2410] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:07:50.691048 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.692086 15714 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:07:50.710770 20860 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:07:50.711572 20865 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:50.710953 20847 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.713443 20858 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:50.713891 20858 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.714758 20858 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.716220 20858 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.722031 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.722683 15714 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:50.659381 20857 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:50.654611 20868 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:50.671442 20848 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:50.669040 20836 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:50.750072 16298 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:50.753626 20777 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.735113 20828 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.758054 20870 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:50.759569 20825 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:50.759900 20746 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:50.760746 20848 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:50.756760 20785 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.761015 20841 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.752743 20857 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:50.737677 20776 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.734637 20750 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:50.770821 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 114493us
W20260709 13:07:50.773098 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.784602 15718 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:50.772305 20836 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:50.778673 20825 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.829499 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:50.794571 20844 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.887297 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 221961us
I20260709 13:07:50.794852 20841 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:50.855578 20825 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:50.778077 20768 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.000s
I20260709 13:07:50.756579 20862 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:50.757349 20832 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:07:50.795428 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:50.827415 20802 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:50.891490 15718 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:50.893276 20848 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.792953 20870 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.773928 20868 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:50.787705 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 117052us
I20260709 13:07:50.896540 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:50.890143 20806 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.004s
I20260709 13:07:50.889906 20750 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:50.976321 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.978072 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:50.978231 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 139370us
W20260709 13:07:50.979172 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 91797.9us
W20260709 13:07:50.944548 20826 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:50.983201 15721 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:50.989034 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:50.992493 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 96069.9us
I20260709 13:07:50.891209 20844 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.998342 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:51.016912 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:50.991048 20746 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:50.983863 20806 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:50.991724 20829 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.988000 20750 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:51.020762 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:51.002431 20847 raft_consensus.cc:2764] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:51.027354 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:50.983115 20802 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:51.039054 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.042176 20879 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.042776 20879 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.045044 20880 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.046078 20875 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:07:51.047991 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.049424 20883 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:51.051210 20877 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:07:51.054780 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.061450 20849 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.638s	user 0.000s	sys 0.010s
W20260709 13:07:51.065269 20839 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.001s
W20260709 13:07:51.046013 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 57689.4us
I20260709 13:07:51.046177 20884 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:51.072086 15642 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:51.077788 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 79693.2us
I20260709 13:07:51.078969 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:51.027848 20571 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:51.030241 20746 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:51.092569 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 99508.3us
I20260709 13:07:51.095429 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:50.992776 20836 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.098322 20750 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.081918 20777 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.081344 20859 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.106279 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:51.084225 20839 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:51.110934 16298 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:07:51.111896 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 122931us
I20260709 13:07:51.039736 20829 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.121352 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:51.123543 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.126041 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:51.127177 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 124171us
W20260709 13:07:51.130707 20882 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:51.031845 20862 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:51.134426 20840 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.001s
W20260709 13:07:51.115128 20775 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.006s
I20260709 13:07:51.115383 20838 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.094911 20571 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.117238 20875 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.145061 15644 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:51.134869 20802 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.143242 20626 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.156198 20894 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.186898 20894 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.187368 20894 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.173343 20857 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:51.174827 20540 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:07:51.174496 20884 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:51.177809 20887 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:51.179311 20571 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:51.209944 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 87692.1us
I20260709 13:07:51.182305 20806 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:51.184147 20829 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.184793 20776 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:51.185439 20674 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.000s
I20260709 13:07:51.134896 20840 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.218636 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:51.224622 15713 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.219472 20887 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:51.220183 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57235.3us
I20260709 13:07:51.231945 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:51.232832 15722 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:51.214828 15721 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:51.215739 15718 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:51.217552 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:51.229979 20840 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.230706 15795 raft_consensus.cc:2368] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:51.194196 20780 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.240527 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 119227us
I20260709 13:07:51.238571 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.235616 20888 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:51.144243 20746 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.259395 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:51.261853 15713 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:51.210429 20540 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.235886 20887 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:51.181599 20868 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:51.276954 15718 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:51.241699 20846 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:51.257547 20858 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:07:51.241787 20859 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:51.261052 20797 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.001s
I20260709 13:07:51.280190 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.228734 20844 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.261351 20822 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.291945 15716 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:51.265126 20828 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.240278 20674 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.254453 20780 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.286689 20846 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:51.286485 20426 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:51.285992 20888 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:51.314320 20888 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:51.316407 20785 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.007s
I20260709 13:07:51.296896 20750 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.317996 20673 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:07:51.321326 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 63096.4us
I20260709 13:07:51.308864 15611 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:51.344566 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68426.5us
I20260709 13:07:51.346907 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.309547 20426 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.297804 20822 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.364537 15792 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:51.299876 20890 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:51.365193 15792 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:51.366181 20889 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.367254 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:51.374119 15794 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:51.335546 20785 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.382854 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:51.384315 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:51.308753 20825 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.352855 20426 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.348330 20896 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:51.368997 20828 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.427120 20874 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:51.428022 20906 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:07:51.376857 15792 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:51.433226 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.365072 20806 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:07:51.429986 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 92486.3us
I20260709 13:07:51.429634 20777 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.430629 20896 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:51.469283 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.398278 20785 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.478021 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.470244 20828 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.391822 20889 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.487558 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:51.488310 20898 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:51.488274 16325 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:51.473271 20859 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.520510 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:51.522447 16325 raft_consensus.cc:2410] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:51.485090 20880 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.486739 20868 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:51.526448 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 53553.6us
I20260709 13:07:51.487682 20540 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:51.528465 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:51.474992 20777 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.537009 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:51.520519 20780 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.538338 15792 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.513391 20828 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.532835 20880 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.592859 20822 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.600571 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.539443 20896 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.546255 20915 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:51.545689 20909 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:51.544699 20540 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:51.606935 15718 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:51.613461 15792 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:51.651916 20840 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:51.613567 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.639151 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2293) took 1201 ms. Trace:
I20260709 13:07:51.670635 20825 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:51.655930 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 128127us
W20260709 13:07:51.714030 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 113544us
I20260709 13:07:51.663990 20571 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.613008 20844 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:51.796881 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:51.735445 15642 rpcz_store.cc:276] 0709 13:07:50.399988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.400548 (+   560us) service_pool.cc:224] Handling call
0709 13:07:50.400814 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.072682 (+671868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.573655 (+500973us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54003eadd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:51.601361 (+ 27706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543147264}
I20260709 13:07:51.725831 20832 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.657215 20894 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.814318 16332 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:51.730707 20540 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:51.817212 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:51.825639 20920 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:07:51.799904 20822 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:51.826804 20880 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:51.826576 20822 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.810205 20844 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:51.828328 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:51.829861 15640 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.830955 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:51.833122 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:51.833657 20822 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.834123 20674 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.834309 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:51.835316 20913 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.003s
I20260709 13:07:51.835556 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:51.836135 16334 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
W20260709 13:07:51.837389 20916 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:07:51.837406 20801 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.839121 20912 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.839634 20912 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:51.842113 20907 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.138s	user 0.005s	sys 0.000s
I20260709 13:07:51.843313 20868 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.795893 20840 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.846872 20840 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.847584 20840 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:51.849568 20828 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.851397 20777 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.729646 20915 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.853344 20855 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.853905 20855 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.855899 20855 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.811344 20785 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.805320 20859 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.858199 20859 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.860329 20859 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.860570 20426 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.795868 20909 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:51.919925 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:51.921005 16332 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:51.922752 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:51.926465 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:51.865275 20887 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:07:51.824139 20540 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:51.858223 20750 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.001s
I20260709 13:07:51.929041 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:51.940196 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.941530 20918 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:07:51.942484 20436 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:51.863451 20426 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:51.853644 20915 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.988548 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:51.876024 20912 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:51.804579 20571 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.002396 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:51.947927 20887 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.005949 20887 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:52.001341 20846 consensus_meta.cc:287] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.000s
I20260709 13:07:52.006980 20846 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:52.008409 20905 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.744s	user 0.003s	sys 0.000s
I20260709 13:07:52.009131 20846 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.009809 15715 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:52.011077 20571 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.012251 20844 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:52.012529 20870 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.017271 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.021893 15794 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:52.024878 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:51.998126 20750 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.997067 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 475223us
I20260709 13:07:51.851411 20894 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.047014 15790 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:52.003526 20837 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.048827 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.051039 15794 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.056479 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.058116 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.059729 16334 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:52.062312 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.062938 15789 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:52.068279 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.068969 15795 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:52.071053 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 336005us
I20260709 13:07:52.055158 20784 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.078445 15641 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.055773 15794 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:52.080147 15794 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.077452 20858 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.095396 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.098711 15789 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:52.075970 20844 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:52.100787 15794 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.103380 15795 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:52.103176 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.076290 20894 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:07:52.107487 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 310680us
I20260709 13:07:52.070796 20837 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.115296 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:52.118054 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.118889 15795 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:52.088873 20784 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.126837 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.130371 15645 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:52.134438 15645 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:52.135946 15793 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:52.136850 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.100620 20858 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.142377 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.143179 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.143640 20866 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.144191 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:52.144775 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.146418 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.147075 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.156064 15647 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:52.156181 15645 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:52.151222 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:52.157670 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76927.2us
I20260709 13:07:52.114336 20785 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:52.175524 15795 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:52.176213 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:52.178164 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.176991 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.178120 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.178399 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:52.159688 15643 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:07:52.183143 20837 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.183902 20880 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:52.184994 20926 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.185225 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:52.185454 20935 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.176705 20750 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:07:52.188923 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:52.189714 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 74519.8us
I20260709 13:07:52.190272 15792 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:52.190557 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:52.191569 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.196120 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.151232 20870 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.200407 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.120036 20931 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:07:52.147773 20930 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.155743 15642 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:52.330216 15796 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:52.286036 15638 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:52.330731 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:52.333882 16328 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:52.341065 16334 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:52.337827 16332 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:52.331777 15646 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.279383 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:52.342592 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 152096us
I20260709 13:07:52.343433 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.344515 16297 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:52.230224 15794 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:52.343319 20926 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.346716 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:52.347069 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.348574 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.351368 15642 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
W20260709 13:07:52.230593 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.350576 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.345862 15639 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:52.354414 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.354856 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.355738 15789 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.347174 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.357232 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:52.231460 20932 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:07:52.232589 20922 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:52.294585 20801 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.249544 20844 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.278997 20540 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.358774 20939 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.345639 20837 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.350503 20870 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.391112 20889 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.391778 20870 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.370814 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.357312 15685 leader_election.cc:400] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:52.392804 15685 leader_election.cc:403] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.393621 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.373163 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.398259 15793 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:52.361011 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.340150 20930 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:52.365940 20928 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.363220 15795 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:52.347652 20768 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.225673 15791 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:52.360074 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.378491 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.374912 20750 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.420176 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:52.387722 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.386688 20880 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:07:52.359620 20784 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.389076 20939 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.400511 15638 raft_consensus.cc:2410] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:52.370311 20879 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.358857 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.410471 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.415717 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.416209 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.422082 15788 raft_consensus.cc:2376] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 12. Re-sending same reply.
I20260709 13:07:52.423125 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.407639 20837 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.415586 20768 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.428659 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.429144 20784 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:52.249254 20841 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.528512 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.528861 16330 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:52.525478 15796 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:07:52.510555 15644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 619) took 1513 ms (client timeout 1639 ms). Trace:
W20260709 13:07:52.457042 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.529693 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 133584us
I20260709 13:07:52.430089 20939 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.484102 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.400054 20785 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:52.527329 20880 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:52.534507 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:52.530181 15644 rpcz_store.cc:269] 0709 13:07:50.997467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.997634 (+   167us) service_pool.cc:224] Handling call
0709 13:07:52.510267 (+1512633us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54000e83d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:52.510425 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260434688}
I20260709 13:07:52.536975 20540 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.537529 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.541509 20846 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.542074 20846 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.542171 20880 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.506016 20910 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.546176 20910 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.488385 20926 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:52.453092 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 112622us
I20260709 13:07:52.533317 20837 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.407519 20870 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 10. Current term is 11.
I20260709 13:07:52.524689 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.553912 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.554194 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.554778 15790 raft_consensus.cc:2376] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 15. Re-sending same reply.
I20260709 13:07:52.555608 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.484047 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.534420 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:52.548394 20900 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.285s	user 0.004s	sys 0.000s
I20260709 13:07:52.430202 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.557106 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.533521 15791 raft_consensus.cc:2376] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 11. Re-sending same reply.
I20260709 13:07:52.535455 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.535480 15796 raft_consensus.cc:2376] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 13. Re-sending same reply.
I20260709 13:07:52.406469 20930 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.430894 20859 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:52.532738 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:52.403810 20801 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.556376 16326 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
W20260709 13:07:52.572047 15688 connection.cc:256] RPC call timeout handler was delayed by -1.361024493000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:07:52.572484 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3033847260001039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:07:52.572845 15688 connection.cc:256] RPC call timeout handler was delayed by -1.181024493000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 13:07:52.574048 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3151) took 1733 ms. Trace:
I20260709 13:07:52.574542 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.575044 15720 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.553202 20785 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.575675 15717 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:52.575783 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.576848 15720 raft_consensus.cc:1217] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:07:52.574446 15719 rpcz_store.cc:276] 0709 13:07:50.840082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.857570 (+ 17488us) service_pool.cc:224] Handling call
0709 13:07:50.895447 (+ 37877us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:50.980867 (+ 85420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.980909 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:50.985199 (+  4290us) log.cc:844] Serialized 52 byte log entry
0709 13:07:51.211885 (+226686us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.212244 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.212492 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.212569 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.545373 (+1332804us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:52.573629 (+ 28256us) raft_consensus.cc:1685] finished
0709 13:07:52.573725 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.573888 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81199,"prepare.queue_time_us":3812,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":91071,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":10243,"spinlock_wait_cycles":4281088,"thread_start_us":184936,"threads_started":1,"wal-append.queue_time_us":202904}
I20260709 13:07:52.559012 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.578423 16331 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:52.579550 15717 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.579909 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:52.580241 20858 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:52.580578 15721 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:52.581007 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:52.577337 20785 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:52.430692 20750 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.430459 20928 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:52.395160 20844 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.553247 20837 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.560760 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.554685 15789 raft_consensus.cc:2376] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 11. Re-sending same reply.
I20260709 13:07:52.597213 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.561436 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.561565 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.561904 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.598917 15721 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:52.599145 15795 raft_consensus.cc:2376] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 11. Re-sending same reply.
I20260709 13:07:52.599648 15790 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:52.599807 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.561480 20859 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.568593 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.569052 20880 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.548419 20910 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.570816 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.577373 15720 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:52.580533 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.610322 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.610669 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.611442 20934 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.611896 20934 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:52.612987 15788 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:52.613369 15788 pending_rounds.cc:85] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 7
I20260709 13:07:52.583590 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:52.583508 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50868.3us
I20260709 13:07:52.592132 20870 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:52.617642 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:52.405233 20855 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:07:52.531154 20768 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.618263 20870 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.585137 20540 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.619716 16332 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.620081 20540 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.621356 20870 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.591003 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.591465 20866 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:52.592841 15716 raft_consensus.cc:1217] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:07:52.593333 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:52.593645 15715 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:07:52.627333 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.654525 20750 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.655365 20840 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.655957 20840 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.656342 20840 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.657989 20571 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.658500 20571 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:52.658663 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 473459us
I20260709 13:07:52.659030 20571 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.660722 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:52.662078 20944 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.626983 20859 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.661926 15796 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:52.629181 15714 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:52.665277 15719 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:52.665645 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2296) took 1635 ms. Trace:
I20260709 13:07:52.670012 15641 rpcz_store.cc:276] 0709 13:07:51.030944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.031079 (+   135us) service_pool.cc:224] Handling call
0709 13:07:51.072349 (+ 41270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.079444 (+1007095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.653697 (+574253us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000e7ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:52.665589 (+ 11892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311984000}
I20260709 13:07:52.594698 15794 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:52.601557 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.622087 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.622458 20540 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.586148 20825 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:52.623880 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:52.683096 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.624846 15791 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:52.624580 20844 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:52.625495 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.691448 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.692711 15795 raft_consensus.cc:2376] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 13. Re-sending same reply.
I20260709 13:07:52.695633 15713 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:07:52.697472 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.673584 16331 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:52.673483 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.676128 15716 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:52.676563 15790 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:52.627686 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.635753 15720 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:52.624565 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.701458 16332 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:52.613611 15788 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 10.8
W20260709 13:07:52.684262 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.702194 15788 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.699903 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:52.702719 15788 pending_rounds.cc:107] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:07:52.600565 20785 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:52.702925 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.703672 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.711903 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.715292 15795 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:52.771505 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 110842us
W20260709 13:07:52.770532 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.771792 15795 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:52.747012 15720 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:52.703116 15788 raft_consensus.cc:2889] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.724351 15790 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:52.774633 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:52.775717 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.776685 15790 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:52.763432 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:52.778735 15713 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:52.777933 16333 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:52.714066 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.783916 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:52.787112 15611 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:52.784147 15644 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:52.789542 15713 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:52.627101 20934 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.793915 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.789947 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:52.773602 15795 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.727715 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:52.685006 20801 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:52.684410 20784 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.733501 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.817469 15720 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:52.772483 20785 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:52.691785 20855 consensus_queue.cc:1243] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:52.817272 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.788014 20891 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:52.800006 15714 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:52.845795 15713 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:52.790874 20750 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:52.793416 20880 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:52.750114 15719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53344
I20260709 13:07:52.848784 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.847193 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:52.822827 20889 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.798902 20842 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.857821 15720 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:07:52.858845 15795 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.872974 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.862918 15717 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:52.817610 20822 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:52.866429 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:52.876179 15714 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:52.847150 20784 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.869087 15721 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.740654 20928 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.848369 20785 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.890658 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.728513 20866 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:52.872082 15720 pending_rounds.cc:85] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 7
I20260709 13:07:52.891623 15720 pending_rounds.cc:107] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:07:52.891911 15720 raft_consensus.cc:2889] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.864027 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:52.892067 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.892647 15713 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:52.892976 15795 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:52.869300 16328 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:52.894227 15718 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.867419 20750 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.895824 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.896323 15717 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:52.868378 20880 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.855760 20897 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:52.855551 20674 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:52.904914 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:52.911262 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.920943 15719 raft_consensus.cc:606] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:52.917563 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.921330 15719 raft_consensus.cc:614] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:52.921348 15788 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.922184 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.878484 20822 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.933990 20822 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:52.935567 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.939532 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.901952 20750 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.946203 15718 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:52.952396 15714 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.952368 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.954538 15795 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:52.955741 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.881255 20842 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.914399 20880 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.957172 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:52.964850 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.968009 15717 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:52.970745 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:52.971225 20842 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:52.971591 20943 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.973420 20943 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.974207 20943 consensus_queue.cc:1243] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:52.973899 20930 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.974749 20801 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.975057 15716 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.975133 20801 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:52.976120 20801 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.976897 20897 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:52.977411 20897 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:52.979014 20801 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.978619 20897 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:52.980300 20897 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.980808 20930 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:52.985963 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:52.921489 20889 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:52.971768 20841 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.991464 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:52.952929 20891 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:52.974890 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.017455 15787 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:53.045552 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.046675 15795 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:53.048053 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.053850 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.049685 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.056566 15795 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:53.057915 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.997341 20848 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:53.076331 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:52.971838 20842 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.098547 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.099006 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.133428 15718 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:53.099550 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.106572 15717 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:53.108088 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.114645 20889 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.124348 20866 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:53.125667 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:53.138324 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.139447 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.143381 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.143906 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.145897 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.084959 20892 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.090353 20848 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.149632 15789 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:53.152391 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.154393 15789 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:53.136390 20930 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.158346 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.150991 20892 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.157068 20866 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:53.154713 20844 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:53.142060 20870 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.152976 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.184653 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.153944 20848 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.160175 20892 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:53.163775 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 171513us
I20260709 13:07:53.197711 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:53.190420 15643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.011s
I20260709 13:07:53.246917 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:53.268617 20949 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:07:53.281194 20859 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:07:53.258306 20784 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:53.163225 20930 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:53.249126 20840 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.592s	user 0.014s	sys 0.001s
I20260709 13:07:53.294315 15788 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:07:53.294960 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.260372 20866 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:53.302345 15721 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:07:53.303613 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 106013us
I20260709 13:07:53.304889 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.309415 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:53.310863 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.185251 20891 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.312418 20909 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:53.301980 20571 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.009s
I20260709 13:07:53.331692 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.332820 15788 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:53.298197 20859 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:53.353273 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 199151us
I20260709 13:07:53.300794 20840 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.354267 15688 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.355134 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:53.349684 20768 consensus_meta.cc:287] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.731s	user 0.019s	sys 0.002s
I20260709 13:07:53.356693 15788 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:53.332873 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.368494 15795 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:53.332396 20571 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:53.375770 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66419.5us
W20260709 13:07:53.376077 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.377101 15685 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.380841 15789 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:53.381412 15789 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:53.400242 15789 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.405992 15789 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:53.386336 20954 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:53.388661 20858 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.414738 20858 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:53.415709 20858 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.416949 20858 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:53.417238 20785 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.515s	user 0.017s	sys 0.000s
W20260709 13:07:53.417604 15610 leader_election.cc:336] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.525s (SENT)
I20260709 13:07:53.383817 15790 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:53.418123 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:53.419355 15610 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.528s (SENT)
I20260709 13:07:53.419613 15790 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:53.421100 15795 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:53.421898 20874 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:53.395905 20750 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:53.422976 15792 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2756) took 1506 ms (client timeout 1586 ms). Trace:
W20260709 13:07:53.423393 15792 rpcz_store.cc:269] 0709 13:07:51.916717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.916876 (+   159us) service_pool.cc:224] Handling call
0709 13:07:53.422758 (+1505882us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001f81d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:53.422895 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613177216}
I20260709 13:07:53.424865 15792 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:53.396832 20844 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.397833 15793 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:07:53.425680 20844 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.427043 20930 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.427673 15793 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:53.429430 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2800) took 1059 ms. Trace:
I20260709 13:07:53.400701 20571 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:53.401185 15788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:53.430888 15788 raft_consensus.cc:606] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:53.431376 15788 raft_consensus.cc:614] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.367077 20768 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.450258 20768 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.402174 20848 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.451308 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 771) took 1068 ms. Trace:
I20260709 13:07:53.451727 15796 rpcz_store.cc:276] 0709 13:07:52.383430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.663463 (+280033us) service_pool.cc:224] Handling call
0709 13:07:52.681510 (+ 18047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.772212 (+ 90702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.772241 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.772281 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:52.772343 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.451075 (+678732us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b540047b3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:53.451121 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.451248 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208120704}
I20260709 13:07:53.452586 20848 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:53.453279 20848 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:53.453999 16329 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:53.454214 15789 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:07:53.455608 20957 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:53.455629 15789 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:53.457317 15789 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:53.404029 20846 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.458628 20509 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:53.459076 20509 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:53.459213 20846 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:53.403558 20892 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.459633 15789 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:53.459973 20509 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.459652 20846 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.461474 20892 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.461644 20846 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.429704 15794 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:53.399318 20840 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:53.463725 20509 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.427695 20930 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.464717 20930 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.465302 20930 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.467612 20930 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.468514 20822 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:53.471851 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.445497 15787 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:07:53.478229 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76885.5us
W20260709 13:07:53.394237 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.421475 15795 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:53.490767 15795 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.431598 15792 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:53.383919 15611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.016s	sys 0.004s
W20260709 13:07:53.494516 15611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.016s	sys 0.004s
W20260709 13:07:53.495082 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 647554us
I20260709 13:07:53.497224 15796 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:53.446383 15790 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:53.430176 15791 rpcz_store.cc:276] 0709 13:07:52.372524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.559908 (+187384us) service_pool.cc:224] Handling call
0709 13:07:53.429255 (+869347us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b540016d5d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:53.429374 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113803136}
I20260709 13:07:53.447259 20750 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:53.431277 20784 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.448089 15788 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:07:53.450546 20859 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:53.507889 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:53.528435 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:53.529860 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.530793 15639 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:07:53.533782 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.538897 15795 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.539036 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:53.539659 16333 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.547614 20750 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.548298 20750 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.550129 20822 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:53.550346 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.537254 20571 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:53.551011 20571 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.550346 20897 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:53.551568 20571 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.551018 15791 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.417692 20785 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.560835 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.562145 15796 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:53.567478 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.568480 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 191450us
I20260709 13:07:53.576581 15611 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:53.577728 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.578346 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.579058 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.579644 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.581607 15795 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:53.581988 15791 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:53.582767 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2816) took 1038 ms. Trace:
I20260709 13:07:53.583755 16297 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.569674 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.583379 15795 rpcz_store.cc:276] 0709 13:07:52.544079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.420665 (+876586us) service_pool.cc:224] Handling call
0709 13:07:53.420971 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.582356 (+161385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.582687 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:53.565583 20880 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.567s	user 0.019s	sys 0.003s
W20260709 13:07:53.594483 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 240297us
I20260709 13:07:53.595305 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.535264 20784 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:53.600275 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 231317us
I20260709 13:07:53.602062 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.606437 20870 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.607580 20870 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:53.608134 20870 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.608804 20870 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.610852 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.611644 15716 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:53.611837 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.612654 15718 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:53.612903 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.613525 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.608168 20972 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.606611 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:53.614346 15721 raft_consensus.cc:2393] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 14: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:53.619861 20972 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.618227 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.620651 15720 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:07:53.621851 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.622189 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.622700 15720 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.623095 15715 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:53.623477 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.624254 15721 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:07:53.626884 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.627970 15715 raft_consensus.cc:2368] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
I20260709 13:07:53.630646 15715 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.631206 15720 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:53.618270 20870 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.635578 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.636211 15718 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.636103 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.633478 15715 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:53.639288 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.640036 15715 raft_consensus.cc:3060] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.646100 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:53.646997 15716 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:53.647785 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.648808 15721 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:07:53.636518 20870 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.632632 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:53.659021 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.660194 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:53.661818 20859 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:53.662587 20859 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:53.663059 20859 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:53.663956 20859 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.665670 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.666445 20972 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:53.667876 20540 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:53.668257 20540 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:53.669247 20540 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.665938 20930 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.676807 15715 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:53.677949 16298 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.680146 20842 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.680678 16298 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:53.680948 20969 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:53.681077 20970 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:53.681921 20969 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.682350 20969 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.682749 20969 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.683001 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:53.683377 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.680738 20842 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.685024 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.686758 20842 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:53.686683 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:53.685503 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:53.687525 16334 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.688761 20780 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.689285 20780 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:53.689795 20780 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.690145 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.691520 20930 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.692010 20930 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.694294 20930 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.695106 20848 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.695578 20848 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.696496 20930 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.697026 20930 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.699687 20930 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.668262 15716 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:07:53.697731 20848 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.702996 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.709244 15795 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:53.711438 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.699829 20870 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.713810 20870 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.717836 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:53.719257 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 119252us
I20260709 13:07:53.722231 16298 leader_election.cc:400] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
I20260709 13:07:53.723804 16298 leader_election.cc:403] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:53.712886 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.729425 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.729663 15716 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:53.730345 15715 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:53.733057 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.735132 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.735929 15796 raft_consensus.cc:2468] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:53.709400 16334 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:53.737538 16297 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.739040 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.739990 15796 raft_consensus.cc:2410] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:53.563407 20822 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:53.565212 20897 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:53.742341 15796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:53.564607 20951 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:07:53.760978 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:53.776522 15795 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.597819 20959 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.802107 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.759603 15718 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:53.760305 20930 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:53.764492 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.803474 15714 raft_consensus.cc:2410] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:53.769974 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.771175 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.774531 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.805678 15720 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:53.761421 15796 raft_consensus.cc:606] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:07:53.806710 15796 raft_consensus.cc:614] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.599363 20892 raft_consensus.cc:2804] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:53.811359 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.811404 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 391184us
W20260709 13:07:53.812024 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.798023 20974 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.565713 20885 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:07:53.814739 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.725821 20926 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:53.821620 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:53.826956 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:53.743017 20949 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:07:53.853091 15795 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:53.854745 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.856201 15640 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:53.861778 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.866458 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:53.867079 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.799764 20768 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
I20260709 13:07:53.871927 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.872078 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 929) took 1378 ms. Trace:
I20260709 13:07:53.741328 20889 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:07:53.873363 16329 rpcz_store.cc:276] 0709 13:07:52.494908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.538518 (+ 43610us) service_pool.cc:224] Handling call
0709 13:07:52.538817 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.454443 (+915626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.871830 (+417387us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54005f0ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:53.872018 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104210688}
I20260709 13:07:53.719547 20956 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:07:53.717644 20880 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.812664 20912 raft_consensus.cc:2804] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:53.883052 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.705266 20969 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:53.810891 20930 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:53.880086 20784 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:53.848394 20926 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.841356 20892 raft_consensus.cc:697] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:53.887229 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.865820 20848 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:53.889760 15793 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:53.891374 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.894258 15641 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:53.902310 16330 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:53.907281 15795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:53.907742 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.843721 20974 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:53.892489 20926 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:53.915397 15645 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:07:53.890434 20930 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.909611 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53344 (request call id 2) took 1214 ms. Trace:
I20260709 13:07:53.922276 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:53.919575 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.914875 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:53.923233 15796 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:53.922168 15719 rpcz_store.cc:276] 0709 13:07:52.686771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.687276 (+   505us) service_pool.cc:224] Handling call
0709 13:07:53.895992 (+1208716us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b540026d9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25400853 00007fad2a3ce60a 00007fad239547d4 00007fad23954762 00007fad23954691 00007fad2395460c 00007fad239538c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:53.896141 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119974144}
I20260709 13:07:53.892709 20934 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.925014 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:53.818989 20959 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:53.931680 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 208600us
I20260709 13:07:53.932610 15645 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:53.902727 20750 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:53.937112 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:53.904428 20912 raft_consensus.cc:697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:53.944533 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:53.947098 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:53.933486 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:53.947774 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 226067us
I20260709 13:07:53.958443 15645 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.906744 20972 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:53.960078 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 222626us
W20260709 13:07:53.971127 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.978940 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:53.980708 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.988659 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:53.989694 15791 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:53.991058 20889 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:53.991842 20889 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:53.993286 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 59910.6us
I20260709 13:07:53.986862 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:07:53.996258 15610 connection.cc:256] RPC call timeout handler was delayed by -1.1963806170000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:07:53.997781 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.999838 15795 raft_consensus.cc:606] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:54.000243 15795 raft_consensus.cc:614] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:54.000834 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:53.922957 20870 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:54.008244 15645 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:54.009337 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.013461 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:54.014729 20859 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.015034 20870 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.019023 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:53.953670 20943 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:54.015331 20859 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:54.016187 20952 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:53.939698 20426 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 13:07:54.031874 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.034307 15714 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:54.045421 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.061062 15722 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:54.039997 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:54.009727 15610 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.550s (SENT)
I20260709 13:07:53.938385 20846 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.071924 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.072124 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.072347 15790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2813) took 1529 ms. Trace:
I20260709 13:07:54.024667 20870 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:54.082324 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:54.083076 15717 raft_consensus.cc:2368] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13.
I20260709 13:07:53.999300 20750 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:54.074930 15790 rpcz_store.cc:276] 0709 13:07:52.543219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.420373 (+877154us) service_pool.cc:224] Handling call
0709 13:07:53.445877 (+ 25504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.503457 (+ 57580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.070320 (+566863us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b54001f81d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:54.072290 (+  1970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57858432}
I20260709 13:07:54.034915 20943 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.088897 16333 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.003s
I20260709 13:07:54.091970 16333 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:54.089726 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:54.027742 20956 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:54.016834 20972 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.090202 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.100178 15647 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:54.101116 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:54.061102 20879 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:54.102128 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.104712 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:54.105629 15645 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.109850 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:54.042248 20848 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:54.085644 20870 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:54.116088 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 119230us
W20260709 13:07:54.139787 15610 leader_election.cc:336] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.596s (SENT)
I20260709 13:07:54.095595 20943 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.142256 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.156170 15645 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
W20260709 13:07:54.116792 20844 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.006s
I20260709 13:07:54.030782 20892 consensus_queue.cc:237] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.159720 15611 leader_election.cc:400] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13.
I20260709 13:07:54.177683 15611 leader_election.cc:403] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.157294 16298 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:54.175169 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.098165 20993 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:54.179636 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.108940 20970 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:54.183501 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.182371 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:54.178133 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:54.155217 20571 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.006s
I20260709 13:07:54.143824 20879 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:54.184144 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:54.086699 20912 consensus_queue.cc:237] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.190482 15647 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:54.178416 20880 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:54.210184 20969 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:54.210333 20974 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:54.193542 20997 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:54.090407 20889 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:54.213795 20968 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:07:54.174448 20768 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:07:54.189788 20928 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:54.182013 20956 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13.
I20260709 13:07:54.183007 20844 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.195037 15645 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.209163 15644 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.209429 20846 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:54.216756 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 780) took 1195 ms. Trace:
I20260709 13:07:54.217478 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:54.217845 16333 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:54.196357 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56598.7us
W20260709 13:07:54.261960 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44567.8us
I20260709 13:07:54.206095 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2837) took 1097 ms. Trace:
I20260709 13:07:54.262437 15787 rpcz_store.cc:276] 0709 13:07:53.108778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.152653 (+ 43875us) service_pool.cc:224] Handling call
0709 13:07:54.205925 (+1053272us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001388d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:54.206040 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490564992}
I20260709 13:07:54.175135 20891 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:54.206550 15794 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:54.239013 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2830) took 1367 ms. Trace:
W20260709 13:07:54.250953 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 232088us
W20260709 13:07:54.198220 20971 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:07:54.200769 20780 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.002s
W20260709 13:07:54.197414 20986 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:07:54.206944 20979 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:07:54.262063 15610 leader_election.cc:336] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.613s (SENT)
I20260709 13:07:54.198318 15647 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:54.179916 20951 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:54.252558 16297 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:07:54.219349 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.260474 15789 rpcz_store.cc:276] 0709 13:07:53.021848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.460460 (+438612us) service_pool.cc:224] Handling call
0709 13:07:53.460782 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.469835 (+  9053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.469866 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.470403 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.848463 (+378060us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:53.848509 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.848608 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.216563 (+367955us) raft_consensus.cc:1685] finished
0709 13:07:54.216581 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.216705 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8390,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":377638,"threads_started":1,"wal-append.queue_time_us":592304}
I20260709 13:07:54.195119 20962 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:54.191066 20571 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:54.268507 15760 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.575s (SENT) [suppressed 62 similar messages]
I20260709 13:07:54.205215 20829 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:54.269692 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:54.196115 20859 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:54.270483 16330 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:54.368778 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 99178.2us
I20260709 13:07:54.268644 15793 rpcz_store.cc:276] 0709 13:07:52.871847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.428509 (+556662us) service_pool.cc:224] Handling call
0709 13:07:53.428797 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.895227 (+466430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.237240 (+342013us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540021b6d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:54.238957 (+  1717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038267648}
I20260709 13:07:54.195382 20959 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:54.176687 20999 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:07:54.374003 20846 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.374660 20846 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.375010 20846 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.375856 20571 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:54.196115 20972 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:54.376927 15641 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:54.276418 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:54.379022 15713 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.282447 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:54.381109 16300 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.639s (SENT)
I20260709 13:07:54.255280 20969 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:54.344911 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:54.400238 16334 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:54.273579 20801 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.272588 20960 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.402182 20960 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.403374 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:54.404451 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:54.369685 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:54.279703 20780 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.354111 20996 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.208642 20926 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:54.427310 21000 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:54.427596 20926 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:54.428454 15638 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:54.401131 20801 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.368432 20829 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:54.419564 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49977us
I20260709 13:07:54.424126 20965 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:54.424325 20997 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:54.429594 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.368920 21003 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:54.450692 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 188638us
W20260709 13:07:54.477319 15610 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.656s (SENT)
I20260709 13:07:54.405905 20999 consensus_queue.cc:1243] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:54.349661 20848 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:54.427381 20975 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.525s	user 0.000s	sys 0.003s
I20260709 13:07:54.420025 20959 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.490167 20844 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:54.491892 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:54.411039 20969 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:54.492209 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44090.6us
I20260709 13:07:54.503630 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:54.489064 20780 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:54.352634 20879 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:54.508843 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 240162us
I20260709 13:07:54.510867 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:54.512341 15688 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:54.496881 20995 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:54.438735 20571 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:07:54.493770 21003 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:54.544344 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2844) took 1251 ms. Trace:
I20260709 13:07:54.509529 20928 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:54.549044 15794 rpcz_store.cc:276] 0709 13:07:53.283482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.463897 (+180415us) service_pool.cc:224] Handling call
0709 13:07:54.206159 (+742262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.268304 (+ 62145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.529589 (+261285us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54001388d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:54.534894 (+  5305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706346880}
I20260709 13:07:54.519475 20866 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.438503 20996 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.567410 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:54.529300 20997 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.520102 20970 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.529196 20780 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.520146 20960 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:54.483668 20965 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.542891 20844 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.559944 20962 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:54.545928 20994 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.540258 20885 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:54.597481 20994 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:54.596692 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.573936 20935 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:54.575469 20997 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.602097 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:54.605513 16334 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.579795 20780 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.596586 21004 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:07:54.582540 20844 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.623862 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56523.9us
I20260709 13:07:54.624900 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:54.575078 20897 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:54.528139 20829 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:54.628614 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.636302 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.602308 20885 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:54.608031 20509 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.144s	user 0.013s	sys 0.000s
I20260709 13:07:54.608055 20997 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:54.645054 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 126655us
I20260709 13:07:54.601895 20935 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:54.579255 20928 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.622788 20780 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.649336 15643 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:07:54.656479 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:54.656769 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:54.657236 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:54.650454 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 397904us
I20260709 13:07:54.627903 20844 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.652326 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2325) took 1164 ms. Trace:
I20260709 13:07:54.606546 20960 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:54.657344 15795 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:54.643702 16334 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:54.658149 15788 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:07:54.658507 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:54.657200 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:54.679349 20987 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:07:54.684190 15793 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:54.652580 20829 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.654917 20509 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.718619 15790 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.719063 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:54.659649 20951 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.698114 15795 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.723984 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:54.723213 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2326) took 1152 ms. Trace:
I20260709 13:07:54.724871 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:07:54.729200 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 104397us
W20260709 13:07:54.770237 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 113107us
I20260709 13:07:54.768143 15642 rpcz_store.cc:276] 0709 13:07:53.568367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.568566 (+   199us) service_pool.cc:224] Handling call
0709 13:07:53.590915 (+ 22349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.591207 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:54.659271 (+1068064us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.720546 (+ 61275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.720611 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.720676 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.720753 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.720901 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1067337,"prepare.queue_time_us":1071499,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":43,"raft.queue_time_us":13969,"spinlock_wait_cycles":100844288,"thread_start_us":46912,"threads_started":1}
W20260709 13:07:54.763975 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54307.5us
I20260709 13:07:54.771283 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:54.772065 15647 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.646946 21025 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:07:54.707326 20880 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:54.769423 20975 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:54.788734 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:54.816998 15714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.019s	sys 0.034s
W20260709 13:07:54.821213 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 160930us
W20260709 13:07:54.823848 15714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.019s	sys 0.035s
I20260709 13:07:54.767645 20951 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.774092 21020 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.835557 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64937.4us
I20260709 13:07:54.842450 15790 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:07:54.821292 20934 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
I20260709 13:07:54.846390 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:54.790679 20969 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:54.829934 21012 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:07:54.645551 21003 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.850255 15792 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:54.857731 15789 raft_consensus.cc:606] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:54.858265 15789 raft_consensus.cc:614] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:54.822582 20801 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:54.823725 21024 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:54.664448 20962 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.724211 21028 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 13:07:54.843796 20994 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:54.865931 20930 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.925s	user 0.012s	sys 0.000s
I20260709 13:07:54.857247 20509 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.842032 20880 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:54.863456 20912 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:07:54.890883 21017 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:07:54.875806 20801 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.891834 20785 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:54.878273 21010 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:07:54.895146 20981 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:54.875638 20934 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:54.895953 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:54.896216 21026 log.cc:927] Time spent T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:07:54.897015 21018 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:07:54.899812 20858 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.903115 21032 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:54.937677 20426 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.904639 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2517) took 1076 ms. Trace:
I20260709 13:07:54.906014 20540 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:54.906483 21014 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:55.015146 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2322) took 1541 ms. Trace:
I20260709 13:07:54.906684 15639 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:54.878402 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:54.919668 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2846) took 1564 ms. Trace:
W20260709 13:07:54.920550 20992 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.524s	user 0.000s	sys 0.002s
I20260709 13:07:54.860278 20840 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.724581 20935 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:54.906872 21016 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:07:54.868743 20965 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:54.942117 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 106976us
I20260709 13:07:54.984992 20801 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:54.880386 20943 consensus_meta.cc:287] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
W20260709 13:07:54.973067 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 102442us
I20260709 13:07:55.030540 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:54.980144 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 209029us
I20260709 13:07:54.985390 16330 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.851099 21020 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.992511 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.000978 15638 rpcz_store.cc:276] 0709 13:07:53.827861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.861390 (+ 33529us) service_pool.cc:224] Handling call
0709 13:07:54.904423 (+1043033us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540045f1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:54.904579 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300992768}
I20260709 13:07:55.017028 15714 raft_consensus.cc:2376] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12. Re-sending same reply.
I20260709 13:07:55.017035 15792 rpcz_store.cc:276] 0709 13:07:53.354965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.493519 (+138554us) service_pool.cc:224] Handling call
0709 13:07:53.493981 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.857507 (+1363526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.919302 (+ 61795us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540010ca54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:54.919583 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117972224}
I20260709 13:07:55.012883 20970 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:55.020224 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.015573 15640 rpcz_store.cc:276] 0709 13:07:53.473558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.473693 (+   135us) service_pool.cc:224] Handling call
0709 13:07:53.529368 (+ 55675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.856902 (+327534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.014904 (+1158002us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54000aa354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:55.015089 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750945664}
I20260709 13:07:54.974793 20934 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:55.050336 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:54.932073 20930 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:54.877310 21024 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.032930 15719 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16. Re-sending same reply.
I20260709 13:07:55.052971 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.074470 15722 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.010191 20426 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:55.078032 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:55.077469 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:55.010932 20858 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.080390 20935 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.086400 20858 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.087301 20842 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:55.088323 20785 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:55.004349 20996 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.080677 20994 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.089978 21010 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:55.091126 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:07:55.092929 20870 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.933s	user 0.010s	sys 0.000s
I20260709 13:07:55.093268 20848 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.093971 20848 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.096093 20848 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.096357 20930 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.029893 20840 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.043776 20943 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:55.099390 20846 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.002s
I20260709 13:07:55.099563 20943 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.100010 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3203) took 1047 ms. Trace:
I20260709 13:07:55.099845 20846 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.101234 15716 raft_consensus.cc:2368] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
I20260709 13:07:55.100500 20801 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.101423 15721 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:55.102877 21024 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.100458 15715 rpcz_store.cc:276] 0709 13:07:54.053104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.212684 (+159580us) service_pool.cc:224] Handling call
0709 13:07:54.213036 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:54.213406 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.213437 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.214074 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 13:07:54.492710 (+278636us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:54.497596 (+  4886us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.507847 (+ 10251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.507939 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.099764 (+591825us) raft_consensus.cc:1685] finished
0709 13:07:55.099788 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.099946 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4641,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4392,"raft.queue_time_us":16551,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":21702,"thread_start_us":250560,"threads_started":1,"wal-append.queue_time_us":365024}
I20260709 13:07:55.104743 15794 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:55.106923 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:55.108448 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:55.109750 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.110430 15715 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.124794 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.129585 15714 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.093336 20870 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.132550 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:55.145702 15715 raft_consensus.cc:2410] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:55.141436 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:55.112514 21024 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.128932 20965 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:55.128518 21028 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.130578 20848 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:55.169965 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:55.169196 21036 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:07:55.081338 20970 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.159019 15718 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.159915 15715 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:55.148466 21025 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.103996 20426 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.124402 20930 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:55.149660 20879 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.170974 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:55.174851 15647 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:55.171252 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:55.172372 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58629.3us
I20260709 13:07:55.188391 15795 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:55.173370 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65020.6us
I20260709 13:07:55.188316 15790 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:55.170636 15792 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:55.189834 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:55.171959 21029 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:07:55.244422 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 103062us
W20260709 13:07:55.238062 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 49252.5us
I20260709 13:07:55.248680 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:55.206298 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.250741 15795 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:55.186683 20879 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:55.256199 15789 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:55.172631 21010 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:55.145533 20934 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.178375 21025 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.282119 21025 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.288094 21056 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.288674 21056 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:55.289083 21056 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.290156 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 635) took 1337 ms. Trace:
I20260709 13:07:55.290721 15644 rpcz_store.cc:276] 0709 13:07:53.952323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.261020 (+308697us) service_pool.cc:224] Handling call
0709 13:07:54.280957 (+ 19937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.281349 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:54.281389 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.344363 (+ 62974us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.627436 (+283073us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.627476 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.627557 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.289827 (+662270us) raft_consensus.cc:1685] finished
0709 13:07:55.289856 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.290070 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7990,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4221,"thread_start_us":247627,"threads_started":1,"wal-append.queue_time_us":492940}
I20260709 13:07:55.294209 21020 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.193958 20846 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.298246 20846 consensus_queue.cc:1059] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:55.170496 20965 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.303025 20934 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.263983 20426 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.315793 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.316705 15716 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:55.194615 20930 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.320178 21056 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.321058 20930 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.187196 21003 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.179493 21024 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:55.266940 20970 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.346765 21024 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.349118 21024 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.350075 20969 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.350827 15643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 2328) took 1662 ms (client timeout 1951 ms). Trace:
I20260709 13:07:55.350612 20969 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:55.351209 15643 rpcz_store.cc:269] 0709 13:07:53.688120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.689910 (+  1790us) service_pool.cc:224] Handling call
0709 13:07:55.350649 (+1660739us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54003ec1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:55.350760 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204363648}
I20260709 13:07:55.352375 20972 raft_consensus.cc:3055] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:55.352744 20972 raft_consensus.cc:740] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:55.353008 20969 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.353549 20972 consensus_queue.cc:260] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.273272 20540 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:55.176352 20848 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.354997 20540 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.356755 20848 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.258184 20879 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.357652 20540 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:55.274811 20997 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
W20260709 13:07:55.276098 20780 consensus_meta.cc:287] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.612s	user 0.003s	sys 0.004s
I20260709 13:07:55.361850 20997 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.362706 20780 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.363473 21010 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.364843 20780 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.276427 20866 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.332563 21003 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.277595 20870 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.279115 20880 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.331897 16298 leader_election.cc:400] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
I20260709 13:07:55.366637 21003 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.366967 16298 leader_election.cc:403] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.333819 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.368287 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.369104 15716 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.370035 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.371155 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.372130 20879 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:55.374217 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2518) took 1532 ms (client timeout 2036 ms). Trace:
W20260709 13:07:55.374650 15641 rpcz_store.cc:269] 0709 13:07:53.842049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.907371 (+ 65322us) service_pool.cc:224] Handling call
0709 13:07:55.374026 (+1466655us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54000e88d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:55.374161 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069805824}
I20260709 13:07:55.377010 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 636) took 1424 ms. Trace:
I20260709 13:07:55.377393 15639 rpcz_store.cc:276] 0709 13:07:53.952682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.345809 (+393127us) service_pool.cc:224] Handling call
0709 13:07:54.906425 (+560616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.016502 (+110077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.376814 (+360312us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540045f1d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:55.376950 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268627200}
I20260709 13:07:55.379571 20910 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.379624 20879 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.380088 20910 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:55.384384 21008 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.810s	user 0.003s	sys 0.000s
I20260709 13:07:55.385258 16330 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:55.326205 20965 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.365650 21010 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.309185 21025 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.438772 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.439528 21025 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.439690 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:55.340332 21056 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.440117 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.341454 20988 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:55.441229 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.441402 20988 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:55.441954 15719 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.442629 20988 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.444433 20988 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.445041 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 634) took 1493 ms. Trace:
I20260709 13:07:54.660344 15646 rpcz_store.cc:276] 0709 13:07:53.487819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.488062 (+   243us) service_pool.cc:224] Handling call
0709 13:07:53.535972 (+ 47910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.536236 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:53.560153 (+ 23917us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.784176 (+224023us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b180021a840. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:54.639687 (+855511us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b180021a840. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:07:54.644094 (+  4407us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.651945 (+  7851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.652011 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:54.652067 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.652158 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.652270 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1227809,"prepare.queue_time_us":23784,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":24043,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":12531,"spinlock_wait_cycles":19567872}
I20260709 13:07:55.364758 20997 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.365926 20866 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:55.277498 21034 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:07:55.278033 21039 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:55.448416 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.449026 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.450227 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.452081 20829 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:55.452572 20829 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.454490 20829 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.454964 20829 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:55.455574 15716 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:55.456465 15762 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:55.457227 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.457459 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.457947 21052 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.286s	user 0.000s	sys 0.002s
I20260709 13:07:55.458175 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:55.458420 20959 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:55.458765 20959 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:55.459565 20959 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:55.460330 21051 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:07:55.460642 20959 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.460872 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:55.461160 20891 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:55.460775 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 212323us
W20260709 13:07:55.462332 21044 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:07:55.463302 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:55.445516 15645 rpcz_store.cc:276] 0709 13:07:53.952004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.254480 (+302476us) service_pool.cc:224] Handling call
0709 13:07:54.254817 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.255052 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:54.830700 (+575648us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.975987 (+145287us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.021546 (+ 45559us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b180035a160. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:07:55.444429 (+422883us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b180035a160. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:07:55.444605 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.444670 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:55.444737 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.444835 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.444976 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417886,"prepare.queue_time_us":471748,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":9148,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"spinlock_wait_cycles":29735424,"thread_start_us":271930,"threads_started":2,"wal-append.queue_time_us":183230}
I20260709 13:07:55.465096 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:55.465935 20956 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:55.466542 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:55.468096 20956 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.469219 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:55.470043 20509 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:55.470649 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:55.471282 15639 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:55.471485 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2088) took 1657 ms. Trace:
I20260709 13:07:55.471895 15720 rpcz_store.cc:276] 0709 13:07:53.814209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.814395 (+   186us) service_pool.cc:224] Handling call
0709 13:07:55.471279 (+1656884us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540017a7d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:55.471425 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2478758272}
I20260709 13:07:55.473021 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:55.473709 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:55.473057 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.474295 15645 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.474486 15720 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:55.475322 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.475385 15717 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:55.475864 15720 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:55.476647 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.313257 20951 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.477347 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3200) took 1428 ms. Trace:
I20260709 13:07:55.482980 20509 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:55.484098 15717 rpcz_store.cc:276] 0709 13:07:54.049101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.088187 (+ 39086us) service_pool.cc:224] Handling call
0709 13:07:55.475048 (+1386861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.475901 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.477113 (+  1212us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540017a7d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:55.477269 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133739392}
I20260709 13:07:55.477582 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.485206 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.485755 15720 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:55.486696 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.487591 20866 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.487775 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.488574 15720 raft_consensus.cc:2368] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11.
I20260709 13:07:55.489367 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.489663 15722 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:55.489933 15720 raft_consensus.cc:2376] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12. Re-sending same reply.
I20260709 13:07:55.321606 20930 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.467774 20840 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.490581 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.559780 15722 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.480865 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:55.436872 20844 consensus_meta.cc:287] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
I20260709 13:07:55.380932 20910 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.495805 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3194) took 1461 ms. Trace:
I20260709 13:07:55.563181 15718 rpcz_store.cc:276] 0709 13:07:54.034031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.034164 (+   133us) service_pool.cc:224] Handling call
0709 13:07:54.034433 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.173583 (+1139150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.495507 (+321924us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003bae54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:55.495733 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585803008}
I20260709 13:07:55.564710 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.496837 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3196) took 1455 ms. Trace:
W20260709 13:07:55.498411 21050 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:07:55.500355 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:55.500689 16329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 699) took 1244 ms (client timeout 1532 ms). Trace:
W20260709 13:07:55.581480 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 81226.3us
W20260709 13:07:55.581348 16329 rpcz_store.cc:269] 0709 13:07:54.256529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.256671 (+   142us) service_pool.cc:224] Handling call
0709 13:07:55.500467 (+1243796us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540066eed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:55.500601 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620437248}
W20260709 13:07:55.501109 21045 log.cc:927] Time spent T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:07:55.565913 15718 raft_consensus.cc:2368] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:55.502152 20862 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:07:55.502470 21046 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 13:07:55.502655 20935 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:55.503726 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:55.504225 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.505818 20858 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:55.522501 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 82860.9us
I20260709 13:07:55.584921 15717 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:07:55.525357 21025 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.442664 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.548012 15645 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
W20260709 13:07:55.551944 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 224496us
W20260709 13:07:55.554150 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.562300 15647 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.561043 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.603574 15722 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.604745 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:55.604758 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.605350 15718 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.579408 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.607179 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:55.608151 15720 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:55.579902 16330 raft_consensus.cc:1240] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:07:55.566301 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 109897us
I20260709 13:07:55.580510 15721 rpcz_store.cc:276] 0709 13:07:54.041695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.042592 (+   897us) service_pool.cc:224] Handling call
0709 13:07:54.042983 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.102384 (+1059401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.496579 (+394195us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540017b1d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:55.496775 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433741824}
I20260709 13:07:55.552726 21037 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.500640 21003 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:55.585345 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 338292us
I20260709 13:07:55.589025 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:55.598529 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 94903us
I20260709 13:07:55.609619 16298 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:55.619961 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:55.565397 21040 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:55.692906 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3215) took 1057 ms. Trace:
I20260709 13:07:55.620263 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:07:55.694690 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 74783.1us
I20260709 13:07:55.699347 15722 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:55.699749 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:55.586362 20988 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:55.613076 15794 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:55.586760 21010 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:55.700878 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:55.620242 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:55.726503 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 106332us
W20260709 13:07:55.701989 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.704798 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 95255.4us
I20260709 13:07:55.699151 15720 rpcz_store.cc:276] 0709 13:07:54.635102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.692083 (+1056981us) service_pool.cc:224] Handling call
0709 13:07:55.692387 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.692574 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.692605 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.692649 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:55.692682 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.692737 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.692852 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.706179 15647 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:07:55.715246 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.047s
I20260709 13:07:55.718609 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3216) took 1077 ms. Trace:
I20260709 13:07:55.579300 20866 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:55.722324 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 133403us
I20260709 13:07:55.587203 20858 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:55.769999 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.017s	sys 0.055s
I20260709 13:07:55.770087 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:55.773540 15685 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:55.588428 21043 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.769026 15722 rpcz_store.cc:276] 0709 13:07:54.641444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.692682 (+1051238us) service_pool.cc:224] Handling call
0709 13:07:55.692941 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.718301 (+ 25360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.718537 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.609856 20910 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.609452 20889 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:55.693109 21013 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:55.782498 15795 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.580015 20930 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.786819 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:55.791137 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:55.588214 20885 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
W20260709 13:07:55.792747 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 172530us
I20260709 13:07:55.758831 15718 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:55.580049 20844 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.717459 20988 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.794947 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:55.588162 20862 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:55.816401 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 46371.7us
I20260709 13:07:55.780587 21048 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.715301 20997 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.830139 20997 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.830262 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:55.830632 20997 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.831118 16333 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
W20260709 13:07:55.769243 21054 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:07:55.783789 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:55.832862 15789 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:55.792760 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:55.782169 15722 pending_rounds.cc:85] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 10
I20260709 13:07:55.833420 15722 pending_rounds.cc:107] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:07:55.803108 15720 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.834120 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2092) took 1184 ms. Trace:
I20260709 13:07:55.834445 15720 rpcz_store.cc:276] 0709 13:07:54.649609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.778318 (+1128709us) service_pool.cc:224] Handling call
0709 13:07:55.778750 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.833882 (+ 55132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.834069 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.768746 21031 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.804710 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2091) took 1156 ms. Trace:
I20260709 13:07:55.715327 21037 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.837775 15717 rpcz_store.cc:276] 0709 13:07:54.648771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.769141 (+1120370us) service_pool.cc:224] Handling call
0709 13:07:55.792001 (+ 22860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.804360 (+ 12359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.804394 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.804437 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:55.804481 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.804539 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.804656 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.728183 21040 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.719955 20509 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.813000 15795 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:55.813522 15610 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:55.778901 20870 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:55.776594 20840 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.779074 20848 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:55.817174 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:55.779927 20866 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.790005 20970 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:55.817991 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:55.837720 21031 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.818915 15718 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:55.905408 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 776) took 1255 ms. Trace:
I20260709 13:07:55.905849 15718 rpcz_store.cc:276] 0709 13:07:54.650207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.812189 (+1161982us) service_pool.cc:224] Handling call
0709 13:07:55.812686 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.905094 (+ 92408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.905338 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.596843 20959 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.206s
I20260709 13:07:55.824551 21024 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.816429 20988 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.825124 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:07:55.791996 20426 raft_consensus.cc:2764] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:07:55.833691 15722 raft_consensus.cc:2889] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:55.720180 21056 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:55.796375 21010 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:55.834626 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:55.922359 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 87786.8us
I20260709 13:07:55.811717 21058 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.847582 16300 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.056s
W20260709 13:07:55.926398 16300 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.016s	sys 0.056s
W20260709 13:07:55.926729 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 604661us
W20260709 13:07:55.927309 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.924062 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:55.788681 20960 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:55.874027 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.797518 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:55.833637 20885 consensus_queue.cc:1243] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:55.931876 15790 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:55.911057 21031 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.837916 21039 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:55.811902 21013 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.971977 21013 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.911219 20870 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:55.976153 20866 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.975759 20870 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.977780 20844 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:55.915443 15793 raft_consensus.cc:606] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:55.917459 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.983948 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.915179 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 101749us
I20260709 13:07:55.920367 21037 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:55.921350 20970 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:55.900200 20858 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.924073 20935 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:55.903932 20891 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.907306 21025 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:55.901157 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 84048.7us
I20260709 13:07:55.940325 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:55.931005 20960 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:56.023357 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:56.024470 16328 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:07:55.963630 20862 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:55.985355 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:55.835700 21048 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.844283 20962 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:07:55.849031 20509 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:55.998224 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:55.916998 16297 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:55.987725 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:55.999655 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:56.001040 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:55.922183 21056 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:55.937237 20840 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.900658 20848 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.010176 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:55.936697 21058 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:55.963140 21009 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:56.017019 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:56.027431 20858 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.028503 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:56.030920 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.003885 20935 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:56.038908 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 125348us
I20260709 13:07:56.002292 21013 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:56.041931 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:07:56.017198 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 77017.1us
I20260709 13:07:56.028081 20960 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:56.032151 20844 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:56.031489 20891 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:56.063913 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.064234 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:56.077327 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.065498 20935 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.043745 21056 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.044773 20768 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.075938 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:56.043767 21060 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.044075 20840 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:56.081113 15720 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:56.078008 21020 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.116850 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3218) took 1465 ms. Trace:
I20260709 13:07:56.083240 16326 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:56.083319 20935 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.083581 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:07:56.085884 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57446.8us
I20260709 13:07:56.117388 15720 rpcz_store.cc:276] 0709 13:07:54.651853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.080499 (+1428646us) service_pool.cc:224] Handling call
0709 13:07:56.080886 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.116504 (+ 35618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.116778 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.118554 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:56.120590 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:56.076691 20970 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.092772 16325 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:07:56.111702 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.118628 20840 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.067619 21009 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:56.130501 21009 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.076918 20896 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.125686 15720 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:56.125059 21067 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:56.129524 21040 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.133656 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3219) took 1473 ms. Trace:
I20260709 13:07:56.078143 20866 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:56.135456 15720 rpcz_store.cc:276] 0709 13:07:54.660485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.125200 (+1464715us) service_pool.cc:224] Handling call
0709 13:07:56.125522 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.133415 (+  7893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.133603 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.117349 20844 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:56.115979 20891 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.068020 21015 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:07:56.044451 21010 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.134374 20930 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.122678 20426 raft_consensus.cc:2764] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:07:56.205725 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.074898 21013 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:56.191365 21069 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:07:56.158844 21020 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.133208 20885 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:56.158245 20926 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:56.249008 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 128494us
I20260709 13:07:56.118491 21060 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.132825 20959 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:07:56.198730 21040 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.211215 15720 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:56.278221 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3220) took 1396 ms. Trace:
I20260709 13:07:56.278702 15720 rpcz_store.cc:276] 0709 13:07:54.882002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.187313 (+1305311us) service_pool.cc:224] Handling call
0709 13:07:56.210749 (+ 23436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.277845 (+ 67096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.278144 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.281622 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 784) took 1355 ms. Trace:
I20260709 13:07:56.282187 15717 rpcz_store.cc:276] 0709 13:07:54.926288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.249792 (+1323504us) service_pool.cc:224] Handling call
0709 13:07:56.281097 (+ 31305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.281286 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.281311 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.281350 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:56.281392 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.281445 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.281568 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.187659 20866 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:56.238860 21066 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:07:56.259286 20956 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:56.197666 20891 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.303750 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 786) took 1348 ms. Trace:
I20260709 13:07:56.311172 15720 rpcz_store.cc:276] 0709 13:07:54.955453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.279910 (+1324457us) service_pool.cc:224] Handling call
0709 13:07:56.303264 (+ 23354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.303437 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.303459 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.303500 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:56.303536 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.303587 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.303694 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:56.312043 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59872.4us
I20260709 13:07:56.275714 20896 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:56.258471 20889 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:07:56.248672 20926 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:56.275000 20862 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:56.348065 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3207) took 2257 ms. Trace:
W20260709 13:07:56.371229 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 307591us
W20260709 13:07:56.373075 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.368522 15713 rpcz_store.cc:276] 0709 13:07:54.090503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.394447 (+303944us) service_pool.cc:224] Handling call
0709 13:07:54.395091 (+   644us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:54.412583 (+ 17492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.412625 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.423544 (+ 10919us) log.cc:844] Serialized 52 byte log entry
0709 13:07:55.469518 (+1045974us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800086ce0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:07:55.832331 (+362813us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:56.317680 (+485349us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.318003 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.318080 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.318119 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:56.347749 (+ 29630us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.348005 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16908,"raft.queue_time_us":23433,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":53236,"spinlock_wait_cycles":23151488,"thread_start_us":834574,"threads_started":2,"wal-append.queue_time_us":1549038}
I20260709 13:07:56.378757 15713 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:56.379397 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2102) took 1134 ms. Trace:
I20260709 13:07:56.348017 21048 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:56.382923 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:56.374053 21066 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:56.371652 20926 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.306444 20844 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:56.378463 20997 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.003s
I20260709 13:07:56.379745 15713 rpcz_store.cc:276] 0709 13:07:55.245143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.375559 (+1130416us) service_pool.cc:224] Handling call
0709 13:07:56.375878 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.379150 (+  3272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.379345 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.348341 20426 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:07:56.392479 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.348521 20951 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:56.349172 20829 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:07:56.380658 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 297140us
I20260709 13:07:56.377584 20509 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:56.398600 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:56.403221 15760 leader_election.cc:400] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11.
I20260709 13:07:56.403748 15760 leader_election.cc:403] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.372128 20885 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:56.412686 15793 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:56.391701 20848 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:56.398125 20862 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:56.423249 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:56.403450 21020 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:56.424765 20862 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:56.427860 21039 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:56.428488 21060 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.428360 20862 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:56.429972 21074 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:56.431849 21078 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11.
I20260709 13:07:56.434223 21013 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:56.436951 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:56.438235 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:56.439688 15760 leader_election.cc:400] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13.
I20260709 13:07:56.391537 21015 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:07:56.454825 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.454914 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2343) took 1003 ms. Trace:
I20260709 13:07:56.451570 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:56.403877 20997 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:56.452718 21070 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:07:56.455435 15640 rpcz_store.cc:276] 0709 13:07:55.451791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.465040 (+ 13249us) service_pool.cc:224] Handling call
0709 13:07:55.465339 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.465680 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:55.479524 (+ 13844us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.717578 (+238054us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.785511 (+ 67933us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.786373 (+   862us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.786434 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.786558 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.454718 (+668160us) raft_consensus.cc:1685] finished
0709 13:07:56.454738 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.454858 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40461,"prepare.queue_time_us":13919,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":22831,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":40947,"thread_start_us":215036,"threads_started":1,"wal-append.queue_time_us":359487}
W20260709 13:07:56.480890 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 138609us
W20260709 13:07:56.475420 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 78113.6us
W20260709 13:07:56.476164 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.478303 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:56.458549 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:56.487848 15688 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.579s (SENT)
I20260709 13:07:56.488562 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:56.489554 21060 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.454398 21040 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:56.429679 20862 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.501228 15719 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 13. Ops: []
I20260709 13:07:56.461925 21078 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.458179 21013 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.507550 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 780) took 1856 ms. Trace:
W20260709 13:07:56.497377 20988 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.003s
W20260709 13:07:56.512712 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.527904 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 782) took 1629 ms. Trace:
I20260709 13:07:56.523566 16334 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.522452 15718 rpcz_store.cc:276] 0709 13:07:54.651189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.077034 (+1425845us) service_pool.cc:224] Handling call
0709 13:07:56.077381 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.079531 (+  2150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.079577 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.080202 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.397118 (+316916us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:56.505561 (+108443us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.505965 (+   404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.506064 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.506120 (+    56us) raft_consensus.cc:1685] finished
0709 13:07:56.507361 (+  1241us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.507500 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25070,"prepare.queue_time_us":33191,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":14563,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":34542,"thread_start_us":285705,"threads_started":2,"wal-append.queue_time_us":309961}
I20260709 13:07:56.545074 16333 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:56.453586 21020 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.451311 20960 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.528352 15716 rpcz_store.cc:276] 0709 13:07:54.898349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.189451 (+1291102us) service_pool.cc:224] Handling call
0709 13:07:56.190214 (+   763us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:56.190693 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.190733 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:56.196687 (+  5954us) log.cc:844] Serialized 52 byte log entry
0709 13:07:56.392106 (+195419us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:56.527317 (+135211us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.527595 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.527671 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.527710 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:56.527721 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.527848 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9947,"prepare.queue_time_us":37993,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":118,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5545,"thread_start_us":224896,"threads_started":2,"wal-append.queue_time_us":172126}
I20260709 13:07:56.552929 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 775) took 1903 ms. Trace:
I20260709 13:07:56.500511 20426 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:07:56.553431 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2115) took 1249 ms. Trace:
I20260709 13:07:56.554497 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:56.557260 15716 rpcz_store.cc:276] 0709 13:07:55.303576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.552533 (+1248957us) service_pool.cc:224] Handling call
0709 13:07:56.552887 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.553084 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.553114 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.553170 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:56.553214 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.553270 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.553375 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.559976 15716 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:56.560766 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3222) took 1103 ms. Trace:
I20260709 13:07:56.561103 15716 rpcz_store.cc:276] 0709 13:07:55.457035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.559279 (+1102244us) service_pool.cc:224] Handling call
0709 13:07:56.559701 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.560488 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.560705 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.496917 20959 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:56.531816 21013 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.564481 20997 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:56.564877 21013 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.565490 15718 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:56.561015 20891 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.566749 20960 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:56.566780 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.579273 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.580595 15645 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 12: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:56.569160 21031 consensus_meta.cc:287] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.005s
I20260709 13:07:56.547931 20988 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.576004 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.576195 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.581950 15643 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:56.576723 16329 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:07:56.576877 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3214) took 1949 ms. Trace:
I20260709 13:07:56.577663 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.585476 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.582696 15715 rpcz_store.cc:276] 0709 13:07:54.627700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.180971 (+553271us) service_pool.cc:224] Handling call
0709 13:07:55.181431 (+   460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:55.519763 (+338332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.519791 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:55.551957 (+ 32166us) log.cc:844] Serialized 52 byte log entry
0709 13:07:56.035771 (+483814us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:56.035818 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.035889 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.576647 (+540758us) raft_consensus.cc:1685] finished
0709 13:07:56.576668 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.576822 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91256,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":57,"thread_start_us":763138,"threads_started":2,"wal-append.queue_time_us":601930}
W20260709 13:07:56.605803 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.611083 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.612084 15645 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:56.614861 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.617395 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.621057 15643 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:56.623672 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.555331 15722 rpcz_store.cc:276] 0709 13:07:54.649966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.781563 (+1131597us) service_pool.cc:224] Handling call
0709 13:07:55.781956 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.919348 (+137392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.919391 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.919837 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.172214 (+252377us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:56.551307 (+379093us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.552606 (+  1299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.552679 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.552726 (+    47us) raft_consensus.cc:1685] finished
0709 13:07:56.552742 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.552877 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":133641,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":232,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6808,"thread_start_us":485806,"threads_started":2,"wal-append.queue_time_us":388558}
W20260709 13:07:56.625209 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 173733us
I20260709 13:07:56.626391 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:56.621645 15643 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:56.587078 21031 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.631435 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.632381 21031 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:56.637161 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.640746 15645 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:07:56.556304 20768 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:07:56.655488 15639 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:56.656666 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.657397 15639 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:56.644670 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.658720 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.648754 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.653644 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:56.621217 20858 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:07:56.661397 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.666554 15644 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:56.669694 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:56.604612 20866 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:56.628275 15643 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.671175 15638 raft_consensus.cc:2368] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16.
I20260709 13:07:56.676137 15643 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.674482 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.677031 15639 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.674638 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.671514 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.677773 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.680210 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.680389 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.683327 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.685024 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.685921 15642 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:56.686057 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.686821 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.687482 15642 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:07:56.686955 15638 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:56.689349 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:56.689577 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 158084us
I20260709 13:07:56.689667 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:56.667276 21024 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:07:56.656235 20960 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.675894 21081 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.722340 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.725683 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.723341 15642 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:56.728866 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:56.728834 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 208931us
I20260709 13:07:56.730376 15642 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:56.730950 15642 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:56.733072 15646 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:56.694813 20858 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.692734 21040 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:56.702531 21024 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.732018 15642 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:56.735047 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65475.9us
I20260709 13:07:56.745697 15642 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:56.735707 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 242290us
I20260709 13:07:56.732051 15645 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:56.748795 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.751324 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3224) took 1284 ms. Trace:
I20260709 13:07:56.753082 15715 rpcz_store.cc:276] 0709 13:07:55.466782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.587054 (+1120272us) service_pool.cc:224] Handling call
0709 13:07:56.587393 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.587630 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:56.610098 (+ 22468us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.750675 (+140577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.750757 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:56.750877 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.751005 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.751212 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65462,"prepare.queue_time_us":33756,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"thread_start_us":139958,"threads_started":1}
I20260709 13:07:56.755678 15646 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:56.758123 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.765647 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.772269 16334 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:56.775452 21082 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:07:56.775887 20988 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:56.778043 21094 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.783399 15641 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:56.771852 20844 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:56.782368 21101 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:07:56.790431 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:56.791951 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:56.743418 20858 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.794304 15639 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:07:56.796271 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.793673 20840 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.000s
I20260709 13:07:56.804273 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3228) took 1336 ms. Trace:
W20260709 13:07:56.785669 21056 consensus_meta.cc:287] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.005s
I20260709 13:07:56.811245 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2100) took 1610 ms. Trace:
I20260709 13:07:56.810993 21040 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.813481 21093 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:56.813798 21081 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:56.814628 21072 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.431s	user 0.000s	sys 0.004s
I20260709 13:07:56.819249 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2110) took 1538 ms. Trace:
I20260709 13:07:56.844166 20858 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.845304 21105 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.844365 15713 rpcz_store.cc:276] 0709 13:07:55.281335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.409625 (+1128290us) service_pool.cc:224] Handling call
0709 13:07:56.409955 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.411582 (+  1627us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:56.502409 (+ 90827us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.700613 (+198204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.703744 (+  3131us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.703908 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:56.744822 (+ 40914us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.745053 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.745132 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.816938 (+ 71806us) raft_consensus.cc:1685] finished
0709 13:07:56.816964 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.819190 (+  2226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75892,"prepare.queue_time_us":61072,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":4217,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":22774,"spinlock_wait_cycles":21694720,"thread_start_us":214897,"threads_started":2,"wal-append.queue_time_us":240446}
I20260709 13:07:56.845957 21105 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.847237 15713 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:56.847898 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3229) took 1379 ms. Trace:
I20260709 13:07:56.848433 21105 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:56.848490 21095 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.849009 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3210) took 2731 ms. Trace:
I20260709 13:07:56.848209 15713 rpcz_store.cc:276] 0709 13:07:55.467990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.846712 (+1378722us) service_pool.cc:224] Handling call
0709 13:07:56.847045 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.847637 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.847815 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.852401 15713 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:56.853856 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 789) took 1070 ms. Trace:
I20260709 13:07:56.822943 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3226) took 1355 ms. Trace:
I20260709 13:07:56.823590 16328 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:56.768158 21096 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.825894 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.825451 15717 rpcz_store.cc:276] 0709 13:07:55.467756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.802946 (+1335190us) service_pool.cc:224] Handling call
0709 13:07:56.803442 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.803712 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.803755 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.803839 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:56.803894 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.803980 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.804174 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.835129 15642 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:56.834074 15720 rpcz_store.cc:276] 0709 13:07:55.201214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.362605 (+1161391us) service_pool.cc:224] Handling call
0709 13:07:56.376884 (+ 14279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.377246 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.377273 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.377718 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.610611 (+232893us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:56.695395 (+ 84784us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.695693 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.695795 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.810992 (+115197us) raft_consensus.cc:1685] finished
0709 13:07:56.811018 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.811182 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62316,"prepare.queue_time_us":113555,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3066,"raft.queue_time_us":1846,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":23951,"thread_start_us":201544,"threads_started":1,"wal-append.queue_time_us":371535}
I20260709 13:07:56.836588 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.837646 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:56.837953 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.838073 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:56.838642 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:56.841600 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.843088 21081 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.849457 15714 rpcz_store.cc:276] 0709 13:07:54.117898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.147505 (+1029607us) service_pool.cc:224] Handling call
0709 13:07:55.147836 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.776297 (+628461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.776327 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.776771 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.135495 (+358724us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:56.135549 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.135646 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.673339 (+537693us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:56.848709 (+175370us) raft_consensus.cc:1685] finished
0709 13:07:56.848731 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.848953 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124769,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":15186304,"thread_start_us":930660,"threads_started":2,"wal-append.queue_time_us":500936}
I20260709 13:07:56.855721 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.801608 20926 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.795353 21094 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:56.920276 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 77296.7us
I20260709 13:07:56.856014 15722 rpcz_store.cc:276] 0709 13:07:55.467275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.625768 (+1158493us) service_pool.cc:224] Handling call
0709 13:07:56.626167 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.626465 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:56.724731 (+ 98266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.822579 (+ 97848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.822637 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:56.822693 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.822773 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.822885 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74309,"prepare.queue_time_us":110791,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1942,"raft.queue_time_us":2767,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7152,"thread_start_us":97123,"threads_started":1,"wal-append.queue_time_us":201976}
I20260709 13:07:56.961180 20862 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:56.961686 15722 raft_consensus.cc:1275] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.961862 20862 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:56.963292 15722 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:56.964341 21111 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.964505 20862 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.964932 21111 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.849285 21095 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:56.922623 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.966922 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.967346 21111 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:56.967665 15645 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:56.966847 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.963351 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 1065) took 1031 ms. Trace:
I20260709 13:07:56.968895 15790 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:07:56.969033 16329 rpcz_store.cc:276] 0709 13:07:55.931956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.988112 (+ 56156us) service_pool.cc:224] Handling call
0709 13:07:56.963191 (+975079us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540066e4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:56.963293 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550514048}
I20260709 13:07:56.970209 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:56.931694 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 64288.9us
I20260709 13:07:56.970960 15790 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.854439 15713 rpcz_store.cc:276] 0709 13:07:55.783821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.851598 (+1067777us) service_pool.cc:224] Handling call
0709 13:07:56.851980 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.853517 (+  1537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.853786 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.971925 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:56.921079 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.973613 15787 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.835574 20844 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:56.975217 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.976768 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:56.891283 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.978015 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.979338 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.980245 15791 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:56.989519 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.991775 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.981945 15642 pending_rounds.cc:85] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 7
I20260709 13:07:56.925624 15643 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:07:56.984941 15640 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:56.993863 15643 pending_rounds.cc:85] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 13
I20260709 13:07:56.994022 15642 pending_rounds.cc:107] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:56.994305 15643 pending_rounds.cc:107] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:07:56.994567 15642 raft_consensus.cc:2889] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.994733 15643 raft_consensus.cc:2889] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.992825 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:56.996191 15791 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:56.950785 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.997543 15646 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:56.998410 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:56.998739 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:56.999634 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.000900 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:56.949374 21043 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.135s	user 0.014s	sys 0.000s
I20260709 13:07:56.849503 20988 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:56.894249 21020 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.007658 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.835321 20840 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.014889 15641 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14. Re-sending same reply.
I20260709 13:07:57.015329 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:56.928882 20972 raft_consensus.cc:3060] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.934612 20960 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.009179 15645 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.967898 20509 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.011595 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.011865 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.012900 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:56.941506 21058 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:56.997196 15790 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:07:57.023881 15789 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:57.016183 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:57.017264 15541 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 150) took 46790 ms (client timeout 15000 ms). Trace:
I20260709 13:07:57.048803 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.018939 15787 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:07:57.030706 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.840974 21056 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.043301 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.050222 15645 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:57.051360 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.052148 15639 raft_consensus.cc:2368] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16.
I20260709 13:07:57.016626 20862 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.055611 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34988 (request call id 0) took 1237 ms. Trace:
I20260709 13:07:57.056186 15720 rpcz_store.cc:276] 0709 13:07:55.805519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.971595 (+1166076us) service_pool.cc:224] Handling call
0709 13:07:57.042318 (+ 70723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.015321 21043 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
W20260709 13:07:57.048453 15541 rpcz_store.cc:269] 0709 13:07:10.216195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.216497 (+   302us) service_pool.cc:224] Handling call
0709 13:07:57.006629 (+46790132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:50.236749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:50.241683 (+  4934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:50.241755 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:07:50.241773 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:50.243259 (+  1486us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:50.243338 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:50.243367 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:50.244646 (+  1279us) tablet.cc:701] Row locks acquired
0709 13:07:50.244696 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:07:50.244864 (+   168us) write_op.cc:270] Start()
0709 13:07:50.245018 (+   154us) write_op.cc:276] Timestamp: P: 1783602470244803 usec, L: 0
0709 13:07:50.245045 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:50.256784 (+ 11739us) log.cc:844] Serialized 6243 byte log entry
0709 13:07:50.769840 (+513056us) op_driver.cc:464] REPLICATION: finished
0709 13:07:51.063026 (+293186us) write_op.cc:301] APPLY: starting
0709 13:07:51.063124 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:51.550622 (+487498us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:51.658998 (+108376us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:52.246001 (+587003us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:52.246333 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:07:52.246376 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:52.246913 (+   537us) log.cc:844] Serialized 148 byte log entry
0709 13:07:52.338366 (+ 91453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.338531 (+   165us) write_op.cc:454] Released schema lock
0709 13:07:52.338609 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:52.343156 (+  4547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.343191 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1625067,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":292857,"apply.run_cpu_time_us":40566,"apply.run_wall_time_us":1276503,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70943,"num_ops":16,"prepare.queue_time_us":384232,"prepare.run_cpu_time_us":17805,"prepare.run_wall_time_us":151214,"raft.queue_time_us":103095,"raft.run_cpu_time_us":47707,"raft.run_wall_time_us":241466,"replication_time_us":524551,"spinlock_wait_cycles":1920,"thread_start_us":665511,"threads_started":5,"wal-append.queue_time_us":323907,"wal-append.run_cpu_time_us":27471,"wal-append.run_wall_time_us":2306919}]]}
I20260709 13:07:57.043853 20509 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:57.043814 20960 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:57.061295 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.066109 15716 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:57.069263 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.073395 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:57.078174 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3227) took 1610 ms. Trace:
I20260709 13:07:57.078035 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.017304 20988 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.078832 15715 rpcz_store.cc:276] 0709 13:07:55.467532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.757340 (+1289808us) service_pool.cc:224] Handling call
0709 13:07:56.757773 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.758017 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:56.783958 (+ 25941us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.077844 (+293886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.077901 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:57.077945 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.078010 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.078121 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24960,"prepare.queue_time_us":31138,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":292417,"threads_started":1}
I20260709 13:07:57.082289 15796 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:07:57.081192 15593 auto_rebalancer.cc:893] Removing replace marker failed: Replica 8ca6a5ab086d47e5a79ef37ddead9f28 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:07:57.084952 15593 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:57.087333 15642 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:57.088819 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:07:57.085261 15593 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:57.096518 16333 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:57.098806 16330 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:57.102583 15787 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:57.108927 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:57.108819 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.117302 20960 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.118537 20960 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.119995 20840 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:57.082150 20844 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.122553 20926 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.123200 20926 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:57.060331 20862 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.130632 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.134905 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.136197 15713 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:57.138322 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:57.138899 15715 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.124524 21058 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:57.152061 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:57.152897 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.153676 15720 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:57.106022 20891 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:57.152860 16333 raft_consensus.cc:2376] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9. Re-sending same reply.
I20260709 13:07:57.126318 20970 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.094210 20879 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:57.133201 20866 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.175127 20866 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.176324 15721 raft_consensus.cc:1275] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:57.177346 20866 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.126152 21087 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:07:57.132997 20959 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:57.165539 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.166656 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.170193 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.171161 21056 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.067201 20509 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.174126 20879 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.182137 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.191399 20879 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.183365 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.193711 21094 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.125926 20829 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:57.194859 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.184486 21020 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.186503 21081 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.188956 20509 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.200683 16325 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:57.201551 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:57.222388 15762 leader_election.cc:400] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16.
I20260709 13:07:57.222839 15762 leader_election.cc:403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.223819 15762 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.211688 20988 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.160133 21058 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.159044 20891 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:57.214435 15645 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
W20260709 13:07:57.221638 21078 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.668s	user 0.005s	sys 0.008s
I20260709 13:07:57.250573 15794 raft_consensus.cc:1240] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:57.217669 20862 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.180159 20959 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:57.234846 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 124869us
W20260709 13:07:57.242872 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 131230us
I20260709 13:07:57.215306 15715 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
W20260709 13:07:57.202917 20426 consensus_queue.cc:1175] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
I20260709 13:07:57.255937 20959 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:57.259848 21118 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:07:57.263211 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.266358 20959 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.268018 15642 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:57.269248 20959 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.270224 20960 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:57.271938 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:57.276088 21081 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.276839 21081 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:57.277384 21081 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:57.278285 15645 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:57.247566 21096 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.279000 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:57.243542 21094 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.243650 20840 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.180897 20970 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:57.290383 20935 consensus_meta.cc:287] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.167s	user 0.013s	sys 0.000s
I20260709 13:07:57.249509 20891 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:57.315908 15647 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:57.290663 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2113) took 1994 ms. Trace:
I20260709 13:07:57.316627 15718 rpcz_store.cc:276] 0709 13:07:55.295953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.531846 (+1235893us) service_pool.cc:224] Handling call
0709 13:07:56.532185 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.579102 (+ 46917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.290418 (+711316us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b540003c354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:57.290606 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76196096}
I20260709 13:07:57.317795 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3217) took 2670 ms. Trace:
I20260709 13:07:57.318320 15719 rpcz_store.cc:276] 0709 13:07:54.647305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.702363 (+1055058us) service_pool.cc:224] Handling call
0709 13:07:55.702743 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.507561 (+804818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.317460 (+809899us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400095454. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:57.317704 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835694976}
I20260709 13:07:57.292246 21058 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.292692 21094 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:57.326144 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.326470 21094 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.326846 15646 raft_consensus.cc:2376] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13. Re-sending same reply.
I20260709 13:07:57.255270 21078 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.293177 20879 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.294947 21056 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.295933 20866 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:57.324371 21058 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:07:57.325440 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:57.301992 20972 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:07:57.338493 15788 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:57.345062 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:57.357403 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:07:57.359916 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 87389.7us
I20260709 13:07:57.336314 21127 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:57.343798 20785 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:07:57.337064 20879 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.336920 21056 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.351812 21096 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:07:57.386708 21128 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.395507 20829 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:57.397599 21096 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.398208 21096 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.399202 20862 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.399760 20862 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:57.401625 21087 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:57.402064 20866 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:57.361384 21081 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.402449 20866 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:57.403180 20866 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.369580 21127 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.412232 15647 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:57.414124 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.414896 15647 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:57.417526 21087 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:57.418399 21076 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 1.034s	user 0.003s	sys 0.000s
I20260709 13:07:57.418166 21087 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.420559 21087 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.417728 21131 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:57.421231 21131 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:57.411018 21128 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.422349 21131 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.430473 21040 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:57.435899 21131 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.429930 21107 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:07:57.426047 20785 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.438354 20785 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.440725 21056 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.443115 20785 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:57.454685 20970 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.456776 21127 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:57.466099 21135 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:07:57.469760 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.471765 20879 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:57.478827 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 182273us
I20260709 13:07:57.484779 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.400746 20862 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.492648 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:57.495689 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:57.497371 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:57.505764 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:57.497406 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 140120us
I20260709 13:07:57.509995 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.510473 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:57.511121 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.511763 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:57.510663 16333 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:57.520084 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.520787 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.521153 21060 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:57.518157 20862 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.520740 15646 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:57.528461 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.410894 20829 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:07:57.531558 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.513842 21056 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.536813 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.518114 20970 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.546485 21039 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:57.546981 21039 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:57.548550 16330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56432 (request call id 938) took 1819 ms (client timeout 1720 ms). Trace:
W20260709 13:07:57.548954 16330 rpcz_store.cc:269] 0709 13:07:55.729347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.729526 (+   179us) service_pool.cc:224] Handling call
0709 13:07:57.548359 (+1818833us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54006cfcd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:57.548481 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915257088}
W20260709 13:07:57.541308 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.518921 20879 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.550812 20879 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:57.551765 20879 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.518822 20972 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.543339 16328 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:57.543428 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:07:57.530397 20888 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:07:57.554977 20888 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.555347 20888 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:57.556195 20888 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.557683 15646 raft_consensus.cc:2410] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:07:57.559168 15759 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.530207 21133 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.538051 21096 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.542407 21056 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:57.575237 20844 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:57.586505 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 225528us
I20260709 13:07:57.579093 20840 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16.
W20260709 13:07:57.586009 20870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.017s	sys 0.059s
W20260709 13:07:57.609805 20870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.018s	sys 0.060s
W20260709 13:07:57.613260 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.618530 21141 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:57.594053 21056 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.626493 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.630996 20891 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.634366 15647 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:07:57.637576 21116 log.cc:927] Time spent T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.519s	user 0.000s	sys 0.001s
I20260709 13:07:57.640336 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3223) took 2173 ms. Trace:
I20260709 13:07:57.640781 15716 rpcz_store.cc:276] 0709 13:07:55.466476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.562075 (+1095599us) service_pool.cc:224] Handling call
0709 13:07:56.562500 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.072106 (+509606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.640047 (+567941us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540017acd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:57.640269 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157730048}
I20260709 13:07:57.642362 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 644) took 1067 ms. Trace:
I20260709 13:07:57.642808 15640 rpcz_store.cc:276] 0709 13:07:56.574901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.575656 (+   755us) service_pool.cc:224] Handling call
0709 13:07:57.642177 (+1066521us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54002db754. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:57.642303 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927820160}
I20260709 13:07:57.644279 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.592334 21031 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.633675 20891 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.673202 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.674041 15644 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:07:57.675088 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.676014 15644 raft_consensus.cc:2410] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:57.677352 15644 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:57.679224 21021 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:57.679726 21021 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:57.681012 16327 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:57.680684 21021 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.683482 15638 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:57.657524 15641 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:07:57.660686 15715 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.685858 15641 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:57.685886 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:57.661926 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.688123 15716 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:57.662989 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:57.689216 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 800) took 1901 ms. Trace:
I20260709 13:07:57.689637 15792 rpcz_store.cc:276] 0709 13:07:55.787779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.788172 (+   393us) service_pool.cc:224] Handling call
0709 13:07:55.788535 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.910876 (+122341us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:56.265763 (+354887us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.808635 (+542872us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b180041c7a0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a
0709 13:07:56.809061 (+   426us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.809236 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.809290 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:56.809345 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.688971 (+879626us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001f7cd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:57.689024 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.689156 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466191,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":9947,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"spinlock_wait_cycles":302800000,"thread_start_us":463822,"threads_started":2,"wal-append.queue_time_us":156048}
I20260709 13:07:57.691959 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.692625 15792 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:57.693531 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.694692 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:07:57.694883 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.696594 15688 connection.cc:256] RPC call timeout handler was delayed by -1.1154099750000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31930000000000003s for a response
I20260709 13:07:57.695618 21021 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.700537 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.701710 21061 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:57.702055 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:57.702775 15716 raft_consensus.cc:2368] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16.
W20260709 13:07:57.695612 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.703545 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.702769 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.704398 15792 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:57.704706 15717 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:07:57.702349 21061 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.703645 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.705307 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.724858 21094 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.748057 21003 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:57.749177 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.726874 21077 raft_consensus.cc:993] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:07:57.749962 15792 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:57.750252 21077 raft_consensus.cc:1081] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:07:57.750965 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.768062 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.729506 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.695266 21031 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.738497 21025 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:57.707576 21024 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:07:57.754714 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.756527 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.756922 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.759374 15642 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:57.760490 21061 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:57.761121 15715 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:07:57.717226 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:57.742817 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.733052 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:57.745206 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 785) took 2818 ms. Trace:
I20260709 13:07:57.787631 16334 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:07:57.741093 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:57.732031 15714 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:07:57.728415 21117 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.611s	user 0.001s	sys 0.000s
I20260709 13:07:57.747082 21095 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:57.706050 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.729873 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.800185 15639 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:57.701613 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.800935 15719 raft_consensus.cc:2410] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:57.705559 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:57.800688 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.710026 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.802168 15641 raft_consensus.cc:2368] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
W20260709 13:07:57.710613 21135 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:57.786295 21060 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:57.808727 21060 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.803695 21094 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.818078 15719 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:57.822897 15717 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:57.771348 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:57.660280 20870 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.786271 15644 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:07:57.824793 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.730211 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:57.788139 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45408.6us
W20260709 13:07:57.825191 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53986.5us
I20260709 13:07:57.826303 16300 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.827096 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:57.787647 15721 rpcz_store.cc:276] 0709 13:07:54.926622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.250229 (+1323607us) service_pool.cc:224] Handling call
0709 13:07:56.250622 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.176695 (+926073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.744866 (+568171us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400385ed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:57.745119 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128160000}
I20260709 13:07:57.827857 20426 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:57.828449 21137 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:57.828568 20426 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:57.829125 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:57.829416 21137 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:57.829792 21137 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:57.829880 20426 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.830578 21137 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.831405 20509 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:57.832007 21137 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.830869 20896 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:57.832913 20896 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.833403 20896 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:57.834969 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 117867us
I20260709 13:07:57.836140 21061 raft_consensus.cc:2764] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:57.837652 21061 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:57.795758 15640 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:07:57.723268 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:57.841454 15720 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.819140 20888 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.826635 20935 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:57.856933 21140 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:57.856756 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:57.857914 15790 raft_consensus.cc:2368] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:57.748063 21056 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:57.839057 21039 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.875101 15720 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:07:57.879674 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:57.841226 20870 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:57.867899 21021 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.888439 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.905345 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.910166 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.910902 15640 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.911384 15688 leader_election.cc:400] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16.
I20260709 13:07:57.911754 15688 leader_election.cc:403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.916334 15790 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:07:57.925246 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:57.928169 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.929198 15644 raft_consensus.cc:2410] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 17 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:57.930999 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:57.931869 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:57.932400 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2849) took 1094 ms. Trace:
W20260709 13:07:57.932608 21144 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:57.932902 15788 rpcz_store.cc:276] 0709 13:07:56.837896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.838505 (+   609us) service_pool.cc:224] Handling call
0709 13:07:56.838861 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.343168 (+504307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.932096 (+588928us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002e6b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:57.932341 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148445952}
I20260709 13:07:57.917789 21146 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:57.934844 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.936025 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.934729 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.940531 15788 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:57.943255 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:57.943889 15788 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:57.943722 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:57.927660 21024 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.929697 20879 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:57.927143 21138 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.927080 21094 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:57.943859 20870 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:57.965619 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.967233 21031 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:57.974912 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.977057 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:57.978487 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46718.8us
I20260709 13:07:57.979470 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:57.981230 15788 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:07:57.931046 21013 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.931023 21058 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16.
I20260709 13:07:57.955339 15639 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:57.951560 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:57.983300 15720 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:57.984280 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2855) took 1144 ms. Trace:
I20260709 13:07:57.985318 15644 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:07:57.925343 15640 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:07:57.986224 15789 rpcz_store.cc:276] 0709 13:07:56.839744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.048947 (+209203us) service_pool.cc:224] Handling call
0709 13:07:57.049229 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.049647 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.049682 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.054231 (+  4549us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.102658 (+ 48427us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:57.982746 (+880088us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.983089 (+   343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.983163 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.983202 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:57.983215 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.984208 (+   993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651066,"prepare.queue_time_us":651091,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":192,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6215,"thread_start_us":248102,"threads_started":2,"wal-append.queue_time_us":29654}
W20260709 13:07:58.007014 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.956837 21024 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.012545 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.014416 21150 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.015053 21150 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:58.015513 21150 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.018186 21013 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.020030 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.026054 20879 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.027765 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:58.028803 20879 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:58.029289 20879 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.029685 20879 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:58.039062 15688 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.039878 20885 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:57.983004 21031 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.983889 21133 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.051839 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:57.965209 21094 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:58.054046 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 292161us
I20260709 13:07:57.962476 21138 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.060578 15640 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:07:58.062076 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 235880us
W20260709 13:07:58.015609 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.054751 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.129153 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:07:58.103025 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48378.5us
I20260709 13:07:58.129544 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.122021 16327 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:58.134042 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:58.131389 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 817) took 1153 ms. Trace:
I20260709 13:07:58.127332 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2860) took 1216 ms. Trace:
I20260709 13:07:58.135605 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.137143 15646 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:07:58.130256 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.136302 15795 rpcz_store.cc:276] 0709 13:07:56.911089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.080362 (+169273us) service_pool.cc:224] Handling call
0709 13:07:57.080717 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.085054 (+  4337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.085100 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.095074 (+  9974us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.168514 (+ 73440us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:57.754577 (+586063us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.754804 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.126451 (+371647us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b48001d01d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:07:58.127034 (+   583us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b54001fa9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:58.127079 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.127123 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:58.127135 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.127270 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586671,"prepare.queue_time_us":589701,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":10988,"raft.run_cpu_time_us":3416,"raft.run_wall_time_us":1032042,"spinlock_wait_cycles":33569024,"thread_start_us":39572,"threads_started":1,"wal-append.queue_time_us":121142}
I20260709 13:07:58.138114 16333 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
W20260709 13:07:58.138863 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.138429 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:58.139690 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:58.140280 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:58.104741 15610 leader_election.cc:400] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:58.141589 15610 leader_election.cc:403] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.051383 20885 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:58.142544 16326 raft_consensus.cc:2368] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:58.135504 15794 rpcz_store.cc:276] 0709 13:07:56.978433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.125243 (+146810us) service_pool.cc:224] Handling call
0709 13:07:57.147260 (+ 22017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.251543 (+104283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.131097 (+879554us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400152a54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:58.131309 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237035776}
I20260709 13:07:58.119977 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:58.137905 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.145656 15639 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:58.169076 15790 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 8.
W20260709 13:07:58.092088 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.054183 21013 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.173491 15795 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:07:58.174216 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 69656.9us
I20260709 13:07:58.174952 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2862) took 1167 ms. Trace:
I20260709 13:07:58.175423 15795 rpcz_store.cc:276] 0709 13:07:57.007169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.172792 (+1165623us) service_pool.cc:224] Handling call
0709 13:07:58.173209 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.174691 (+  1482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.174895 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.176597 15610 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:58.120821 21145 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:07:58.120276 21148 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:58.105376 21146 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.095216 21138 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.053236 21095 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:07:58.102499 20801 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:58.055601 20896 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.056090 21133 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:58.061872 20870 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.132s
I20260709 13:07:58.102094 21150 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.180109 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:58.180368 15794 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:58.193107 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:58.216939 15647 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 8.
I20260709 13:07:58.179673 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.181654 21130 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.181773 21131 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.219385 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 819) took 1240 ms. Trace:
I20260709 13:07:58.181207 15610 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:58.195106 15789 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:58.219815 15794 rpcz_store.cc:276] 0709 13:07:56.978949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.170633 (+1191684us) service_pool.cc:224] Handling call
0709 13:07:58.180128 (+  9495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.219128 (+ 39000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.219330 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.220273 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2865) took 1158 ms. Trace:
I20260709 13:07:58.220649 15789 rpcz_store.cc:276] 0709 13:07:57.062099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.194601 (+1132502us) service_pool.cc:224] Handling call
0709 13:07:58.194886 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.220034 (+ 25148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.220221 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:58.221501 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.181859 21134 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:58.186339 21147 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:58.190984 21094 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.180590 21137 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.229233 15641 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:07:58.095850 20879 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.100838 21077 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:58.118105 21061 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:58.142827 21039 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.100416 21021 consensus_queue.cc:1048] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:07:58.202361 15792 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:58.203104 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:58.119174 21024 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:58.062453 21056 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.230557 20935 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.104539 21108 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:58.119570 21031 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:07:58.181852 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:58.271592 15720 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
W20260709 13:07:58.223188 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 43602.6us
W20260709 13:07:58.224807 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.212208 20934 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:58.193141 15644 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:07:58.214041 21013 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.234422 15794 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:58.210924 21121 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:58.215734 21133 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.229849 21138 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:58.146255 20885 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:07:58.263108 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60076us
I20260709 13:07:58.277232 15638 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:07:58.267551 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 388686us
I20260709 13:07:58.229596 21131 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.272228 20801 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.279291 15642 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:58.279362 20801 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.279721 15642 pending_rounds.cc:85] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 9
I20260709 13:07:58.280030 15642 pending_rounds.cc:107] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:58.280844 15642 raft_consensus.cc:2889] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.229801 21130 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.282143 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:58.279897 20801 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.277665 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:58.280157 21131 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.292197 20879 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.280292 21161 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.292778 21161 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:58.293346 21138 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:58.280814 20892 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:07:58.237509 21077 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.293614 20896 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.293164 21161 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.298241 21077 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.293138 20879 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:58.301935 20879 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.293807 21039 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.302343 20879 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.302588 21039 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:58.303198 21039 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.303639 20870 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:58.305770 21157 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.239219 21061 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.307631 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:58.308276 15644 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:07:58.302706 21150 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.309700 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:58.301644 15789 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [15.11-16.12]
I20260709 13:07:58.310715 21077 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.311093 21077 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:58.311424 21077 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.312297 15789 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:58.313544 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:58.309825 21130 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:58.321141 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.327875 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:58.274351 20934 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:58.341112 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:58.329129 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:07:58.308207 21061 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.342908 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:58.345945 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:58.346647 15720 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:58.347493 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:58.352219 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:58.289152 21056 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:58.279313 21013 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:58.273372 21108 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.365170 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:58.294678 21096 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:07:58.395967 15720 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:58.393878 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:58.351949 21061 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:58.429785 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:58.430773 15794 raft_consensus.cc:2393] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:07:58.413334 21009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.026s	user 0.002s	sys 0.031s
W20260709 13:07:58.432915 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 298916us
I20260709 13:07:58.361408 20870 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:58.412196 20926 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.437605 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:07:58.446417 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 173666us
W20260709 13:07:58.435528 21009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.051s	user 0.002s	sys 0.032s
I20260709 13:07:58.449553 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:58.369777 21056 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.366333 20885 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.421438 21166 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:07:58.458582 21150 raft_consensus.cc:2764] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:58.451498 20926 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:58.484236 21162 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:58.458173 21039 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.454157 21013 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.425557 20934 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.424212 21061 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.469758 16300 leader_election.cc:400] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13.
I20260709 13:07:58.433218 21138 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.439743 20870 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:58.479790 20866 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.450472 21021 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:58.488477 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76593.8us
I20260709 13:07:58.489784 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.500481 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:58.509456 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.488339 21108 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.497972 20885 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.489688 21169 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:58.501585 20870 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.510526 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.510066 21021 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:07:58.525458 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 87944.1us
W20260709 13:07:58.590479 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.511569 21171 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:58.653240 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 139689us
I20260709 13:07:58.524776 21176 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:58.654534 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 144064us
I20260709 13:07:58.644045 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:58.625339 21108 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:58.665012 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3232) took 1533 ms. Trace:
I20260709 13:07:58.665000 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:58.625710 20988 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:58.663769 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.666224 15722 rpcz_store.cc:276] 0709 13:07:57.131498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.132049 (+   551us) service_pool.cc:224] Handling call
0709 13:07:57.132389 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.279689 (+147300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.279719 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.279758 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:57.279788 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.532074 (+1252286us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540026c0d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:58.663797 (+131723us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.663917 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338268416}
I20260709 13:07:58.670526 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.676324 16327 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:58.673452 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.645970 21175 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:58.525805 21178 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:07:58.682279 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.682632 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:58.683871 20926 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.684610 21133 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.688843 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:58.657042 21137 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:58.655063 21094 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:58.720338 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76386.4us
W20260709 13:07:58.721488 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 69058.7us
W20260709 13:07:58.722576 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 59176.8us
I20260709 13:07:58.722455 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:58.726949 15790 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:58.675266 20988 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:58.651918 21158 consensus_queue.cc:1059] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:07:58.727988 15790 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:58.680106 21009 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.733353 21009 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.735708 21009 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:58.735884 21172 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:58.676465 21166 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:07:58.732071 15790 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:58.737715 21081 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:58.738554 21174 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:58.738309 21081 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.690456 21099 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:07:58.737808 21168 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:07:58.690062 21183 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.750965 15688 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.678987 21108 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.771433 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:58.807442 16326 raft_consensus.cc:2376] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13. Re-sending same reply.
I20260709 13:07:58.758846 20969 raft_consensus.cc:3055] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:58.809367 20988 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:58.812983 20879 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
I20260709 13:07:58.752785 21099 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.814396 21133 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.724084 21094 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.805819 21166 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:58.816275 21108 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:58.821038 15611 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:58.760928 21169 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.723680 21171 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:58.756840 21180 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:07:58.766896 21061 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.817061 20935 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:58.847062 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 96193.1us
I20260709 13:07:58.887197 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:58.753116 21056 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:58.843401 21176 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.879096 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58145.9us
I20260709 13:07:58.806205 21189 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:58.894583 21189 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:58.817971 20969 raft_consensus.cc:740] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:58.895900 20969 consensus_queue.cc:260] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.897636 20969 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.878221 21137 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.898615 21137 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.900844 21137 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:58.840556 21161 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.544s	user 0.004s	sys 0.007s
I20260709 13:07:58.766444 21039 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:58.902423 21185 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:07:58.902040 21161 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.903484 16328 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:58.903627 21150 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:58.904490 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2866) took 1160 ms. Trace:
I20260709 13:07:58.766742 21184 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 13:07:58.905565 21184 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:58.906189 21184 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:58.905009 15794 rpcz_store.cc:276] 0709 13:07:57.744280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.439331 (+695051us) service_pool.cc:224] Handling call
0709 13:07:58.447784 (+  8453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.448249 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.448288 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.448721 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.642601 (+193880us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.651359 (+  8758us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.664228 (+ 12869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.664300 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.904207 (+239907us) raft_consensus.cc:1685] finished
0709 13:07:58.904235 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.904401 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22519,"prepare.queue_time_us":6604,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1732,"raft.queue_time_us":28520,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7791,"thread_start_us":179283,"threads_started":1,"wal-append.queue_time_us":315033}
W20260709 13:07:58.769577 21142 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:58.902642 21178 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:58.749010 21021 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.849151 21183 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:58.894788 21146 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 13:07:58.847527 20879 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.885031 21130 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:58.907850 20801 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.004s
W20260709 13:07:58.919772 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 187243us
I20260709 13:07:58.839305 21182 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.847965 20926 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.893719 20935 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.907233 21184 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.921540 21146 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.883788 21169 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.937940 20935 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:58.934582 20926 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.945043 21189 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.947172 21095 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:58.928326 21182 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.923830 21130 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.927114 21166 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.961283 21130 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:58.961921 21186 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:07:58.961721 21166 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.911250 21176 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:58.959749 21095 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:07:58.961360 21184 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:58.960806 21182 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.965034 21189 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:58.902455 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:07:58.998875 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 96246.9us
I20260709 13:07:58.926988 20801 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:58.926487 15759 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:07:59.012454 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 85949.7us
I20260709 13:07:59.012696 20801 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.014324 20801 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.943274 20870 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:59.018333 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 108219us
I20260709 13:07:59.018949 20870 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.019763 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.020464 20870 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.021306 20870 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.021970 20870 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.938196 20879 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.030614 20926 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.031409 20896 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:59.032148 20896 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:59.032495 20926 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.034751 20896 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.033805 20926 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.044796 20926 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.049975 20934 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:59.058128 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 793) took 1352 ms. Trace:
I20260709 13:07:58.957042 21081 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.077659 21176 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.064411 15715 rpcz_store.cc:276] 0709 13:07:57.704897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.804136 (+ 99239us) service_pool.cc:224] Handling call
0709 13:07:57.804475 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.909647 (+105172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.909678 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.765566 (+855888us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b2c000108d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:07:58.776760 (+ 11194us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.007012 (+230252us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:59.007141 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.056903 (+ 49762us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540011a3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:59.057003 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.057129 (+   126us) raft_consensus.cc:1685] finished
0709 13:07:59.057153 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.057464 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45065,"raft.queue_time_us":8785,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6556,"spinlock_wait_cycles":359863424,"thread_start_us":127005,"threads_started":1,"wal-append.queue_time_us":120624}
I20260709 13:07:59.080080 21169 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.090564 21048 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:59.134881 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:59.137593 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:59.138525 15722 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
W20260709 13:07:59.139286 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.139372 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68290.3us
I20260709 13:07:59.140085 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:59.140506 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:59.140974 15713 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:07:59.142581 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:59.143623 15718 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:07:59.131024 21048 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:59.144691 21048 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:59.146198 21048 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.159196 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 821) took 1731 ms. Trace:
W20260709 13:07:59.159981 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.165377 21146 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:59.099697 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.159879 15792 rpcz_store.cc:276] 0709 13:07:57.427969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.239634 (+811665us) service_pool.cc:224] Handling call
0709 13:07:58.239910 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.422328 (+182418us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:58.434550 (+ 12222us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.526807 (+ 92257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.526862 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:58.526917 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.158481 (+631564us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400307ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:07:59.158589 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.158945 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11839,"prepare.queue_time_us":14744,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":7672,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":115213,"spinlock_wait_cycles":419016576,"thread_start_us":86365,"threads_started":1,"wal-append.queue_time_us":188871}
I20260709 13:07:59.099498 21094 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.108036 21099 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.107579 21166 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:07:59.188663 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.101991 21095 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.185261 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.191131 21095 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.099916 21161 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.176918 21169 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:59.196982 15722 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:59.200013 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 59709.9us
I20260709 13:07:59.208771 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.214572 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:59.217424 21205 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.218585 21205 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.221601 21169 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.231419 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.232626 21131 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.233083 21131 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.233435 21131 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:59.233675 21190 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.318s	user 0.003s	sys 0.000s
I20260709 13:07:59.233986 21207 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:59.234504 21207 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.234911 21207 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:59.236299 21200 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:07:59.238128 20959 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:59.238363 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2868) took 1493 ms. Trace:
I20260709 13:07:59.238583 20959 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.239521 21201 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 13:07:59.239995 20959 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:59.246434 21077 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.010s
I20260709 13:07:59.248276 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.250208 21146 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.239022 15796 rpcz_store.cc:276] 0709 13:07:57.744946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.533106 (+788160us) service_pool.cc:224] Handling call
0709 13:07:58.621436 (+ 88330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.622543 (+  1107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.622572 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.625957 (+  3385us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.879557 (+253600us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.879614 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.879709 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.235107 (+355398us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:59.237794 (+  2687us) raft_consensus.cc:1685] finished
0709 13:07:59.237820 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.238164 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10587,"raft.queue_time_us":884,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":25403,"spinlock_wait_cycles":48836480,"thread_start_us":183992,"threads_started":1,"wal-append.queue_time_us":260833}
I20260709 13:07:59.247148 21077 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:59.255568 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2580) took 1340 ms (client timeout 1565 ms). Trace:
W20260709 13:07:59.256059 15646 rpcz_store.cc:269] 0709 13:07:57.914955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.915131 (+   176us) service_pool.cc:224] Handling call
0709 13:07:59.255095 (+1339964us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540028a854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:59.255274 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451427200}
I20260709 13:07:59.256618 21077 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:59.257990 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.258845 21206 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:59.259644 21206 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.258024 15791 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.270978 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.274472 21206 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.275137 21206 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.275547 21206 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.245668 21182 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.276051 21206 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.273686 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.245260 21131 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.281962 15638 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.282823 21182 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.283316 21130 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:07:59.284138 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2586) took 1307 ms (client timeout 1739 ms). Trace:
W20260709 13:07:59.284566 15641 rpcz_store.cc:269] 0709 13:07:57.950444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.950558 (+   114us) service_pool.cc:224] Handling call
0709 13:07:59.257470 (+1306912us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400346054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:07:59.257679 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599795968}
I20260709 13:07:59.263464 21048 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:59.294550 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 87359.1us
I20260709 13:07:59.297186 15688 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:59.299165 21184 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.301590 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:07:59.302881 21205 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:07:59.303303 21154 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.911s	user 0.000s	sys 0.002s
I20260709 13:07:59.303018 21184 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:59.263625 21169 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.321908 15715 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:59.324749 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:59.325520 15713 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.322679 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:59.322256 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:59.294488 21131 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.304617 21130 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.266454 20959 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.343130 20988 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:59.345309 21187 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.528s	user 0.000s	sys 0.000s
I20260709 13:07:59.346330 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:07:59.349390 21199 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
W20260709 13:07:59.349859 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.350164 15718 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:59.356958 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 55663.7us
I20260709 13:07:59.361582 15646 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:59.335481 20870 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.359738 21131 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:59.374997 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:07:59.376346 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.377238 15643 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:07:59.378728 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:59.379487 15714 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
I20260709 13:07:59.380261 15642 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.382556 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.383492 21205 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.383888 21205 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:59.384038 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.384327 21205 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:59.385242 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.387823 21165 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.943s	user 0.000s	sys 0.002s
W20260709 13:07:59.368598 15760 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 2.173s (SENT) [suppressed 40 similar messages]
I20260709 13:07:59.377633 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.391574 15713 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:59.395741 15642 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
W20260709 13:07:59.398082 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 124574us
I20260709 13:07:59.378155 21013 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:59.404250 20426 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:07:59.413501 15610 leader_election.cc:400] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:07:59.369180 21131 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.414848 21131 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.417078 15611 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.367187 21189 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:07:59.420817 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 87615.3us
I20260709 13:07:59.424234 20870 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.434602 20885 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.435417 20885 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:59.437908 21107 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:59.440429 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:59.440251 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62773.4us
I20260709 13:07:59.441056 21061 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:59.405601 20426 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:59.436556 20840 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.438975 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:59.435956 21095 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.437429 21077 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:07:59.451900 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:59.452086 21061 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.452996 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:07:59.453375 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.433621 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.461932 21189 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.470877 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:59.471805 16329 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.471024 15545 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 12, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.472445 21189 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.464587 16326 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:07:59.453096 21207 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.480875 16329 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:07:59.454793 20426 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:59.473405 15545 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 13, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 13 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:59.431790 21206 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.461176 21061 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.490135 15644 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.498102 15791 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:59.495611 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.502689 15641 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:59.463923 20870 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:59.506193 15646 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 16: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:07:59.508210 15718 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:07:59.503821 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:07:59.509498 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:59.510267 15713 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.519164 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:59.502195 21013 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:59.523691 15611 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.519042 15545 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 12, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.502460 21095 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.490113 20840 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.533823 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.497454 20426 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.544401 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:59.543736 15545 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 12, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.546559 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:59.545583 15545 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.549305 20896 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.548964 15545 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 13, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 13 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:07:59.541769 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2867) took 1751 ms. Trace:
I20260709 13:07:59.539849 21130 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.550894 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:59.560626 21175 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:59.554697 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:07:59.567981 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.561030 15545 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 13, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 13 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.569370 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.569517 15545 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.570492 15640 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:59.561509 15644 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.542161 21013 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:59.573362 15638 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.574013 15791 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.550664 20959 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.578689 21169 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:59.578299 15545 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:07:59.579458 21210 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:59.580461 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:07:59.587535 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.605989 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.566429 21175 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:07:59.599143 15545 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.573390 21130 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:59.626639 15792 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:59.555174 15793 rpcz_store.cc:276] 0709 13:07:57.744616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.481601 (+736985us) service_pool.cc:224] Handling call
0709 13:07:58.483534 (+  1933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.484026 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.484068 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.484671 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.655284 (+170613us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:58.671544 (+ 16260us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.692020 (+ 20476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.692116 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.344232 (+652116us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:59.463368 (+119136us) raft_consensus.cc:1685] finished
0709 13:07:59.468061 (+  4693us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.495743 (+ 27682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26485,"raft.queue_time_us":53179,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":12103,"spinlock_wait_cycles":4765056,"thread_start_us":154644,"threads_started":1,"wal-append.queue_time_us":262377}
I20260709 13:07:59.630645 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:07:59.631175 15713 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:07:59.634191 15611 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.647707 20988 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:59.647338 21131 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.582415 21169 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:59.649823 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:59.575701 21138 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:07:59.545941 20885 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.623764 20426 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.602731 21146 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:59.656863 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 74006us
I20260709 13:07:59.682318 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.658617 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:07:59.664050 21138 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.663936 15545 catalog_manager.cc:5697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 3 to 16. New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.688086 15713 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:59.665939 15643 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:59.674062 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:07:59.674979 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:07:59.693051 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:07:59.695168 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.652173 21169 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.706204 15792 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:07:59.705911 15642 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:07:59.693054 21096 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.639313 20896 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.694213 21206 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.704818 21207 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.712484 21146 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:59.742383 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.743631 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.745373 20935 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.745245 21146 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.746032 20935 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.747915 21146 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.749871 20880 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:07:59.750363 21216 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:07:59.752048 21058 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:59.752648 21058 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:07:59.753757 21058 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.754396 21099 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.755017 21099 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.756217 21010 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.756657 21010 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.756999 21010 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.757098 21099 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.722623 21094 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:07:59.761950 21094 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.737490 15545 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 10, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.779805 15638 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:59.739308 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.781898 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:07:59.787635 15791 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:07:59.787386 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:07:59.825366 15642 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:07:59.831110 21101 consensus_queue.cc:1048] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:59.831959 21101 consensus_queue.cc:1243] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:59.833900 20934 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:07:59.834671 20934 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.836094 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2869) took 1913 ms. Trace:
I20260709 13:07:59.836627 15787 rpcz_store.cc:276] 0709 13:07:57.822793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.664942 (+842149us) service_pool.cc:224] Handling call
0709 13:07:58.688877 (+ 23935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.697398 (+  8521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.697445 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.703846 (+  6401us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.855998 (+152152us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.856058 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.856163 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.348134 (+491971us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:07:59.562024 (+213890us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b2400262358. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2219f9c4 00007fad2219dacb 00007fad22358dc9 00007fad22358a55 00007fad22357fb0 00007fad24fce488 00007fad24fcebe8 00007fad24fa6398 00007fad24fa176a 00007fad24fa0bb6
0709 13:07:59.712764 (+150740us) raft_consensus.cc:1685] finished
0709 13:07:59.712785 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.736085 (+ 23300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8102,"raft.queue_time_us":48356,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":22802432,"thread_start_us":151767,"threads_started":1,"wal-append.queue_time_us":214651}
I20260709 13:07:59.828887 15545 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 14, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:59.843490 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:07:59.792805 21095 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.838541 20934 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:07:59.847698 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.848888 21205 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:07:59.839435 21217 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:07:59.845643 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:07:59.849993 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:07:59.789698 21207 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.799278 21206 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:59.859705 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 225613us
I20260709 13:07:59.864508 15638 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 11: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:07:59.866814 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 82959.4us
I20260709 13:07:59.846014 20935 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:07:59.783898 21130 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.787876 21096 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.791595 21107 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:07:59.866204 21099 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:59.875970 20988 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:07:59.790956 21013 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.883056 15545 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 14, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 14 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.785473 21175 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.907884 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:07:59.887105 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.872762 20840 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.912808 15722 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:07:59.905030 15718 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:59.932425 15713 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
W20260709 13:07:59.933805 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83984.8us
I20260709 13:07:59.918895 15545 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.907647 21095 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:59.881494 21048 consensus_queue.cc:1059] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:59.885342 21207 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.888738 21206 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.914525 21099 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:07:59.945113 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77171.9us
W20260709 13:07:59.953689 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 74384.2us
I20260709 13:07:59.953831 15545 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 15, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:07:59.937567 20926 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:07:59.961695 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 102737us
I20260709 13:07:59.947247 21137 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:07:59.953156 21138 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.956760 20885 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.967774 21094 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.963438 20896 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.979596 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:07:59.971938 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:07:59.973464 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:07:59.951713 21146 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:59.965993 21205 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:07:59.977725 15545 catalog_manager.cc:5697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 10, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.972416 16298 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:07:59.988824 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2863) took 2943 ms. Trace:
I20260709 13:07:59.989292 15795 rpcz_store.cc:276] 0709 13:07:57.019050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.176130 (+1157080us) service_pool.cc:224] Handling call
0709 13:07:58.176424 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.490674 (+314250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:58.491039 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.664439 (+173400us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.665626 (+  1187us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.665806 (+   180us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:59.524261 (+858455us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18003e52a0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:07:59.864720 (+340459us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.926501 (+ 61781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.942047 (+ 15546us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.954363 (+ 12316us) raft_consensus.cc:1685] finished
0709 13:07:59.954382 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.962176 (+  7794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11733,"prepare.queue_time_us":1119244,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":12350,"raft.queue_time_us":41947,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":13631,"spinlock_wait_cycles":4710784,"thread_start_us":737127,"threads_started":3,"wal-append.queue_time_us":269557}
I20260709 13:07:59.990983 21096 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.991655 20885 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:59.993274 21218 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:59.996739 21010 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:07:59.998266 21099 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.000339 21010 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:07:59.975554 20969 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:07:59.986269 21094 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:59.968456 20926 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:07:59.991995 21224 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.041635 21215 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
W20260709 13:08:00.043674 21228 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:00.045146 21061 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.538s	user 0.002s	sys 0.006s
W20260709 13:08:00.046061 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76083.4us
I20260709 13:08:00.047798 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:00.048800 21205 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.049961 21233 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.050243 21146 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:00.050576 21233 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.050786 21146 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.052956 21233 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:00.054487 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.055217 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 88504us
I20260709 13:07:59.974118 21137 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.052982 21146 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.057756 20885 raft_consensus.cc:2764] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:00.058342 21205 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:00.059518 21205 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:00.060353 21205 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:00.067472 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 188598us
I20260709 13:08:00.075747 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.053658 21233 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:00.079970 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.081780 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.082465 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.084017 21095 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:00.085347 21207 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:00.081303 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 114189us
I20260709 13:08:00.086715 15639 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:00.086185 15545 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 13, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 13 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.063380 21205 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:00.090622 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.003644 20988 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.087868 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.115186 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.116026 15713 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.071985 20885 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.045554 21061 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.114543 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.142060 15790 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:00.144999 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 59657.1us
W20260709 13:08:00.146136 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 179934us
I20260709 13:08:00.054185 21224 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:00.147782 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 279001us
I20260709 13:08:00.149138 21224 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.149484 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.150045 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.150876 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.151501 15794 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:00.152918 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.153072 16297 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:00.153843 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.154053 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.155068 15717 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.155367 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.155740 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.156582 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.156594 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:00.157353 16334 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.157967 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.095538 21138 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.159126 21138 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.159663 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.160284 16327 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:08:00.150070 21227 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:00.161345 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:00.162011 20885 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.164173 20885 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.164324 16334 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:00.164324 15720 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:00.164856 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.166875 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.168823 15720 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:00.173323 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.175334 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.183145 21233 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:00.184727 21233 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.190651 15641 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:00.198340 15545 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 10, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.202948 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.155256 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.209861 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.211277 15722 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15.
I20260709 13:08:00.212266 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.215898 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.217033 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.217793 15717 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:00.217715 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.218482 15641 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.218763 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.219498 15717 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:00.220191 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.220839 15717 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:00.222398 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.213114 16328 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:00.141518 21242 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.169811 21095 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.149731 21224 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:00.239217 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 825) took 2486 ms. Trace:
I20260709 13:08:00.245870 21222 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.246408 21222 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:00.247340 21169 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
I20260709 13:08:00.247766 21169 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.248811 21222 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.249400 21223 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.239974 15716 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:00.249969 21223 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.251605 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.242465 21130 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.252331 21223 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.252458 21130 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.254022 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.245270 21189 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:00.223716 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:08:00.258481 15715 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.258975 15715 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:00.267016 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.271063 15714 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:00.270358 15545 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:00.267467 15639 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:00.274592 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.235541 21013 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:00.235879 21242 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:00.287617 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.288304 15545 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 10, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.294503 15644 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.304471 15713 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:08:00.305500 15639 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.245366 21224 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.245898 15789 rpcz_store.cc:276] 0709 13:07:57.576241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.431702 (+855461us) service_pool.cc:224] Handling call
0709 13:07:58.442978 (+ 11276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.443202 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:58.459197 (+ 15995us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.122288 (+663091us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180007f660. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:07:59.930978 (+808690us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.941687 (+ 10709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.951026 (+  9339us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:59.958203 (+  7177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.966563 (+  8360us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.984923 (+ 18360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492013,"prepare.queue_time_us":545474,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":80,"raft.queue_time_us":11602,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":5734,"spinlock_wait_cycles":32039808,"thread_start_us":165335,"threads_started":2,"wal-append.queue_time_us":833112}
W20260709 13:08:00.314925 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 224331us
I20260709 13:08:00.318673 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.312285 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.319084 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.320325 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.322708 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.331472 15794 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.319234 15721 raft_consensus.cc:2468] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:00.288138 21096 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.359366 15545 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.353615 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.363770 15713 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
W20260709 13:08:00.370528 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 56121.7us
I20260709 13:08:00.371363 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.364908 15716 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:00.373142 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:00.337297 15719 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 16: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:00.339857 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.343287 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.344007 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:00.344736 20426 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 13:08:00.344796 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.345302 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.377480 15717 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:00.345806 21078 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.287506 21189 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.305963 21242 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.346381 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.306308 21130 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.347643 21061 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.348237 21137 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:00.357139 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.299065 21169 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.335532 15641 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:00.378924 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.388823 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.346396 21232 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.433935 21232 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.408387 15762 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.401424 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.435458 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.435562 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.401634 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.436896 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.437491 15713 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:00.438542 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.403051 15794 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:00.440492 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.404465 15545 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 10, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.441620 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.441792 15545 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:00.442628 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.443533 15794 raft_consensus.cc:2410] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:00.443287 15545 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 11, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 11 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.444298 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.445815 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.364179 21107 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.446451 21107 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:00.447747 21107 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.448352 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.448959 21107 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.320572 21013 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.450038 15794 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:00.450677 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 80751.7us
I20260709 13:08:00.411823 21025 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:00.413272 21239 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.401252 21003 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:00.414574 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:00.414872 21236 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:00.415271 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.415918 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.417338 21224 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.381177 21096 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.418367 21095 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:00.373965 20844 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:00.418970 21189 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.422389 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.423967 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.424953 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.426267 21078 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.363755 21184 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:08:00.430039 21252 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.432219 21010 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.433512 15721 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:00.434342 21232 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.435711 15611 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.399770 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.445597 15545 catalog_manager.cc:5697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:00.497465 15790 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:00.380254 15715 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:00.475819 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.503310 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.503475 15714 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:08:00.476046 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 274207us
I20260709 13:08:00.502425 15717 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:08:00.477320 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.505220 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69567.7us
I20260709 13:08:00.478272 15794 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:00.483933 15792 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:00.498185 15796 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:00.487761 21058 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.483629 21099 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.506268 15719 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:00.494208 21061 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.482924 21003 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:00.514983 15791 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:00.497251 21252 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.516104 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 80619.6us
I20260709 13:08:00.515641 15545 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.474488 21235 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:08:00.519356 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 165784us
I20260709 13:08:00.521665 15715 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.523026 21251 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:00.523536 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.526693 21224 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.527110 21224 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:00.530051 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.531276 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.532622 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.533720 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.539225 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.541049 15721 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
W20260709 13:08:00.541491 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 239476us
I20260709 13:08:00.540400 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.543125 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.521606 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:00.511902 21205 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:00.511010 21099 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.545890 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.542178 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.547155 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.551774 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.556454 15545 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 13, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 13 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:00.520500 21252 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.575702 15715 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.575104 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.577627 21256 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:00.578377 21256 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:00.578724 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 57279.7us
I20260709 13:08:00.579768 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.580083 20926 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.579581 21256 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.580981 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.577884 21003 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.531147 21078 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:00.554857 21099 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.583995 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.576627 15545 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 11, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 11 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:00.592636 15721 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:00.581578 21096 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:00.602025 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:00.494689 21239 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.602942 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.603173 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.603338 15713 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.603503 21250 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.604048 21250 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:00.604269 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.604489 21250 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.604732 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.556197 21224 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.605993 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.606685 21224 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.607621 15545 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:00.515040 21061 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.602281 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.562386 21131 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.605495 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.610813 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.602025 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.596369 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.604389 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.609038 15545 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:00.518913 21058 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.630374 15545 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.601886 21255 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.616344 15713 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:00.634227 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.624337 15644 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:00.636058 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.636015 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:00.628626 15638 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:00.595048 21223 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.616430 15641 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:00.633322 15640 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:08:00.584208 21184 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.642975 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.593698 21189 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:00.618076 15715 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.610250 20926 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.634186 15646 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:00.610461 21205 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:00.649569 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.653697 15714 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:00.635993 21235 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:00.638360 21137 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.636270 21048 raft_consensus.cc:3055] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.687028 15719 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:00.688169 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 204481us
I20260709 13:08:00.688975 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:00.693064 15641 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:00.689944 15640 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:00.693915 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.692055 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.702824 21175 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.707625 21239 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.649448 21249 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.650650 21189 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.656184 20926 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:00.710556 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 99843.1us
I20260709 13:08:00.686733 21235 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.714475 20926 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.711272 21189 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:00.709698 20885 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.686537 21223 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:00.695158 21048 raft_consensus.cc:740] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:00.718578 21013 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.720136 21235 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:00.749646 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.722236 21061 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:00.711419 21232 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.770926 15646 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:00.774135 21223 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.775040 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.775676 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:00.775897 21260 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:00.776888 15610 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.777704 21260 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.718078 21249 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.793149 21276 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:00.817301 21245 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.577s	user 0.003s	sys 0.001s
I20260709 13:08:00.825361 15638 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.784323 21130 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.854117 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:00.767167 21205 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:00.855278 21279 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.058s	user 0.003s	sys 0.007s
W20260709 13:08:00.877584 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 52951.7us
I20260709 13:08:00.866741 21239 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:00.879958 21239 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:00.880767 21249 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.882078 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.881909 21274 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:00.884135 21274 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:00.888144 21258 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:08:00.890844 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.892284 21274 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.894209 21250 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.897655 21250 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.909790 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.911356 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.912757 21095 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.913237 21095 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:00.916265 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.916978 15716 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:00.919225 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:00.918987 15720 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:00.912530 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:00.920663 15722 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:00.837589 21013 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:00.948562 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:00.951627 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:00.913610 21095 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.958280 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.959146 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:00.918927 21058 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:00.974169 15794 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:00.826861 21048 consensus_queue.cc:260] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:00.979216 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.980695 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:00.984622 15716 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.951890 20896 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.987944 15722 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15.
W20260709 13:08:00.989456 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.994058 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 77373.9us
I20260709 13:08:00.964303 21254 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:00.967595 21131 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.019083 15645 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:01.020263 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.020643 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 69114.7us
I20260709 13:08:01.031247 20426 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:01.021657 20896 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:01.035089 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:01.036172 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 117038us
I20260709 13:08:01.039499 15722 raft_consensus.cc:2376] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13. Re-sending same reply.
I20260709 13:08:01.048161 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:01.051147 21048 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.955251 21013 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.054986 20935 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.055938 20935 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:01.029031 21254 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.058310 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:01.058733 21254 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.059427 21264 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:01.059669 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:01.060005 21264 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.061965 21265 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.062493 21265 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.064736 21265 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.046433 20896 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:01.061018 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:01.066774 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 71671.5us
I20260709 13:08:01.067536 20426 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.990388 21078 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:01.068010 20426 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.069679 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.071266 15722 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:08:01.077756 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.059926 21254 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.070956 20896 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:01.111433 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.030357 21233 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.111761 16297 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:01.130340 20840 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.130242 20926 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.131076 20840 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.132635 20926 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.132905 21010 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:01.071815 21078 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.197285 15718 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:01.137434 15716 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:01.174669 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.167729 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.141776 15793 raft_consensus.cc:1240] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.215075 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2130) took 1062 ms. Trace:
I20260709 13:08:01.167996 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:01.175786 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.217440 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:01.141198 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.156952 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:08:01.188710 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 119118us
I20260709 13:08:01.222206 20426 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.223133 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.223860 15639 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:01.216578 15718 rpcz_store.cc:276] 0709 13:08:00.152863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.155101 (+  2238us) service_pool.cc:224] Handling call
0709 13:08:01.196769 (+1041668us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b58001e2798. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3dffc0 00007fad2a3ca929 00007fad2a3ca3d2 00007fad23941bd4
0709 13:08:01.197054 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.214759 (+ 17705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.215011 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26714496}
I20260709 13:08:01.224776 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:01.141601 21242 consensus_meta.cc:287] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.004s
I20260709 13:08:01.230101 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:01.192963 21252 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.002s
I20260709 13:08:01.233829 15645 raft_consensus.cc:2410] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:01.234314 15714 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:01.133507 20840 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.140627 21249 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.236352 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:01.239441 15640 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:01.128520 21232 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.241361 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.181959 21239 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.190230 21137 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.186348 21264 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.133915 21277 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.139672 20880 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.239746 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.274416 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:01.123519 20934 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:01.190023 21255 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:01.263616 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.263700 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.237478 21207 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.263701 16328 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:01.266673 15714 pending_rounds.cc:85] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 9
I20260709 13:08:01.278015 15647 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:01.168890 21281 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:01.245393 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.133620 21010 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.128216 21233 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.271994 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.272686 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.273180 21294 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:01.299623 21294 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:01.303709 21189 consensus_meta.cc:287] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.001s
I20260709 13:08:01.303874 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2412) took 1242 ms. Trace:
I20260709 13:08:01.304387 15642 rpcz_store.cc:276] 0709 13:08:00.061352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.062264 (+   912us) service_pool.cc:224] Handling call
0709 13:08:00.088545 (+ 26281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.207290 (+118745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.207320 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.745384 (+538064us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800260320. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a
0709 13:08:00.745887 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.995343 (+249456us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.995383 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.995462 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.303470 (+308008us) raft_consensus.cc:1685] finished
0709 13:08:01.303499 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.303773 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61940,"raft.queue_time_us":77741,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":12537,"spinlock_wait_cycles":6948608,"thread_start_us":223071,"threads_started":1,"wal-append.queue_time_us":393564}
I20260709 13:08:01.273710 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:01.307392 15792 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:01.307085 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.308205 15642 raft_consensus.cc:2368] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15.
I20260709 13:08:01.277446 15718 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:01.264495 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.308992 15638 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:01.278172 15789 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:01.239629 21249 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.310786 15788 raft_consensus.cc:2393] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:01.281301 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.311765 15795 raft_consensus.cc:2410] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:08:01.282279 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 106572us
I20260709 13:08:01.279374 15794 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:01.189003 21253 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:08:01.270515 21137 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.304339 21189 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:01.290443 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.290771 21081 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:01.290985 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 55005.9us
I20260709 13:08:01.291584 21274 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.292922 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.293668 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.246856 21235 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:01.296418 21248 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.871s	user 0.006s	sys 0.004s
I20260709 13:08:01.275336 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.312630 15794 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:01.285108 21107 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.005s
I20260709 13:08:01.297401 21010 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.279750 15714 pending_rounds.cc:107] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:01.345708 15714 raft_consensus.cc:2889] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.322633 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.323518 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.324198 15718 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:01.332369 15794 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.306373 20896 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.286226 20934 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.242628 21252 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.327860 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.295506 21095 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.327879 15790 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:01.375419 16326 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:01.331327 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.339578 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.342022 21233 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.331959 15787 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:01.319151 21249 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.336495 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.240584 21242 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.347795 15794 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.286680 21269 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.351811 15645 raft_consensus.cc:2368] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17.
I20260709 13:08:01.282392 20880 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.353900 15795 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:01.388226 16330 raft_consensus.cc:2393] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:01.356904 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.357363 21289 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:01.354959 21010 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:01.353266 21294 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.371624 21235 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.286037 21255 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.370939 21189 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.333014 21078 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.441123 21078 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.442621 21255 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.394043 21238 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:01.443984 21297 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:01.377818 15642 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:01.446571 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.447355 15642 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:01.448215 21242 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.374215 21253 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:01.451387 21253 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.451979 21253 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.455401 21252 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.459411 15793 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.449602 15642 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:01.380010 20934 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.382220 15718 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:01.371572 21099 consensus_meta.cc:287] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260709 13:08:01.515265 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.386731 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:01.386600 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58907.5us
I20260709 13:08:01.383627 15792 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:01.385308 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.310774 21281 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.395123 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.517956 15638 raft_consensus.cc:2393] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:01.388990 15787 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:08:01.517998 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 51681.7us
I20260709 13:08:01.518494 15787 pending_rounds.cc:85] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 7
I20260709 13:08:01.518774 15787 pending_rounds.cc:107] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:01.519016 15787 raft_consensus.cc:2889] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.360051 21131 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:01.400851 16329 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:01.385775 20896 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.388145 21175 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.399986 21269 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.516713 15790 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:01.520460 21099 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.520897 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.536237 15794 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
W20260709 13:08:01.521451 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 188712us
I20260709 13:08:01.533573 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.522516 15642 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:01.530359 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:01.557144 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.522660 21281 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.514971 21294 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.397253 21289 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.521545 21095 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.383333 21094 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.131s
W20260709 13:08:01.529639 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.524539 20934 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:01.410663 21010 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:01.519868 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 134634us
I20260709 13:08:01.568691 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:01.567732 15639 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:01.559680 21297 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 13:08:01.453445 21253 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.577651 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.582577 16334 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:01.586236 15796 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 13: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:08:01.592592 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76163.9us
I20260709 13:08:01.592919 15789 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:01.593375 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.564800 21232 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.593969 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2898) took 1221 ms. Trace:
I20260709 13:08:01.597252 16327 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:01.597995 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:01.594452 15791 rpcz_store.cc:276] 0709 13:08:00.366972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.435190 (+ 68218us) service_pool.cc:224] Handling call
0709 13:08:01.587842 (+1152652us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b540016d5d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:01.587963 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181374720}
I20260709 13:08:01.576630 20934 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.599490 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.579533 20844 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.599953 15688 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:01.601418 21264 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.602855 21255 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:01.600627 21263 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:01.603410 21255 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:01.603648 21263 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.604136 21263 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.604357 21255 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.601068 21238 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:01.601418 21298 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:01.608055 21269 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.608469 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.600800 21010 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.610361 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 806) took 1245 ms. Trace:
I20260709 13:08:01.558735 21189 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:01.578150 21081 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.566247 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:01.609992 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.610750 15716 rpcz_store.cc:276] 0709 13:08:00.375419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.227382 (+851963us) service_pool.cc:224] Handling call
0709 13:08:01.227749 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.264544 (+ 36795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.264576 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.268274 (+  3698us) log.cc:844] Serialized 52 byte log entry
0709 13:08:01.383044 (+114770us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:01.402483 (+ 19439us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.402745 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.402843 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.610135 (+207292us) raft_consensus.cc:1685] finished
0709 13:08:01.610154 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.610299 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19236,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":22558,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6328,"spinlock_wait_cycles":15389568,"thread_start_us":113536,"threads_started":1,"wal-append.queue_time_us":287032}
I20260709 13:08:01.613806 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.614250 20934 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.621855 21269 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.614496 16327 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:01.624258 21263 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.590958 21252 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:01.598003 21095 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:01.617622 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.625218 21095 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.587440 21281 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.626377 21095 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.627070 21094 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.627664 21095 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.627696 21094 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.628460 21094 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.633517 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.634943 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:01.635718 15638 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 16: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:01.636209 20880 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.636929 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 802) took 1296 ms. Trace:
I20260709 13:08:01.638574 21013 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:01.638913 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.637322 15719 rpcz_store.cc:276] 0709 13:08:00.340811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.694990 (+354179us) service_pool.cc:224] Handling call
0709 13:08:00.712193 (+ 17203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.718219 (+  6026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.718241 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.718635 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.904490 (+185855us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18000fb140. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319557 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:00.966531 (+ 62041us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:01.035807 (+ 69276us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.036050 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.036125 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.631499 (+595374us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b18000fb140. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:01.636701 (+  5202us) raft_consensus.cc:1685] finished
0709 13:08:01.636724 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.636847 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69491,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":34351,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":30093,"spinlock_wait_cycles":10205824,"thread_start_us":206986,"threads_started":1,"wal-append.queue_time_us":328650}
I20260709 13:08:01.640149 15719 pending_rounds.cc:85] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 11
I20260709 13:08:01.640503 15719 pending_rounds.cc:107] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:08:01.640781 15719 raft_consensus.cc:2889] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.625185 21252 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.644569 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 796) took 1306 ms. Trace:
I20260709 13:08:01.561685 21289 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.645112 15717 rpcz_store.cc:276] 0709 13:08:00.338634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.583320 (+244686us) service_pool.cc:224] Handling call
0709 13:08:00.597504 (+ 14184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.641661 (+1044157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.641698 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.643561 (+  1863us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:01.643614 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.644321 (+   707us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003bcc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:01.644367 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.644507 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400833280}
I20260709 13:08:01.646415 21289 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.645486 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.646951 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2601) took 1047 ms. Trace:
I20260709 13:08:01.647323 15643 rpcz_store.cc:276] 0709 13:08:00.599355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.605295 (+  5940us) service_pool.cc:224] Handling call
0709 13:08:01.646762 (+1041467us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54000e79d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:01.646875 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607940992}
I20260709 13:08:01.647746 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.644716 21252 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.649055 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:01.649840 21265 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:01.649806 21264 consensus_queue.cc:1175] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fec10611791a4ab384f86b212249410e" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 8 } }
I20260709 13:08:01.650696 21265 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.651360 21265 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.651500 15640 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:01.651739 21265 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:01.652329 21265 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.652812 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.653522 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.654522 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:01.654776 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.655387 15639 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:01.656042 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.566601 21175 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:01.656636 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.624270 21137 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:01.658651 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 48660.3us
I20260709 13:08:01.564972 21294 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.662621 21249 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.665670 21206 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.666627 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2162) took 1328 ms. Trace:
I20260709 13:08:01.670374 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2140) took 1454 ms. Trace:
I20260709 13:08:01.677105 15720 rpcz_store.cc:276] 0709 13:08:00.215961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.216115 (+   154us) service_pool.cc:224] Handling call
0709 13:08:00.918755 (+702640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.920177 (+  1422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.670195 (+750018us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54001e7b50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:01.670320 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615224576}
I20260709 13:08:01.671929 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.679618 15643 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.672470 15639 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:08:01.675524 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.676148 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.645442 21263 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.677978 15713 rpcz_store.cc:276] 0709 13:08:00.338243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.438294 (+100051us) service_pool.cc:224] Handling call
0709 13:08:01.666381 (+1228087us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54001e7154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:01.666509 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377742592}
I20260709 13:08:01.689429 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.691568 16327 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:01.696935 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:01.704504 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.701839 15762 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.674585 21281 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.707319 16325 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:01.708230 16325 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:01.690057 21264 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.700448 21184 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.724292 15688 leader_election.cc:400] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15.
I20260709 13:08:01.708642 21013 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:08:01.678315 20934 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.734506 21252 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.737583 15688 leader_election.cc:403] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.745842 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:01.747360 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 801) took 1406 ms. Trace:
I20260709 13:08:01.747810 15715 rpcz_store.cc:276] 0709 13:08:00.340469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.649501 (+309032us) service_pool.cc:224] Handling call
0709 13:08:00.651186 (+  1685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.696351 (+ 45165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.696402 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.696471 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:00.696505 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.747070 (+1050565us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b540003be54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:01.747126 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.747294 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103212288}
I20260709 13:08:01.714489 21095 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:01.714395 21238 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.710345 21206 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:01.718526 16325 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.750590 21078 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.718761 21175 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.757192 16325 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.770304 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.770865 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.710776 21281 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.793488 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.772553 21277 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.795344 21281 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.771531 15790 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:01.796754 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:01.797300 15790 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.797422 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.798730 21099 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.802220 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 721) took 1175 ms. Trace:
I20260709 13:08:01.807778 15792 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:01.802630 16330 rpcz_store.cc:276] 0709 13:08:00.595941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.596071 (+   130us) service_pool.cc:224] Handling call
0709 13:08:01.771446 (+1175375us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54006cfcd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:01.771598 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745533184}
W20260709 13:08:01.770625 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.774185 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.774492 21138 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:01.775647 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51539.7us
W20260709 13:08:01.778062 16329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 715) took 1663 ms (client timeout 1960 ms). Trace:
I20260709 13:08:01.717427 21058 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:01.752120 21184 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.835935 15643 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:01.783730 21094 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.785573 21294 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.758947 21078 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:01.786263 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:01.786542 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:01.787205 21249 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.787695 21263 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:01.791632 16333 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:01.743813 20880 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:08:01.855660 20880 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:01.855782 20934 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.856158 20880 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:01.857156 21094 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:01.857046 20880 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.833990 16332 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:01.764212 21206 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:01.823530 16329 rpcz_store.cc:269] 0709 13:08:00.114464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.141964 (+ 27500us) service_pool.cc:224] Handling call
0709 13:08:01.777832 (+1635868us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004efa54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:01.777981 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874466688}
I20260709 13:08:01.783129 20426 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.863056 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:01.841334 21223 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.838697 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.840082 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.869158 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.840600 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.764871 21095 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.841447 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:01.843559 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:01.876578 15789 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:01.844007 16334 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 13: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:01.845146 21078 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.824664 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:01.861101 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:01.839174 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 153103us
I20260709 13:08:01.746367 21222 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:01.864115 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:01.873899 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:01.882144 15643 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.874519 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:01.882460 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 57900.7us
I20260709 13:08:01.882779 15645 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.838804 21269 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:08:01.879365 15794 raft_consensus.cc:606] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:01.883457 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.881336 15715 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:01.884613 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:01.886061 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.867967 20880 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.906105 21253 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.907963 15715 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:01.908995 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:01.840983 21184 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.905537 15790 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:01.891862 21058 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.894317 21095 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.894556 21265 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.896334 21182 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.896735 21238 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.864789 21013 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:01.897780 21304 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 13:08:01.876088 21223 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.899796 21255 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:01.965066 15717 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:01.965154 15788 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:01.900060 21277 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15.
I20260709 13:08:01.975116 21184 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.977276 21223 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.881460 21239 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:08:01.902102 21206 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.919358 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:01.919656 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 200794us
I20260709 13:08:01.924695 15645 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:01.871673 21169 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:01.984416 16325 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:01.909588 15715 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:01.985509 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:01.931145 15643 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:01.956694 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:01.878659 21099 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:01.990232 21099 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.990918 21265 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.887992 21137 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:01.932156 21094 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.991150 21099 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.991823 21189 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:01.991766 21094 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.983426 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.992415 21189 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.888705 20870 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:01.994832 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.991133 15713 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:01.996109 21291 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:01.996567 21081 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:01.996659 21291 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.997105 21081 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:01.997565 21291 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:01.998039 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 135481us
I20260709 13:08:01.985729 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:01.978960 21252 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:01.995707 20934 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:01.988082 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.000564 21081 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:02.006387 21301 log.cc:927] Time spent T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.115s	user 0.000s	sys 0.004s
I20260709 13:08:02.007345 20880 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:01.960397 21013 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.008044 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:02.008577 20880 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:02.008838 21256 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:02.009253 21256 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.010023 21013 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.010169 21249 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:01.960083 20959 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:08:02.010648 21249 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.010200 21256 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.011608 21256 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.011606 21249 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.012748 21249 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.984074 21255 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:02.014075 21175 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:02.015259 21255 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:01.989526 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:02.016412 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.017035 15722 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:02.008595 15795 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.990645 21078 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:01.994194 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.023093 15717 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:02.022873 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 370416us
I20260709 13:08:01.984748 21169 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.023279 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:02.025381 15790 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:02.026786 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.024797 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.027529 15639 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.031770 15643 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:02.035449 15643 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:08:02.037071 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.038152 15722 raft_consensus.cc:2410] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:02.017758 21010 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.041352 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.045881 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.046357 15645 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:02.046674 15646 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.043327 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:02.045248 15647 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:02.043709 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 808) took 1602 ms. Trace:
I20260709 13:08:02.044647 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.047737 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.042356 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:02.049094 16297 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:01.994746 21189 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.045231 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.058239 15638 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.034258 21169 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.039059 21137 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.060184 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.061107 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:02.059118 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.056603 15644 raft_consensus.cc:2393] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 13: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:02.047925 15714 rpcz_store.cc:276] 0709 13:08:00.441344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.266027 (+824683us) service_pool.cc:224] Handling call
0709 13:08:01.266376 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.386314 (+119938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.386369 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.398056 (+ 11687us) log.cc:844] Serialized 52 byte log entry
0709 13:08:01.735756 (+337700us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:01.753755 (+ 17999us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.761798 (+  8043us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.762000 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.762079 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.800863 (+ 38784us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b18000ee600. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f
0709 13:08:01.857913 (+ 57050us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:08:02.005593 (+147680us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:02.043452 (+ 37859us) raft_consensus.cc:1685] finished
0709 13:08:02.043481 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.043640 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45898,"prepare.queue_time_us":54600,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":17462,"raft.run_cpu_time_us":3435,"raft.run_wall_time_us":106909,"spinlock_wait_cycles":108237696,"thread_start_us":293066,"threads_started":1,"wal-append.queue_time_us":421211}
I20260709 13:08:02.069268 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:02.069543 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.070425 15714 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.070574 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:02.036285 21206 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:02.045503 21010 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.065281 15639 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:02.057410 21265 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:02.082834 21265 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.083214 21265 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:02.083988 21265 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.085361 21265 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.057870 21223 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.086025 21223 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.088570 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.089265 15713 raft_consensus.cc:3060] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.090077 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.090466 21094 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:02.090848 15718 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:02.068076 21137 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.091408 21137 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.091816 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.093076 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.075162 15611 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.096700 21078 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:02.075726 21222 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:02.097347 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.074399 21138 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.098296 21222 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:02.098656 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.098937 21222 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:02.067104 21239 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.099946 21222 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.100196 21239 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.097880 20896 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:02.106482 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:02.107534 21078 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.107697 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3291) took 1193 ms. Trace:
I20260709 13:08:02.107852 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:02.108843 21253 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.109231 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:02.108246 15716 rpcz_store.cc:276] 0709 13:08:00.914692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.621358 (+706666us) service_pool.cc:224] Handling call
0709 13:08:01.621662 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.621997 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.622026 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.622551 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.841418 (+218867us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:01.841458 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.841523 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.107497 (+265974us) raft_consensus.cc:1685] finished
0709 13:08:02.107517 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.107642 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1600,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":218522,"threads_started":1,"wal-append.queue_time_us":448320}
I20260709 13:08:02.076359 21175 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:02.111200 21175 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:02.111658 21175 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.113891 21010 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.110376 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.060588 21242 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.116271 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3294) took 1200 ms. Trace:
I20260709 13:08:02.064150 21232 raft_consensus.cc:2804] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.122852 15713 raft_consensus.cc:2468] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:02.123098 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.121438 15795 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:02.123106 15717 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:02.064293 21262 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:02.132076 21189 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.118906 21242 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.132483 21189 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.133152 21242 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.133728 21189 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.135478 21189 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.137110 15716 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:02.138809 15713 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:02.143239 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:02.146083 21253 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.146534 21253 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:02.146636 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:02.146957 21253 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.147851 15760 leader_election.cc:400] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15.
I20260709 13:08:02.148725 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:02.151566 21232 raft_consensus.cc:697] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.152400 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.152990 15722 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.098299 21138 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:02.152534 21232 consensus_queue.cc:237] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:02.162299 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 88012.8us
W20260709 13:08:02.156642 15719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.021s	sys 0.020s
I20260709 13:08:02.156947 15638 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:02.163225 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.118940 15721 rpcz_store.cc:276] 0709 13:08:00.915435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.628252 (+712817us) service_pool.cc:224] Handling call
0709 13:08:01.628545 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.628871 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.628897 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.629368 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.845836 (+216468us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:01.845876 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.845951 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.116079 (+270128us) raft_consensus.cc:1685] finished
0709 13:08:02.116097 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.116218 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10362,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":216081,"threads_started":1,"wal-append.queue_time_us":421585}
I20260709 13:08:02.145548 21249 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:02.169776 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:02.178416 16332 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:02.170658 15688 leader_election.cc:400] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17.
I20260709 13:08:02.166152 21254 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.179522 15688 leader_election.cc:403] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.140805 21264 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:02.181047 15640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.015s	sys 0.012s
I20260709 13:08:02.182734 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.153900 21138 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:02.184636 15640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.015s	sys 0.012s
I20260709 13:08:02.198706 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:02.200206 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.183604 21254 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:02.202014 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:02.202529 21254 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.202930 16333 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:02.205843 21262 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.207126 21233 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:02.207958 21233 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.208261 21233 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.198261 21169 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.162681 21078 raft_consensus.cc:2764] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:02.214046 15720 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:02.198458 21256 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:08:02.166309 21294 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.178851 21131 raft_consensus.cc:2764] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:08:02.181203 21251 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:02.218572 21251 consensus_queue.cc:1243] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:08:02.221861 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51357.6us
I20260709 13:08:02.222173 21239 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:02.223191 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.224376 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.226203 21048 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.198776 21249 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.225415 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.227612 21249 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.232839 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.238034 21131 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.238821 21131 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:02.239848 21131 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.237934 21013 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17.
I20260709 13:08:02.248992 15722 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:02.266661 15646 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:02.261533 15714 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:08:02.284165 15717 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:02.225256 21253 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:02.313369 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 164687us
I20260709 13:08:02.321847 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.314762 21189 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.342113 21094 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.347474 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:02.345803 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 459797us
W20260709 13:08:02.355685 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 280923us
I20260709 13:08:02.314601 21010 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.316912 21242 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.353989 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:02.378118 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:02.378935 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.358371 21294 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.376036 21238 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.357156 21189 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.388474 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:02.376641 20934 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.380210 21013 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.385118 21094 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.398407 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.428345 15795 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.423940 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
W20260709 13:08:02.468482 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44110.8us
I20260709 13:08:02.445396 20426 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.386006 21238 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:02.469257 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:02.468705 15790 raft_consensus.cc:606] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:02.473011 15790 raft_consensus.cc:614] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:02.397547 21239 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.491617 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.499243 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.502637 15717 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
W20260709 13:08:02.507067 21315 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:08:02.510169 21311 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:08:02.512452 21313 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:08:02.513850 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44683.2us
I20260709 13:08:02.514695 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:02.516973 21274 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.517428 21274 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:02.517859 21274 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.518086 21013 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:02.519912 21013 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:02.526414 21314 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:02.530043 21274 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.532474 21010 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:02.533531 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.533946 21189 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.535653 21274 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.536242 21274 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.538074 21242 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.536693 21274 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.387344 21294 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.517055 20870 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.548013 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3295) took 1516 ms. Trace:
I20260709 13:08:02.585242 15719 rpcz_store.cc:276] 0709 13:08:01.032014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.639542 (+607528us) service_pool.cc:224] Handling call
0709 13:08:01.639941 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.641355 (+  1414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.641407 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.656300 (+ 14893us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.164277 (+507977us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:02.164332 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.164430 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.547790 (+383360us) raft_consensus.cc:1685] finished
0709 13:08:02.547811 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.547954 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":506736,"threads_started":1,"wal-append.queue_time_us":681801}
I20260709 13:08:02.397466 21327 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.580740 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.403455 21281 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 13:08:02.429528 21137 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.604465 15638 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.605175 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.490315 21238 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.491247 20880 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.497152 21239 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:02.424659 21175 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.655964 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.465219 21260 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:08:02.541663 21169 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.664705 15641 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:02.606906 20870 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:02.671286 15639 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:08:02.487457 21277 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:08:02.692868 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.664216 21095 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.660811 16298 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:02.672194 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.607326 21253 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:02.684860 15642 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:08:02.669399 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 278368us
I20260709 13:08:02.698740 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:02.674276 21328 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:08:02.679561 21239 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.700271 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.708971 15639 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:02.714560 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53848us
I20260709 13:08:02.681630 21327 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.688522 21260 consensus_queue.cc:1243] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:02.725132 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.726014 15646 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:02.731858 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 215306us
I20260709 13:08:02.734474 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:02.738636 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:02.743364 15640 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:02.706672 21274 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.765815 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:02.718501 21331 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.771442 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.771049 15722 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:08:02.747071 21277 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:02.757555 20934 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:02.775017 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 343652us
I20260709 13:08:02.785939 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.790387 15713 raft_consensus.cc:2376] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17. Re-sending same reply.
I20260709 13:08:02.780644 15646 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:02.776350 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.800108 16328 pending_rounds.cc:85] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 11
I20260709 13:08:02.801218 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:02.801330 16328 pending_rounds.cc:107] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:02.802187 16328 raft_consensus.cc:2889] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.803916 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.811245 15611 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.811528 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:02.812875 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:02.815618 15646 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:02.810484 21169 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.785193 21281 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.828759 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:02.788069 21277 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:02.767390 21330 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:08:02.796552 21274 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:02.721288 15530 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8ca6a5ab086d47e5a79ef37ddead9f28 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:02.844076 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:02.863078 15790 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:02.858079 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46625.4us
I20260709 13:08:02.868155 15715 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.877723 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:02.878564 15715 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.866246 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:02.886155 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 51089.4us
I20260709 13:08:02.820477 21294 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.823544 21206 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:02.818763 21137 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.896339 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:02.814813 21255 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:02.838721 21260 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.792128 20870 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.836024 21281 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:02.837530 21277 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.812767 21184 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:08:02.864624 21269 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.888695 21010 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.914665 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 138442us
I20260709 13:08:02.888916 21169 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:02.919220 15790 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
W20260709 13:08:02.893905 15530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 172811us
W20260709 13:08:02.900876 21325 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:08:02.921396 21320 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:08:02.922437 21319 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:08:02.923298 21322 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:08:02.924374 21326 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
W20260709 13:08:02.924922 21332 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 13:08:02.925182 21321 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:08:02.947857 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3310) took 1028 ms. Trace:
I20260709 13:08:02.948300 15718 rpcz_store.cc:276] 0709 13:08:01.918984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.131535 (+212551us) service_pool.cc:224] Handling call
0709 13:08:02.131889 (+   354us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:02.132574 (+   685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.132598 (+    24us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:02.133339 (+   741us) log.cc:844] Serialized 78 byte log entry
0709 13:08:02.384673 (+251334us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:02.384721 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.384791 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.947577 (+562786us) raft_consensus.cc:1685] finished
0709 13:08:02.947602 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.947795 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":243358,"threads_started":1,"wal-append.queue_time_us":467842}
I20260709 13:08:02.894578 21330 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:02.927129 21233 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.950608 15718 pending_rounds.cc:85] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 8
I20260709 13:08:02.950807 21233 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.928164 15795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:02.954038 15795 raft_consensus.cc:606] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:02.932639 21333 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.954712 21333 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.955446 21269 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:02.955853 21330 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.956061 21269 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:02.956295 21330 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:02.862541 21336 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:08:02.936318 21169 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.915241 21340 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.942459 21260 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:02.947265 21323 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:02.900444 21206 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.874809 21274 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.913864 21281 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.950971 15718 pending_rounds.cc:107] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:02.975262 15718 raft_consensus.cc:2889] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.837095 21327 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:02.931308 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:02.972910 16325 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.945502 21175 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.966235 21169 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.957207 21333 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:02.981997 21222 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:02.999289 15715 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:02.983312 21274 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:02.985388 21260 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:02.988297 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 289608us
I20260709 13:08:02.936764 21010 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.957151 21269 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:02.957294 21330 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:03.039690 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 108508us
W20260709 13:08:03.029652 21254 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.000s
I20260709 13:08:03.053805 16327 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:02.970079 21340 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.027695 21255 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.059134 16325 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:03.063196 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.064383 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.066349 21010 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:03.067346 21206 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.069187 21330 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.073122 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:03.080178 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.084192 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:03.084697 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:03.085690 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:03.087663 21206 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.088306 21206 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:03.088454 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.088766 21206 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.087705 21355 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:03.090641 21350 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:03.092694 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:03.093219 15641 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:03.094543 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.095337 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.098426 21294 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.098839 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.099000 21294 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.100272 21336 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:03.100704 21336 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:03.101138 21294 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.106082 21368 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.107666 21281 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.071309 21265 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:03.060194 21254 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.122548 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.123255 16325 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 9.
I20260709 13:08:03.101636 21010 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:08:03.077304 21255 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.127746 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.164953 21366 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:03.130996 21340 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:03.165602 21369 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:03.163142 21349 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:08:03.119956 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:03.131805 21281 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.122699 21355 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.167389 21081 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:03.168977 21223 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:03.175155 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 51810.3us
I20260709 13:08:03.145550 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:03.143802 21354 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:08:03.136777 21337 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:08:03.174152 21366 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.180294 21353 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:03.181559 21338 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.266s	user 0.000s	sys 0.002s
W20260709 13:08:03.184207 21238 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
W20260709 13:08:03.189038 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 304455us
W20260709 13:08:03.198347 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.205771 15715 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.246393 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:03.135226 21335 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:08:03.132498 21254 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:03.123713 21364 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:03.152364 21265 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.241878 21081 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:03.245339 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 137204us
I20260709 13:08:03.244336 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:03.276826 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 198909us
I20260709 13:08:03.282550 20426 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.282950 20426 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.283445 20426 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.282950 16297 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:03.286342 16328 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:03.274035 21138 consensus_meta.cc:287] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.048s	user 0.012s	sys 0.002s
I20260709 13:08:03.290793 16328 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:03.292987 15715 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:03.305230 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:03.302047 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.306033 15719 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:03.296661 15645 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:03.310910 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:03.273836 21233 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:03.277349 21333 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.369246 16332 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.207357 21369 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.295725 21048 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:03.250337 21355 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.368263 21348 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.402304 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.403889 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:03.405891 15714 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.404393 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:03.407413 20426 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.275159 21238 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.408654 15715 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.287616 21265 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.415287 20426 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.352502 21254 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:08:03.417423 21365 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:03.400862 21184 consensus_queue.cc:1059] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:03.418606 21349 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.418258 21365 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.419224 21349 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.425590 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3312) took 1321 ms. Trace:
I20260709 13:08:03.426250 15716 rpcz_store.cc:276] 0709 13:08:02.104633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.178202 (+ 73569us) service_pool.cc:224] Handling call
0709 13:08:02.391708 (+213506us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:02.425278 (+ 33570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.425311 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:02.466347 (+ 41036us) log.cc:844] Serialized 78 byte log entry
0709 13:08:02.718449 (+252102us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:02.718500 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.718571 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.133358 (+414787us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:03.425171 (+291813us) raft_consensus.cc:1685] finished
0709 13:08:03.425201 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.425512 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43351,"raft.queue_time_us":28211,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":37987,"spinlock_wait_cycles":11017600,"thread_start_us":109859,"threads_started":1,"wal-append.queue_time_us":319811}
I20260709 13:08:03.430154 15720 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:03.431531 21238 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.434818 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:03.435374 15790 raft_consensus.cc:606] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:03.435669 15790 raft_consensus.cc:614] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:03.442307 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:08:03.443094 21370 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:03.444193 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:03.444885 15717 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:03.447904 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.448982 16334 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:03.450069 21081 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.312002 21138 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.405506 21048 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:03.414139 21348 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.285344 21364 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.266635 21353 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:03.411115 21239 consensus_meta.cc:287] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.001s
I20260709 13:08:03.455574 15719 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 11: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:03.445371 15717 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:03.394532 21281 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:03.379952 21233 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.464931 15714 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:03.354832 21342 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 13:08:03.476271 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:03.421558 21365 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.421576 21349 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.477008 15716 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:03.453506 21138 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.460758 20870 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:03.484098 16334 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:03.489173 15717 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.503961 15717 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.505079 15719 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:03.476697 15715 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:03.498817 15716 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.461660 21169 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.486629 21184 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.522325 15788 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:03.508566 21340 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.524955 21340 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.509043 20870 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.556501 21184 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.519925 20934 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:03.526400 15790 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:03.482568 21239 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.588866 15717 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:03.484293 21281 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.591719 15717 pending_rounds.cc:85] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 7
I20260709 13:08:03.592639 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:03.592036 15717 pending_rounds.cc:107] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:03.594096 15717 raft_consensus.cc:2889] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.597726 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:03.601003 15647 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:03.591027 21277 consensus_meta.cc:287] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.651s	user 0.015s	sys 0.000s
I20260709 13:08:03.570044 21094 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:03.598075 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:03.603291 15722 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.604269 15794 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.605876 15718 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:03.614554 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.620261 15794 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.596858 21366 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.598693 21369 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:03.615731 21381 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:03.657155 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.607282 21385 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:03.658207 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.660851 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.663074 15794 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.663468 16334 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:03.570008 21048 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.660269 15789 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:03.645078 21349 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.622318 21255 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.669968 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.600772 20934 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.674746 15793 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:03.675144 15787 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.677518 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.683741 15791 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:03.610858 21277 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.662235 21340 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:03.611480 21094 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:03.689769 21382 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:08:03.691816 21373 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:03.692086 20934 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.681599 21233 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.689779 21353 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.694830 21239 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.689803 20870 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.689762 15791 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:03.697014 15787 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:03.697285 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.698719 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.698414 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.701428 21281 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.705520 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.719353 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.720052 15793 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:03.720881 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.722477 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:03.722996 15717 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:03.722666 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.725080 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:03.681840 21169 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.724252 15789 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:03.732493 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.732585 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:03.698410 21380 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:08:03.717694 21340 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.733382 15791 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:03.689600 21390 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.734238 15793 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:03.737030 15794 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:03.703821 21348 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.746743 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.748574 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.680063 21349 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.752866 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:03.755398 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.764318 21094 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:03.753082 21353 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:03.750213 21340 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.770478 21353 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.773722 21349 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.774025 21379 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.751906 21390 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.774844 21379 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:03.776856 21390 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:03.777951 15787 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
W20260709 13:08:03.755335 21206 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 13:08:03.780571 21379 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.780220 21206 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.783510 21206 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.784030 21391 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:03.779665 21378 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:08:03.781002 21316 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:03.784400 21386 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:03.682483 21385 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.789705 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.856200 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.864219 15791 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.864854 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.919847 15789 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:03.867447 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.866978 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.921343 16329 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:03.921478 16334 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:03.865103 15794 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:03.898866 21340 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.864720 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.924237 15787 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 10.
W20260709 13:08:03.909430 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 184610us
I20260709 13:08:03.925827 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:03.927178 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:03.867800 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:03.922827 15793 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:08:03.853564 21316 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:03.930792 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.785451 21377 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:03.930557 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:03.878471 21352 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:08:03.868726 21277 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.903277 21355 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:03.867300 21402 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.934162 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.950317 15789 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:03.933463 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2627) took 1350 ms. Trace:
I20260709 13:08:03.953791 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:03.787457 21364 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.958241 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.959276 15789 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:08:03.942265 21189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.021s	sys 0.016s
I20260709 13:08:03.925134 21385 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:03.946617 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:03.932734 15793 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:04.006664 15787 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.009876 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.010299 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:03.934900 21340 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:03.942668 21354 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:03.944401 21377 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:03.960140 21391 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.023402 15789 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:03.961234 21189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.023s	sys 0.017s
I20260709 13:08:04.027180 15793 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:04.034669 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.010885 21265 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:04.035995 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 102647us
I20260709 13:08:03.959887 21402 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.040333 15793 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:04.024078 21354 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.038224 15787 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:04.040287 21251 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:04.051873 15793 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:03.929873 21390 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:04.072438 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 112265us
I20260709 13:08:04.073439 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:04.099998 15791 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:04.043190 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.042330 21344 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.108307 15787 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.030666 21377 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.109536 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:04.070618 21359 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.112768 15788 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:04.110598 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.118940 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:04.120219 21375 raft_consensus.cc:2764] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:04.120024 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.120256 21377 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.121356 21390 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.121541 21354 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.126405 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.102689 20959 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:04.099291 21251 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.129076 21364 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:04.130206 21364 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.131155 21364 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:04.131659 21364 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:04.136004 15641 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:04.132997 21364 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.139387 21277 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:04.139849 21251 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.140307 21277 consensus_queue.cc:1243] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:04.141194 21352 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:04.141486 20870 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:04.141690 21352 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:04.142143 20870 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.143019 21352 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.144505 20870 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.145393 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.148675 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.149616 15645 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:08:04.155746 21318 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.632s	user 0.015s	sys 0.010s
I20260709 13:08:04.157683 21402 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:04.144743 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:04.160982 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.163570 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:04.164930 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:04.166054 21379 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:04.167524 21379 consensus_queue.cc:1243] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:04.168218 21379 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.168663 21379 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.169102 21379 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.169963 21368 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:04.170055 21359 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:03.954437 15643 rpcz_store.cc:276] 0709 13:08:02.583322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.602383 (+ 19061us) service_pool.cc:224] Handling call
0709 13:08:02.602702 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.602903 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:03.800648 (+1197745us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800364ba0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf
0709 13:08:03.800807 (+   159us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.933093 (+132286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.933159 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:03.933202 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.933268 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.933402 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71438,"prepare.queue_time_us":94687,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":70964,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":2610,"spinlock_wait_cycles":3003136,"thread_start_us":149772,"threads_started":2,"wal-append.queue_time_us":61480}
I20260709 13:08:04.172892 21359 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:04.113726 21399 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:04.138574 21364 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.176851 21281 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.177413 21281 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.164950 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:04.166379 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.161056 21277 raft_consensus.cc:2764] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:04.122498 15788 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 11.
I20260709 13:08:04.170725 21368 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:04.102540 21265 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.033990 21316 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.108539 21206 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:08:04.225136 21316 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.225958 15787 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:04.236810 21274 raft_consensus.cc:3055] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:04.237293 21274 raft_consensus.cc:740] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:04.108562 21333 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:04.238493 21333 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.250973 21358 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.251171 20880 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.251608 21358 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:04.257627 21394 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:08:04.258124 21189 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:04.258769 21189 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.227425 21368 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.285007 21281 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.238618 21274 consensus_queue.cc:260] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.103909 21131 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
W20260709 13:08:04.290549 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.102627 21223 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:08:04.251654 20880 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.296264 15796 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
W20260709 13:08:04.313127 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.114588 21348 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.162s
I20260709 13:08:04.316599 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.322211 15795 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:04.319820 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.323607 15787 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.251060 21256 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.330412 15790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.005s	sys 0.009s
W20260709 13:08:04.334748 15790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.006s	sys 0.009s
W20260709 13:08:04.339201 21407 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:08:04.260965 21265 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:04.343578 15610 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.655s (SENT) [suppressed 23 similar messages]
I20260709 13:08:04.344518 15787 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:04.290504 21358 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.340885 21010 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:04.348778 21232 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:04.349253 20880 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:04.350521 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.350958 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.358873 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.359706 15795 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.359545 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.360395 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.362159 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.363022 15787 raft_consensus.cc:2376] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 15. Re-sending same reply.
I20260709 13:08:04.363889 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.361186 15789 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:04.365548 15796 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:04.361560 21390 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:04.365705 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.366636 21390 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.365983 21010 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.370880 15795 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:08:04.365983 21377 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:04.371204 21010 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.371675 21377 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.373627 21010 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.370688 21390 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.379281 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.380318 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:04.381548 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46280.2us
I20260709 13:08:04.343859 21353 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.383107 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.385205 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.385923 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:04.387169 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.352221 21206 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.352978 21402 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.399480 15790 raft_consensus.cc:2393] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:04.388648 16297 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:04.394853 15642 raft_consensus.cc:1240] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:04.395623 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.400018 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.349973 21329 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.401350 15643 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:04.403353 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:04.404011 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:04.362025 21359 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.405961 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.406092 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.406744 15639 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:04.406924 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.407514 15642 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 10.
I20260709 13:08:04.397001 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.408322 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.409180 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.411291 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.410427 15644 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:04.412171 15643 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:04.404254 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.413982 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.414481 15646 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:04.416549 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:04.416700 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.374770 21223 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:04.418326 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.422243 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:04.422402 15788 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:04.423219 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.417287 15647 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:04.344430 21256 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.420015 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.425655 15639 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:08:04.426884 15642 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:04.423537 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.384219 21377 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.430302 15790 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:04.389603 21281 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:04.436885 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.438304 15642 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:04.435344 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:04.416080 21013 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.461802 15647 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:04.429185 21249 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:04.415429 21277 raft_consensus.cc:2764] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:04.465441 15646 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:04.467080 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.471057 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.474184 15647 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:04.471705 15639 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:04.429347 21233 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:04.393693 21395 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:08:04.460563 21356 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.407612 21206 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.467841 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:04.418471 21402 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.488862 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:04.420768 21329 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.472007 20870 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.429455 21359 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.494587 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:04.497385 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:04.500983 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:04.491853 15790 raft_consensus.cc:2376] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 17. Re-sending same reply.
I20260709 13:08:04.499658 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:04.480933 21233 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.440052 21223 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.501629 15639 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:04.462232 21281 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.479928 21249 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:04.507539 15638 raft_consensus.cc:2368] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:04.511821 15787 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:04.471467 21348 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:04.510728 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:04.486321 21333 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.485921 21356 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:04.456184 21265 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:04.522456 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54692.7us
I20260709 13:08:04.521549 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:04.525506 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:04.497875 21253 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.713s	user 0.020s	sys 0.015s
I20260709 13:08:04.529206 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:08:04.533811 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.535677 15610 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:04.508942 21222 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.508620 21354 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.541383 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.514196 21233 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.550896 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:04.520501 21099 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:04.539960 21253 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.768s	user 0.020s	sys 0.015s
I20260709 13:08:04.566185 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:04.579401 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 260924us
W20260709 13:08:04.581403 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.583967 15714 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.589838 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:04.540723 21352 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.594254 15722 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:04.596025 15716 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: [14.14-14.14]
W20260709 13:08:04.605822 15721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2181) took 1531 ms (client timeout 1575 ms). Trace:
I20260709 13:08:04.599730 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.542869 21377 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:04.606326 15721 rpcz_store.cc:269] 0709 13:08:03.074758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.083298 (+  8540us) service_pool.cc:224] Handling call
0709 13:08:04.589665 (+1506367us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b58001e2798. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:08:04.605766 (+ 16101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17844096}
I20260709 13:08:04.550324 21222 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:04.554262 21094 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.541441 21412 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:04.565711 21048 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.614534 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 208839us
I20260709 13:08:04.576467 21010 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:04.574795 21099 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.615713 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:04.543417 20934 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:04.588892 20870 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.611282 21377 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.579475 21340 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:04.613456 21222 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.617345 21412 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.615198 21013 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.667562 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.667780 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:04.668836 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:04.665043 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 152604us
I20260709 13:08:04.631595 21099 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.695281 15715 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:04.695720 15716 raft_consensus.cc:2410] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:04.678581 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.696635 15721 raft_consensus.cc:2410] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:04.696455 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:04.698299 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 162693us
I20260709 13:08:04.633028 21395 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.658545 21251 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:04.661880 21391 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.631s	user 0.000s	sys 0.010s
I20260709 13:08:04.699297 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:04.696331 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:04.702858 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.664124 21377 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.664644 21010 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:04.654009 21390 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:04.627241 21048 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.736292 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.741513 15715 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:04.743409 15716 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:04.679097 21256 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:04.744163 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 174659us
I20260709 13:08:04.618305 21356 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.682060 21412 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.748524 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:04.661648 20870 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.700148 21354 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:04.762887 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.737967 21010 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.737581 21391 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.738632 21277 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:04.677376 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 111252us
I20260709 13:08:04.698956 21368 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.757797 21329 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:04.773689 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.786689 15716 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:04.761006 21206 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.757246 21353 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.789424 15791 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:04.777380 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:04.757078 21429 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:04.730628 21395 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.804790 21294 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:04.802388 21429 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:04.810565 21417 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:08:04.810652 21429 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.812060 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1118) took 1377 ms. Trace:
I20260709 13:08:04.766661 21336 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.678649 21344 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:08:04.673334 21249 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.788645 21354 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.771361 21223 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.772032 21010 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.778113 21402 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.778014 21359 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:04.835026 15795 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:04.814921 21294 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:04.838220 21414 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:08:04.838927 21413 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:08:04.789142 21428 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:08:04.841569 21404 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.738s	user 0.004s	sys 0.000s
I20260709 13:08:04.799093 21391 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.939354 21391 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:04.791708 21281 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:04.813556 21336 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:04.886973 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.935765 15718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2174) took 1873 ms (client timeout 1927 ms). Trace:
W20260709 13:08:04.950501 15718 rpcz_store.cc:269] 0709 13:08:03.062113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.185124 (+123011us) service_pool.cc:224] Handling call
0709 13:08:04.935600 (+1750476us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540003d254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:04.935706 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784914688}
I20260709 13:08:04.937357 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2667) took 1202 ms. Trace:
I20260709 13:08:04.800894 21353 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.951800 21353 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.951653 15793 rpcz_store.cc:276] 0709 13:08:03.734962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.075770 (+340808us) service_pool.cc:224] Handling call
0709 13:08:04.076174 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.102764 (+ 26590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.102802 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:04.109044 (+  6242us) log.cc:844] Serialized 52 byte log entry
0709 13:08:04.505648 (+396604us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:04.505692 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.505779 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.937155 (+431376us) raft_consensus.cc:1685] finished
0709 13:08:04.937173 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.937297 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11157,"raft.queue_time_us":11359,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":20164,"thread_start_us":369194,"threads_started":1,"wal-append.queue_time_us":442320}
I20260709 13:08:04.959331 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2670) took 1211 ms. Trace:
I20260709 13:08:04.959748 15791 rpcz_store.cc:276] 0709 13:08:03.747711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.100919 (+353208us) service_pool.cc:224] Handling call
0709 13:08:04.106659 (+  5740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.789929 (+683270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.959090 (+169161us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400219dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:04.959276 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569285376}
W20260709 13:08:04.939890 21431 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:04.978874 21294 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:04.980981 21294 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.982102 15643 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:04.996343 21391 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:04.934161 21223 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:05.016608 21355 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:05.017086 21355 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:05.021548 21359 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:05.023545 21355 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.025197 21355 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:05.025367 21411 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.537s	user 0.000s	sys 0.001s
I20260709 13:08:04.758635 21251 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:05.098320 20959 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:05.107414 20959 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.108003 21390 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:05.115406 15718 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.109297 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:05.098766 21251 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.124815 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:05.127434 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 362435us
I20260709 13:08:05.132357 21253 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.132836 21253 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:05.133245 21253 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:05.135437 21316 consensus_meta.cc:287] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.910s	user 0.021s	sys 0.005s
I20260709 13:08:05.136725 21078 raft_consensus.cc:993] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:05.137233 21078 raft_consensus.cc:1081] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:04.812534 16328 rpcz_store.cc:276] 0709 13:08:03.434948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.435093 (+   145us) service_pool.cc:224] Handling call
0709 13:08:03.435394 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.174807 (+739413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.174838 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.175290 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.502291 (+327001us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:04.502319 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.502372 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.811719 (+309347us) raft_consensus.cc:1685] finished
0709 13:08:04.811752 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.811957 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739011,"raft.queue_time_us":739137,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":317035,"threads_started":1,"wal-append.queue_time_us":423127}
I20260709 13:08:05.131739 21435 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:05.141780 15718 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:05.148438 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:05.164863 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.026s	sys 0.047s
W20260709 13:08:05.165254 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.026s	sys 0.047s
W20260709 13:08:05.165776 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 550168us
I20260709 13:08:05.166507 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:05.167834 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46664.2us
I20260709 13:08:05.169355 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:05.172057 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:05.150985 21368 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.174817 21256 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:05.175704 21242 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:05.180284 21242 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.180634 21242 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:05.181398 21242 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.182396 20959 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.182600 21242 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.171927 21281 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.172132 21316 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.183167 21048 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.183604 21316 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.175525 21095 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:05.187929 21379 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.018s	user 0.019s	sys 0.001s
I20260709 13:08:05.188073 21353 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.188452 21379 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.189936 21222 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:05.191265 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.191967 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.194770 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:05.195335 21364 consensus_meta.cc:287] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 1.019s	user 0.008s	sys 0.012s
I20260709 13:08:05.195528 15643 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:05.196884 15638 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:05.199987 21377 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.205056 15718 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:05.205332 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.205936 15716 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:05.206432 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.206774 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.207151 15718 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:05.207672 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.207834 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.208494 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.209239 15715 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:05.209244 15722 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:05.213366 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:05.214277 15795 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
W20260709 13:08:05.218652 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 452800us
I20260709 13:08:05.218981 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:05.221051 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:05.221330 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.221963 15717 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:05.222114 15716 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:05.225473 15721 raft_consensus.cc:2368] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:05.225561 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.225960 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.226811 15715 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:05.167658 21189 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.228008 15638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42130
I20260709 13:08:05.228552 15638 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.228981 15638 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.235169 15715 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:08:05.235648 15715 pending_rounds.cc:85] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 11
I20260709 13:08:05.235931 15715 pending_rounds.cc:107] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:08:05.236218 15715 raft_consensus.cc:2889] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:05.224328 21233 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.020s
I20260709 13:08:05.237886 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:05.225404 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56130us
I20260709 13:08:05.242702 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.211910 21269 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.243364 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:05.240929 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.246214 15715 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
W20260709 13:08:05.248310 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.249728 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:05.228592 21398 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.233997 21281 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.224268 21333 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:05.254422 21432 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.243974 21189 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:05.263300 15795 raft_consensus.cc:1275] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:05.255436 21277 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.227699 21439 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:05.255928 21398 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.251847 21368 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:05.253288 21358 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.254446 21249 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.269053 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.262682 21256 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:05.265429 21099 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.558s	user 0.019s	sys 0.005s
I20260709 13:08:05.260695 21281 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.251345 21233 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.262290 15638 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.290170 15722 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:05.253481 21269 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.297588 15639 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:05.268023 21364 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.273000 21398 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.304023 21316 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.304543 21253 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.279917 21353 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.305723 21274 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.309844 21184 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.311206 20934 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.296448 21379 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.296197 21281 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.267730 21432 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.269955 21189 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.368899 15638 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.272315 21277 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.370297 20934 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:05.398550 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 226894us
I20260709 13:08:05.400638 15787 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:05.378681 21422 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:05.291707 21249 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.289187 21429 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.288313 21358 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.408532 20934 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.413141 21422 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.414171 21048 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:05.402917 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 183455us
I20260709 13:08:05.297097 21256 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:05.430181 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 266787us
I20260709 13:08:05.432502 15718 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:08:05.294718 21099 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.421203 21081 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.424415 21222 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:05.440148 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 190480us
I20260709 13:08:05.443667 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:05.446637 21439 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.447186 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:05.450189 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:05.455730 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:05.457813 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2651) took 1070 ms. Trace:
W20260709 13:08:05.441187 21094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.006s	sys 0.018s
I20260709 13:08:05.439162 20934 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:05.467496 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.440969 21291 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.458240 15640 rpcz_store.cc:276] 0709 13:08:04.387756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.387864 (+   108us) service_pool.cc:224] Handling call
0709 13:08:04.388122 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.536359 (+148237us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:04.566284 (+ 29925us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.009468 (+443184us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b18004214e0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:08:05.126115 (+116647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.126164 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:05.126209 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.457565 (+331356us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003aff54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:05.457622 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.457739 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29742,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2411,"raft.queue_time_us":103,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":101,"spinlock_wait_cycles":360117888,"thread_start_us":116102,"threads_started":1,"wal-append.queue_time_us":559489}
I20260709 13:08:05.473098 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.433424 21048 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.448187 21426 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.448442 21377 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:05.462388 21094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.007s	sys 0.018s
I20260709 13:08:05.462114 21452 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.456827 21439 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:05.476872 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:05.479983 21429 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:05.480131 21443 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 13:08:05.480751 21352 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.871s	user 0.006s	sys 0.014s
I20260709 13:08:05.481597 21269 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.477200 21402 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.499150 21253 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.487493 21233 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.483947 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.477960 21291 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.503109 21395 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.491525 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:05.506422 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50772.8us
I20260709 13:08:05.505376 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.499794 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.571791 16332 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:05.499562 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.498068 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.499917 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.519490 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:05.529595 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.575176 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.532382 15716 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:05.575349 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:05.536947 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 98844.8us
I20260709 13:08:05.576388 15638 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.577101 16297 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:05.542207 21391 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:05.578172 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:05.509711 21329 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 13:08:05.498505 21446 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:08:05.485710 21336 consensus_meta.cc:287] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.537s	user 0.015s	sys 0.015s
W20260709 13:08:05.507005 21412 consensus_meta.cc:287] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.738s	user 0.002s	sys 0.022s
W20260709 13:08:05.492527 21010 consensus_meta.cc:287] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.012s
I20260709 13:08:05.500587 21356 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.508138 21184 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:05.547052 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 70209.3us
I20260709 13:08:05.487031 21099 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:05.493330 21358 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:05.578070 21391 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.496063 21232 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.482362 21206 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.505264 21249 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.504937 21433 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:05.626170 21433 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:05.507160 21094 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:05.628233 21094 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.528750 21379 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.630293 21463 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:08:05.477577 21251 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.507036 21256 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:05.640918 21251 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.488956 21432 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.490180 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.566962 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:05.567274 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:05.599856 21184 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.586383 21265 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:05.644733 15643 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.622053 21358 consensus_queue.cc:1048] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:05.645967 21291 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:05.647879 15720 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:05.630077 21379 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.587085 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:05.499275 21426 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.546693 21448 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:05.550732 21377 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:05.593032 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 164031us
I20260709 13:08:05.598958 15713 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:08:05.604130 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:05.606343 15638 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:05.572116 21428 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:05.609263 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:05.600531 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:05.506258 21277 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.618069 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:05.591491 20870 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.617342 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:05.742414 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 138391us
I20260709 13:08:05.742897 15787 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.597446 21010 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.743796 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:05.624166 21233 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:05.631575 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:05.748461 15717 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.644783 21184 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.597419 21453 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.579815 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:05.579465 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:05.568315 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:05.754961 15640 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:05.654907 15643 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:05.660199 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:05.683161 16329 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.588748 21368 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:08:05.757236 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:05.747686 21465 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:08:05.760676 15787 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:05.761201 16298 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:05.762710 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:05.546937 21452 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.597044 21412 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.715361 15713 pending_rounds.cc:85] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 12
I20260709 13:08:05.772261 15713 pending_rounds.cc:107] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:08:05.772531 15713 raft_consensus.cc:2889] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.773309 21419 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.773619 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.774405 16330 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:05.774708 16328 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:05.732278 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:05.738746 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.732053 15715 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:05.623699 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.633275 21232 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:05.749603 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 182708us
I20260709 13:08:05.773847 21412 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:05.750000 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 149584us
I20260709 13:08:05.787873 15759 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:05.750659 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 93959us
I20260709 13:08:05.708986 21428 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:05.648291 21206 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.621966 21242 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.771051 21452 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.771636 21329 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:05.741405 21463 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:05.737401 21448 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.781628 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:05.747977 21468 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.783015 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:05.754678 21402 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:05.757326 20959 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.747622 21256 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:08:05.798543 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:05.800930 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:05.775449 21464 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.823513 15643 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.825073 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:05.825624 15787 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:05.800534 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:05.797408 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:05.802178 15759 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:05.834496 15717 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:05.833257 16334 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:05.835505 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.836126 15717 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
W20260709 13:08:05.837520 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48124.2us
I20260709 13:08:05.840036 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:05.841046 16329 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 11.
I20260709 13:08:05.840103 16327 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:05.841490 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:05.849782 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 47683.1us
I20260709 13:08:05.794674 21462 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:05.856587 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:05.847941 15643 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:05.838817 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:05.850579 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.762444 21398 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.864924 15787 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:05.799706 21329 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.796494 21470 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:05.837136 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.773916 21419 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:05.903746 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.782192 21281 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.916400 15759 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:08:05.916944 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 116463us
W20260709 13:08:05.853950 21469 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:08:05.815342 21232 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.823262 20959 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:05.799582 21377 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:05.766428 21453 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.917884 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:05.938172 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:05.938638 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:05.809106 21010 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:05.918987 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77616.9us
I20260709 13:08:05.941213 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:05.942982 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:05.810830 21206 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:05.921088 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 105449us
I20260709 13:08:05.839315 21468 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.929940 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:05.913571 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2194) took 1218 ms. Trace:
I20260709 13:08:05.947541 15720 rpcz_store.cc:276] 0709 13:08:04.695601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.696207 (+   606us) service_pool.cc:224] Handling call
0709 13:08:05.913352 (+1217145us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540017b6d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:05.913498 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186337536}
I20260709 13:08:05.950191 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:05.805687 21242 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:05.863300 21466 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.938787 15639 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.863539 21454 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.959949 21454 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:05.960484 21454 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.910868 21291 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.813684 21131 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:08:05.844281 21412 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.906402 21222 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:05.954607 15719 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:05.946228 15715 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:05.957903 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:05.914075 21329 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:05.901767 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 63004us
I20260709 13:08:05.848084 21095 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:08:05.920498 21333 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.915292 21462 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:05.939359 21294 consensus_meta.cc:287] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.010s
I20260709 13:08:05.931782 20959 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.929467 21452 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:08:05.954996 21468 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.984206 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:05.925150 21429 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:05.991432 15611 leader_election.cc:400] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
W20260709 13:08:06.002882 21469 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:05.994867 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:06.001426 21251 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.003049 16331 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:06.009399 15639 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
W20260709 13:08:06.004678 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.021306 15611 leader_election.cc:403] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:08:06.059909 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 102520us
I20260709 13:08:05.924126 21481 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.928092 21470 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.064998 21470 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.024861 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.065984 15715 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:06.066088 16298 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:06.000072 21391 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:05.848500 21428 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:05.951207 21377 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.067488 21424 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:06.036067 21474 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:08:06.067898 20959 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.069599 21377 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.004020 21222 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:06.070408 20959 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.071136 21222 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.074551 21333 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.019870 21429 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.047542 21448 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.048810 21398 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.080257 21429 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.049206 21453 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.050559 21281 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:05.992813 21439 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:06.081382 21439 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.084225 21439 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:05.974300 21353 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:06.085980 21353 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:06.086489 21353 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.994092 21233 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.090899 21233 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.091382 21233 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.112700 21333 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
W20260709 13:08:06.114001 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.011943 21379 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:06.118433 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52439us
I20260709 13:08:06.020561 21426 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.011730 21402 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:08:06.126281 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:06.044013 21482 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:06.129982 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:06.132593 15643 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:06.116187 21223 raft_consensus.cc:2764] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:08:06.140969 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.126966 21081 consensus_meta.cc:287] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.001s
I20260709 13:08:06.125144 21470 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:06.143122 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:06.147068 15638 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.148084 15789 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:06.149664 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:06.146134 21470 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.138693 21251 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.163848 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 136453us
I20260709 13:08:06.176132 15638 raft_consensus.cc:2468] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:06.152433 21345 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.159933 21470 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.196204 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.200438 15640 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:06.202055 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.212723 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.213400 15722 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:06.168807 21482 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:06.215713 15720 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:06.220250 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.222594 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.165012 21251 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.144625 21462 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.194417 21242 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.224361 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:06.220299 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 88243.7us
I20260709 13:08:06.225812 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.224520 21402 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.227474 21481 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.221065 21482 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.244608 21482 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.246279 21265 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.251912 21251 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.254884 21402 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.257414 21402 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:06.228435 21479 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:06.229887 21048 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.205076 21421 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:06.232262 15720 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.190379 21454 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:06.277920 21184 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:08:06.278843 21454 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.278581 21184 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.262786 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:06.280350 15715 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:06.281247 21482 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.281666 21482 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:06.282099 21482 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.281474 21184 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.182951 21345 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.227185 21353 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.267270 21419 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.291253 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 830) took 1697 ms. Trace:
I20260709 13:08:06.291631 15713 rpcz_store.cc:276] 0709 13:08:04.593639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.605670 (+ 12031us) service_pool.cc:224] Handling call
0709 13:08:04.617991 (+ 12321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.773167 (+1155176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.291042 (+517875us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400095e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:06.291200 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239468800}
I20260709 13:08:06.273909 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.266750 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:06.285773 15720 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:06.233532 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:06.554484 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.555087 15720 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.555603 21464 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.556046 21464 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.556417 21464 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.294201 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.300403 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.296032 21470 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.558211 15713 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:06.558637 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.558957 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.559474 15722 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:06.559531 15713 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:06.559962 21470 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.324636 21353 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.325377 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 828) took 1733 ms. Trace:
I20260709 13:08:06.285467 21429 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.290364 21233 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.561609 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:06.309199 21329 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:06.356436 21491 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:08:06.562764 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.562866 21429 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.353452 21468 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.564388 21329 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.565034 15638 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.374583 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.381888 21482 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.562878 21233 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.567315 21482 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.386317 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.567852 15718 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:06.398439 21345 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.410650 21428 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.571988 21486 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.422586 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3350) took 1174 ms. Trace:
I20260709 13:08:06.572535 21486 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.572489 15719 rpcz_store.cc:276] 0709 13:08:05.248338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.248515 (+   177us) service_pool.cc:224] Handling call
0709 13:08:05.248805 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.995510 (+746705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.422243 (+426733us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54001e6c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:06.422505 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622717696}
I20260709 13:08:06.573945 21487 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.574514 21487 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.575860 21487 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.576856 21464 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.430095 21189 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.437696 21094 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.442080 21489 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.211s	user 0.004s	sys 0.000s
I20260709 13:08:06.578935 21094 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:06.464604 15789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 2948) took 1967 ms (client timeout 2248 ms). Trace:
W20260709 13:08:06.580303 15789 rpcz_store.cc:269] 0709 13:08:04.496963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.497152 (+   189us) service_pool.cc:224] Handling call
0709 13:08:06.464371 (+1967219us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540047c2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:06.464528 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786807168}
I20260709 13:08:06.466785 21466 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.475392 21422 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.476365 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.585203 15717 raft_consensus.cc:2368] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:08:06.472553 21433 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.483942 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.485077 21359 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.535348 21439 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.538915 21358 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:06.542026 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 1119) took 1069 ms. Trace:
I20260709 13:08:06.367542 21081 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:06.413308 21256 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:06.561380 15714 rpcz_store.cc:276] 0709 13:08:04.592289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.594917 (+  2628us) service_pool.cc:224] Handling call
0709 13:08:04.595252 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.559461 (+964209us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:05.577928 (+ 18467us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.323950 (+746022us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b1800076fc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:08:06.324153 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.324218 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:06.324290 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.325080 (+   790us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54001e8054. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:06.325134 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.325299 (+   165us) inbound_call.cc:177] Queueing success response
0709 13:08:06.424506 (+ 99207us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4800042fd8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
Metrics: {"mutex_wait_us":6319,"prepare.queue_time_us":26938,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":718326,"raft.run_cpu_time_us":2884,"raft.run_wall_time_us":862156,"spinlock_wait_cycles":2241938432,"thread_start_us":34126,"threads_started":1,"wal-append.queue_time_us":63678}
W20260709 13:08:06.554522 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 321107us
I20260709 13:08:06.600857 21256 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:06.602175 21256 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.580579 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:06.603623 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.603989 21256 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:06.604969 21426 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:06.605515 21426 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.606405 21426 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.584944 21466 raft_consensus.cc:3060] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.594379 15720 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:06.596966 21433 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.597697 16328 rpcz_store.cc:276] 0709 13:08:05.472659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.472866 (+   207us) service_pool.cc:224] Handling call
0709 13:08:06.541791 (+1068925us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54004efa54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:06.541963 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691720064}
I20260709 13:08:06.596649 21439 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:06.586153 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 102305us
I20260709 13:08:06.573485 21486 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.609426 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:06.609877 21094 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.609481 21081 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.608788 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:06.617200 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.619241 15638 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:06.590898 21429 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:06.597441 21359 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.611493 21464 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.611440 21345 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.597440 21358 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:06.615515 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.618137 15722 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:08:06.620059 15643 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:06.625313 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45276.3us
I20260709 13:08:06.628144 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.630144 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:06.638746 15611 leader_election.cc:400] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
I20260709 13:08:06.639158 15611 leader_election.cc:403] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.629845 21094 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:06.639757 21354 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.640929 21358 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.631431 21481 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.629698 21429 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:06.642450 15611 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.632740 21353 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.665076 21353 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.665295 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:06.666038 15720 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.635254 21412 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.649698 21359 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:06.653417 21439 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.665524 21353 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:06.667894 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.629109 21345 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.670926 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:06.661428 21094 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.678660 15720 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:06.644613 21421 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12.
W20260709 13:08:06.680374 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 52329us
I20260709 13:08:06.676054 21358 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.641794 21422 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:06.685712 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.678261 20959 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.686456 15762 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.676970 21412 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:06.689944 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.666224 21481 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.690745 21412 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.690791 21439 raft_consensus.cc:2804] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:06.695539 21081 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.689427 21359 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:06.708257 21359 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:06.709210 21359 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.711522 21481 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.701584 21448 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:06.714327 21448 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.715163 21448 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.696759 20959 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:06.703215 21094 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.718473 20959 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:06.704454 21459 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 1.109s	user 0.004s	sys 0.000s
I20260709 13:08:06.722903 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:06.727831 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:06.730126 16329 raft_consensus.cc:1240] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.749450 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:06.763558 16330 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:06.766098 16331 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.765177 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:06.771839 21412 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.722364 21429 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.780368 21253 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:06.743122 21439 raft_consensus.cc:697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.871371 21345 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.889185 21345 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:06.889987 21345 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.894273 21345 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.897770 21345 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:06.898411 21345 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.901224 21345 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.943050 21353 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.947999 21353 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.983702 21253 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:06.994338 21439 consensus_queue.cc:237] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:06.781366 21412 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.775123 21466 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:07.016906 21466 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:07.017762 16328 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:07.018668 21468 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:07.029484 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.44958e+06us
I20260709 13:08:07.030457 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:07.071106 21439 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.071750 21439 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.073274 21448 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.073897 21448 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.078140 21439 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.078747 21448 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:06.812510 21487 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.305s
I20260709 13:08:07.124779 21439 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:07.125257 21439 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:07.126150 21439 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:07.130246 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.783254 21481 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:07.131175 21481 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.131649 21481 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.168622 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:07.174250 21232 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:07.176693 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.178812 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:07.179680 21094 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.180158 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:07.180334 21094 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.180981 21519 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.187002 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:07.190414 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.200342 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.201373 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.201341 21398 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.204381 21519 consensus_queue.cc:1059] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:08:07.215301 21519 raft_consensus.cc:3055] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:07.215750 21519 raft_consensus.cc:740] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:07.216266 21498 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.216764 21519 consensus_queue.cc:260] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.216820 21498 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:07.228336 21498 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.229509 21519 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.159086 21481 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:06.756557 21081 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.502s
I20260709 13:08:07.262127 21253 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:07.264889 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.020s
W20260709 13:08:07.266857 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.007s	sys 0.021s
W20260709 13:08:07.267184 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 523466us
I20260709 13:08:07.272975 21253 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:07.277031 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.279793 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 1.29144e+06us
I20260709 13:08:07.280560 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:07.282522 21481 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.285115 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:07.285707 15714 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.286028 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2221) took 1081 ms. Trace:
I20260709 13:08:07.286548 15713 rpcz_store.cc:276] 0709 13:08:06.204247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.560142 (+355895us) service_pool.cc:224] Handling call
0709 13:08:06.560436 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.204141 (+643705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.204193 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.205115 (+   922us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.270246 (+ 65131us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.270284 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.270351 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.285815 (+ 15464us) raft_consensus.cc:1685] finished
0709 13:08:07.285835 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.285974 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621666,"spinlock_wait_cycles":32256,"thread_start_us":38228,"threads_started":2,"wal-append.queue_time_us":19828}
I20260709 13:08:07.264889 21398 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:07.298525 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.299333 21359 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.299815 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:07.300195 21359 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.300668 21359 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:07.300638 21355 raft_consensus.cc:2764] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:08:07.303412 21359 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:06.186436 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.301726 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:07.307101 15714 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:07.320818 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:07.314004 21426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.016s	sys 0.015s
I20260709 13:08:07.326972 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.327786 15645 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:07.329347 15645 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:07.331102 15759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.011s
W20260709 13:08:07.331573 15759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.011s
I20260709 13:08:07.331868 15638 raft_consensus.cc:1275] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:07.331171 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.333263 15645 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:07.334949 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.335615 21439 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.336129 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.336776 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:07.338279 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.339847 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.343099 21353 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.343777 21353 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.326758 21355 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:07.346676 21426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.017s	sys 0.015s
I20260709 13:08:07.348629 21094 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.351125 21094 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.349164 21099 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.352610 21099 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.326061 21359 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.354029 21359 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:07.354535 21359 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:07.360601 21456 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 1.916s	user 0.005s	sys 0.001s
I20260709 13:08:07.362489 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2478) took 2168 ms. Trace:
I20260709 13:08:07.312392 21398 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.364845 21398 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.362913 15642 rpcz_store.cc:276] 0709 13:08:05.200317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.201091 (+   774us) service_pool.cc:224] Handling call
0709 13:08:05.201405 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.224080 (+ 22675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.224122 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.230344 (+  6222us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.370406 (+140062us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:05.370452 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.370543 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.360174 (+1989631us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b2400125348. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2219f9c4 00007fad2219dacb 00007fad22358dc9 00007fad22358a55 00007fad2235809d 00007fad24f8a10e 00007fad24fa188c 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221
0709 13:08:07.362114 (+  1940us) raft_consensus.cc:1685] finished
0709 13:08:07.362135 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.362383 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296175,"raft.queue_time_us":22862,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5376,"spinlock_wait_cycles":17547648,"thread_start_us":117273,"threads_started":1,"wal-append.queue_time_us":175932}
I20260709 13:08:07.381315 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:07.388928 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:07.390107 15791 raft_consensus.cc:2368] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11.
I20260709 13:08:07.390915 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.397603 15642 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:07.400203 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:07.405203 15792 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:07.406682 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:07.407457 15645 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.410737 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:07.412602 15792 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.414701 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.398909 21398 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.417497 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:07.424178 15714 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:07.425136 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.425974 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:07.396512 21481 consensus_queue.cc:1059] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:08:07.433599 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:07.433984 15645 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:07.437841 15714 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.440598 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:07.434749 21355 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:07.424794 21426 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:07.449643 21253 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.449774 21426 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.450388 21253 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:07.452111 21426 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.452409 21253 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.452716 21498 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:07.453219 21498 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:07.453536 21355 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:07.444360 21398 raft_consensus.cc:3055] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.447618 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:07.461964 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:07.798769 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.467792 15645 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:07.470860 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.001534 15642 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:08.004101 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.005084 15641 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.471722 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.009784 15640 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
W20260709 13:08:08.014225 15717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.015s	sys 0.020s
W20260709 13:08:08.014703 15717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.015s	sys 0.020s
W20260709 13:08:07.583065 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.018352 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.656127 15792 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
W20260709 13:08:07.999522 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.022610 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.004122 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.028594 15644 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:08:08.069207 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:07.989881 21439 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.007s
I20260709 13:08:08.070151 16334 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
W20260709 13:08:07.844389 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003624c0 after lost signal to thread 14519
W20260709 13:08:08.083194 15722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.018s	sys 0.042s
W20260709 13:08:08.085275 15722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.018s	sys 0.042s
I20260709 13:08:07.801473 21519 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.089550 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:07.823276 21481 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.456614 21099 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.462714 21353 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:07.467466 21094 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:07.830658 21206 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:07.801759 21081 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.861583 21530 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:08.015923 21398 raft_consensus.cc:740] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:08.142315 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.131639 15641 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:08.132823 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:08:08.147341 15715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.056s	sys 0.045s
W20260709 13:08:08.147786 15715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.056s	sys 0.046s
I20260709 13:08:08.138563 16331 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.918653 21529 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.202s
I20260709 13:08:08.147822 16328 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:08.136709 21359 consensus_meta.cc:287] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.001s
I20260709 13:08:08.136183 21206 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.124815 21099 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:08.151008 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.089612 21519 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.139509 21498 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.156157 16329 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:08.159847 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3364) took 1823 ms. Trace:
I20260709 13:08:08.162240 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.123023 21481 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.196432 16334 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:08.195214 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.195905 15715 rpcz_store.cc:276] 0709 13:08:06.335957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.568247 (+232290us) service_pool.cc:224] Handling call
0709 13:08:06.568523 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.434176 (+865653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.434215 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.436586 (+  2371us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.148335 (+711749us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.148386 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.148479 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.159559 (+ 11080us) raft_consensus.cc:1685] finished
0709 13:08:08.159590 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.159768 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":798084,"thread_start_us":760205,"threads_started":2,"wal-append.queue_time_us":711294}
I20260709 13:08:08.210343 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.211298 15792 raft_consensus.cc:2376] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 13. Re-sending same reply.
I20260709 13:08:08.212585 16329 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:08.206552 21498 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.196084 21099 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.213426 21498 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.215342 21099 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:08.215996 21498 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.216794 21498 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.218173 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.222106 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:08.223665 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:08.224473 16325 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:08.217449 21498 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:08.238831 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.239393 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.156586 21206 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:08.147114 21081 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.143853 21530 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.239176 21398 consensus_queue.cc:260] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.252388 16331 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:08:08.252807 16331 pending_rounds.cc:85] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 12
I20260709 13:08:08.253028 16331 pending_rounds.cc:107] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:08:08.252936 16328 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:08.253335 16331 raft_consensus.cc:2889] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.254982 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.255721 15792 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:08.255650 15787 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.153795 21359 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.257200 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.276352 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.258246 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.260864 15788 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:08.243397 21498 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:08.265013 21429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.482s	user 0.017s	sys 0.016s
I20260709 13:08:08.265588 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.285049 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.285873 15790 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:08.266330 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:08.268759 21533 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:08.243486 21545 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.293166 16331 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:08.277535 15787 raft_consensus.cc:2410] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:08.278411 15794 raft_consensus.cc:2368] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:08:08.283679 16325 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:08.287905 15796 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:08.289894 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.303792 15790 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:08.311137 15638 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:08.317320 21519 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:08.310484 21545 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.319232 21481 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:08.319496 21545 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:08.321098 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:08.298331 21429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.515s	user 0.019s	sys 0.017s
I20260709 13:08:08.324869 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.329129 21081 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:08.330978 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:08.333953 21540 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.301028 21498 consensus_queue.cc:1048] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:08:08.334375 21359 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:08.339031 21530 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.334431 21540 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.339818 21540 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:08.340478 21486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.559s	user 0.017s	sys 0.020s
W20260709 13:08:08.340981 21486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.017s	sys 0.020s
I20260709 13:08:08.341960 15791 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:08.344614 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.350306 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
W20260709 13:08:08.352103 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 63236us
I20260709 13:08:08.352106 15788 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:08.345172 21206 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.354262 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.355121 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.356175 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.357247 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.357887 15796 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:08.361667 16297 leader_election.cc:400] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11.
I20260709 13:08:08.362684 15787 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:08.362643 15790 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:08.363642 16297 leader_election.cc:403] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:08.364333 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.365228 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.366734 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.367818 21519 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:08.368527 21519 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.368947 21424 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:08.369390 21424 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:08.370808 21519 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:08.375205 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.375808 15788 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:08.376194 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.364471 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.373010 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.378141 15792 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:08.380684 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.383488 21486 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:08.383903 21540 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:08.386530 21540 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:08.377341 15610 connection.cc:256] RPC call timeout handler was delayed by -1.7008463880000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:08:08.389362 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:08.389770 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.390013 15714 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:08.390543 15641 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:08.392661 15787 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:08.393002 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:08.393918 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.395339 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.396087 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.396173 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:08.393851 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.399271 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.400086 15645 raft_consensus.cc:2410] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:08.400759 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.402630 15641 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:08.385375 21486 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:08.401684 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.403776 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.409543 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:08.413594 15641 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:08.374671 21498 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 10. Current term is 11.
I20260709 13:08:08.353931 21081 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:08.380290 21481 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:08.416406 15715 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:08.417361 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.427326 21206 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.432206 16330 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:08.438154 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.440393 15641 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:08.409335 21546 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.443979 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:08.445554 15714 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:08.445530 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.450114 16330 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:08:08.444038 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 66235.9us
I20260709 13:08:08.424350 21481 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.445410 21546 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:08.503734 21546 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:08.465397 21541 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:08.507332 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3371) took 1836 ms. Trace:
I20260709 13:08:08.507826 15717 rpcz_store.cc:276] 0709 13:08:06.670730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.670878 (+   148us) service_pool.cc:224] Handling call
0709 13:08:06.671196 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.015132 (+1343936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.015177 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.065040 (+ 49863us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.286183 (+221143us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:08.286235 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.286325 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.507024 (+220699us) raft_consensus.cc:1685] finished
0709 13:08:08.507060 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.507236 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":698630,"thread_start_us":807165,"threads_started":2,"wal-append.queue_time_us":271256}
W20260709 13:08:08.525599 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.443836 21498 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:08.421535 21424 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.527889 21424 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.466372 21481 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:08.541641 15714 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
W20260709 13:08:08.551960 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.525370 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:08.583542 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58304.2us
I20260709 13:08:08.585088 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:08.606143 21529 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.606683 21529 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:08.607105 21529 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:08.637775 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 52762.3us
I20260709 13:08:08.640368 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:08.697497 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57225.8us
I20260709 13:08:08.699308 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:08.701941 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.695185 21542 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.704797 21545 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.705368 21545 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:08.705859 21545 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.714061 21542 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:08.701301 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 249191us
I20260709 13:08:08.715412 15641 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.717054 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:08.717644 21544 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:08.731987 21206 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:08.732589 21206 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:08.728037 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:08.735273 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:08.741837 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:08.759754 15641 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:08:08.761176 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.733445 21206 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.764240 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.753360 21539 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:08.770190 21539 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.770548 21539 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.771261 21529 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.776099 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:08.765062 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 719) took 1289 ms. Trace:
I20260709 13:08:08.777479 15639 rpcz_store.cc:276] 0709 13:08:07.476000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.552910 (+ 76910us) service_pool.cc:224] Handling call
0709 13:08:08.764068 (+1211158us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:08:08.764996 (+   928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16365312}
I20260709 13:08:08.781844 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:08.786800 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:08.765031 21545 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:08.788573 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800208580 after lost signal to thread 15579
I20260709 13:08:08.791931 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.794147 15787 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.753808 21544 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:08.799711 16334 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:08.799787 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.780407 21542 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.801663 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:08.802641 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.808553 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.815194 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.809659 15640 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:08.817588 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:08.818434 16332 raft_consensus.cc:2368] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:08.817924 21544 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.819109 21545 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.788393 21530 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:08.816530 21546 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:08.823467 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.798885 21429 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:08.854405 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.829492 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:08.829854 15641 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:08.826207 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:08.814445 21529 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.822381 21542 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:08.883255 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdd60 after lost signal to thread 15671
W20260709 13:08:08.919204 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 89843.9us
W20260709 13:08:08.919574 15668 debug-util.cc:398] Leaking SignalData structure 0x7b080026b060 after lost signal to thread 15672
I20260709 13:08:08.914274 21539 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:08.856698 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.931705 15611 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:08.827913 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:08.933408 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:08.933997 15640 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 5.
I20260709 13:08:08.936767 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:08.937445 15787 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:08.951833 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.956511 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:08.903867 21426 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:08.900524 21546 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:08.920358 21429 raft_consensus.cc:2764] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:08.920064 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:08.991895 21206 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:08.930284 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:08.993126 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:09.001014 15714 raft_consensus.cc:2393] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:08.927258 15639 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:08.994789 15787 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:08.994849 15645 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
W20260709 13:08:08.995795 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.927847 21539 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:08.998857 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 78875.8us
I20260709 13:08:09.001235 15715 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.996383 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1146) took 1195 ms. Trace:
I20260709 13:08:09.005173 16327 rpcz_store.cc:276] 0709 13:08:07.800712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.731537 (+930825us) service_pool.cc:224] Handling call
0709 13:08:08.731873 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.732074 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:08.814208 (+ 82134us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.995431 (+181223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.995492 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:08.995531 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.995626 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.996315 (+   689us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99659,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":84,"raft.queue_time_us":92,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2976,"thread_start_us":262546,"threads_started":2}
I20260709 13:08:09.008451 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:09.006191 21542 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.008386 21356 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:09.012807 21356 consensus_queue.cc:1243] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:09.018276 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:09.019505 21391 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:09.020121 21391 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:09.000402 21544 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.004674 21206 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:09.024744 21206 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.021221 21391 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.045977 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:09.047143 21333 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:09.047652 21333 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:08.999076 21426 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.048029 21333 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:09.049964 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.336s (SENT)
I20260709 13:08:09.050486 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:09.051687 21492 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.057219 15715 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:09.061110 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:09.061180 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 129542us
I20260709 13:08:09.062824 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 723) took 1178 ms. Trace:
I20260709 13:08:09.063298 15646 rpcz_store.cc:276] 0709 13:08:07.883938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.884044 (+   106us) service_pool.cc:224] Handling call
0709 13:08:09.060947 (+1176903us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:08:09.062741 (+  1794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13361920}
I20260709 13:08:09.077548 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3366) took 2726 ms. Trace:
I20260709 13:08:09.079516 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:09.084581 15610 leader_election.cc:400] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:09.084954 15610 leader_election.cc:403] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.078896 15718 rpcz_store.cc:276] 0709 13:08:06.336227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.568483 (+232256us) service_pool.cc:224] Handling call
0709 13:08:06.568701 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.568877 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:06.569166 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.061940 (+2492774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.062011 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.062075 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.062164 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.062309 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2302003,"prepare.queue_time_us":14477,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":901,"thread_start_us":189987,"threads_started":2,"wal-append.queue_time_us":91693,"wal-append.run_cpu_time_us":1362,"wal-append.run_wall_time_us":1134451}
I20260709 13:08:09.094250 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.094645 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.095077 15646 raft_consensus.cc:2393] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:09.095603 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.095808 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.096238 15640 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:09.097075 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.098927 15639 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:09.108799 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.109730 15641 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:09.110935 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.111685 15641 raft_consensus.cc:2376] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16. Re-sending same reply.
I20260709 13:08:09.112895 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.109017 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.115154 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.113562 15641 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:09.121799 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.123299 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:09.123570 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.085546 21530 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:09.125797 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.128989 15644 raft_consensus.cc:2376] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16. Re-sending same reply.
I20260709 13:08:09.129985 15795 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:09.126881 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.130892 15639 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16. Re-sending same reply.
I20260709 13:08:09.089808 21429 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:09.132283 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.137504 15646 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:09.107875 21356 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.140380 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:09.140985 15794 raft_consensus.cc:606] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:09.138867 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.143443 15639 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:09.139004 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.144263 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 722) took 1260 ms. Trace:
W20260709 13:08:09.128968 21566 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:09.085886 21544 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:09.139701 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.141315 15794 raft_consensus.cc:614] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:09.089008 21543 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
W20260709 13:08:09.151532 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35384 (request call id 708) took 1813 ms (client timeout 1639 ms). Trace:
W20260709 13:08:09.152061 15638 rpcz_store.cc:269] 0709 13:08:07.337724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.338043 (+   319us) service_pool.cc:224] Handling call
0709 13:08:09.151326 (+1813283us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002dbc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:09.151452 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235743616}
I20260709 13:08:09.153537 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.154196 15646 raft_consensus.cc:2376] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16. Re-sending same reply.
I20260709 13:08:09.144569 15647 rpcz_store.cc:276] 0709 13:08:07.883531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.883666 (+   135us) service_pool.cc:224] Handling call
0709 13:08:09.138760 (+1255094us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5800002a98. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e1a22 00007fad2b1fac09 00007fad2a354ee0 00007fad2a41e0ab 00007fad2a41e131 00007fad2a3cc0a0 00007fad2a3cb984 00007fad239466d4 00007fad23946662
0709 13:08:09.144220 (+  5460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13022208}
I20260709 13:08:09.158563 21433 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.159114 21433 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.161605 21333 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.162833 15641 raft_consensus.cc:2393] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:09.162838 21544 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:09.163631 21544 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.165045 21433 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:09.163193 21570 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.181362 16328 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:09.140720 21429 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:09.165729 21544 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:09.167483 21356 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:09.169354 21570 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.195925 21570 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:09.168708 21333 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:09.193233 21094 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 13:08:09.244792 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56636.7us
W20260709 13:08:09.234694 21575 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:09.264161 21429 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.328827 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2950) took 1120 ms. Trace:
I20260709 13:08:09.339527 16330 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:08:09.343926 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.345320 21486 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:09.329991 15793 rpcz_store.cc:276] 0709 13:08:08.208287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.208456 (+   169us) service_pool.cc:224] Handling call
0709 13:08:08.208904 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.239458 (+ 30554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.239487 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.160289 (+920802us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:08:09.160739 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.245885 (+ 85146us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:09.246663 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.247212 (+   549us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.327611 (+ 80399us) raft_consensus.cc:1685] finished
0709 13:08:09.327690 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.328471 (+   781us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34901,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":11643648,"thread_start_us":84666,"threads_started":1,"wal-append.queue_time_us":115016}
W20260709 13:08:09.364832 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.373179 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.378732 15762 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.109s (SENT) [suppressed 52 similar messages]
I20260709 13:08:09.167241 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.412348 15638 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:09.414669 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.415647 15638 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.431341 15638 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:09.170816 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.433626 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.435128 15647 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:08:09.443073 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.168444 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.446486 15644 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.167785 15646 raft_consensus.cc:1240] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:09.451340 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.506860 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 905) took 1159 ms. Trace:
I20260709 13:08:09.507400 15795 rpcz_store.cc:276] 0709 13:08:08.347393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.408431 (+ 61038us) service_pool.cc:224] Handling call
0709 13:08:09.123857 (+715426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.130340 (+  6483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.506263 (+375923us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001f86d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:09.506643 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644616448}
I20260709 13:08:09.516407 21233 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:09.526225 21439 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.526846 21439 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:09.528508 21439 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.548890 16332 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:09.553296 21488 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:09.557497 21426 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:09.559208 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:09.559577 21439 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.578286 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.580472 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.582306 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.585502 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.168141 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.605232 15643 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.169486 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.611059 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:09.612116 15795 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:08:09.607612 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.614712 15644 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:09.169636 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.622923 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:09.623700 15795 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.626719 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.628809 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.630108 15640 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:09.630993 15645 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:09.631322 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.634374 15639 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:09.635927 15646 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:09.638221 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.641647 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.642503 15639 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:09.651731 15641 raft_consensus.cc:1275] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:09.652541 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3382) took 1264 ms. Trace:
I20260709 13:08:09.652969 15713 rpcz_store.cc:276] 0709 13:08:08.387822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.388958 (+  1136us) service_pool.cc:224] Handling call
0709 13:08:08.402420 (+ 13462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.648534 (+1246114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.650831 (+  2297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.651827 (+   996us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:09.651929 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.652079 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.652280 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1086900,"thread_start_us":158641,"threads_started":1}
I20260709 13:08:09.654397 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:09.654660 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 2.6185e+06us
I20260709 13:08:09.656397 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:09.657173 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.658592 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.661309 15645 raft_consensus.cc:1275] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:09.657480 21398 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.663143 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.663432 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.663970 15644 raft_consensus.cc:2376] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13. Re-sending same reply.
I20260709 13:08:09.664913 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.665208 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.665892 15638 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:09.666119 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.666800 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.667338 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:09.667946 15640 raft_consensus.cc:2376] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16. Re-sending same reply.
I20260709 13:08:09.664333 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:09.668480 15638 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:09.756229 15638 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:09.757546 15638 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.758977 15638 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.761292 15645 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:09.737915 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.728056 15793 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:09.710541 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:09.871826 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.884294 15638 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:08:09.884927 15638 pending_rounds.cc:85] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 9
I20260709 13:08:09.885185 15638 pending_rounds.cc:107] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:08:09.885519 15638 raft_consensus.cc:2889] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.887740 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:09.892278 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:09.898061 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:09.899355 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.904246 15795 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:09.909510 21488 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.910070 21488 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.910458 21488 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.912635 15639 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
W20260709 13:08:09.937692 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.943722 21507 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:09.943951 15795 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:09.944644 21507 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.945267 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:09.945956 15793 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.981938 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3372) took 2658 ms. Trace:
I20260709 13:08:09.986338 15790 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:09.988735 21099 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.988927 20870 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:09.989408 21099 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:09.989861 20870 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:09.990672 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3383) took 1553 ms. Trace:
I20260709 13:08:09.991168 15720 rpcz_store.cc:276] 0709 13:08:08.388169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.389055 (+   886us) service_pool.cc:224] Handling call
0709 13:08:08.400322 (+ 11267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.400501 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:08.668420 (+267919us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.909179 (+1240759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.918128 (+  8949us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:09.921194 (+  3066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.925843 (+  4649us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.941086 (+ 15243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":971249,"prepare.queue_time_us":301103,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":508698,"threads_started":2}
I20260709 13:08:09.983158 15722 rpcz_store.cc:276] 0709 13:08:07.281462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.283906 (+  2444us) service_pool.cc:224] Handling call
0709 13:08:07.284186 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.284387 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:07.406820 (+122433us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.900851 (+2494031us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.907831 (+  6980us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.914683 (+  6852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.921871 (+  7188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.939565 (+ 17694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1557273,"prepare.queue_time_us":149842,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":1022962,"threads_started":3,"wal-append.queue_time_us":743065,"wal-append.run_cpu_time_us":2418,"wal-append.run_wall_time_us":1183292}
I20260709 13:08:10.000620 21265 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.997843 20934 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:08:10.007406 21265 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.010412 21099 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.012873 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 845) took 3951 ms. Trace:
I20260709 13:08:10.013456 15721 rpcz_store.cc:276] 0709 13:08:06.061226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.061406 (+   180us) service_pool.cc:224] Handling call
0709 13:08:06.061817 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.728372 (+3666555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.728469 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.735106 (+  6637us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.971758 (+236652us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:09.971802 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.973879 (+  2077us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.012429 (+ 38550us) raft_consensus.cc:1685] finished
0709 13:08:10.012452 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.012655 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3415454,"thread_start_us":250279,"threads_started":2,"wal-append.queue_time_us":109010}
I20260709 13:08:10.014356 21539 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:10.015009 21539 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:10.017285 21539 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.019181 21539 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.009161 21507 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.024770 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:10.007781 20934 consensus_queue.cc:1243] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:08:10.028839 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 78067.5us
I20260709 13:08:10.030391 21353 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.031183 21353 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.034030 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.034482 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 2971) took 1761 ms. Trace:
I20260709 13:08:10.034895 15796 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:10.035596 21189 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:10.034997 15788 rpcz_store.cc:276] 0709 13:08:08.272764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.397435 (+124671us) service_pool.cc:224] Handling call
0709 13:08:08.399173 (+  1738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.538304 (+139131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.538333 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.538382 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:08.538413 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.033989 (+1495576us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400271ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:10.034068 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.034281 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319434112}
I20260709 13:08:10.036262 21353 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:10.040323 15793 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:10.036291 21189 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.043852 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.042506 21353 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.055330 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.055953 15796 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:10.047986 21189 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.053653 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:10.059983 15787 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:08:10.061353 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 269369us
I20260709 13:08:10.059511 21281 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:10.063097 21573 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:10.063205 21269 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.063239 21281 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:10.063845 21573 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.064028 21269 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.064909 21281 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.065945 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:10.066637 21269 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:10.066574 21573 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:10.063409 15788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:10.066927 21249 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.071025 15788 raft_consensus.cc:606] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.067675 20934 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.071437 15788 raft_consensus.cc:614] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.071758 20934 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.072801 21277 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:10.073417 21277 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.083349 21277 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:10.084641 21439 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:10.085317 21344 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:10.085800 20934 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.087505 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:10.088246 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08000374c0 after lost signal to thread 15746
W20260709 13:08:10.088732 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003202e0 after lost signal to thread 15747
I20260709 13:08:10.088493 21344 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.090674 21344 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.091068 21344 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:10.092447 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.094442 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5080 after lost signal to thread 15820
W20260709 13:08:10.096491 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8b60 after lost signal to thread 16358
W20260709 13:08:10.099216 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce480 after lost signal to thread 16359
I20260709 13:08:10.098515 21353 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:10.099830 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003e37c0 after lost signal to thread 21184
W20260709 13:08:10.100229 15668 debug-util.cc:398] Leaking SignalData structure 0x7b080039b2a0 after lost signal to thread 21223
W20260709 13:08:10.100577 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1340 after lost signal to thread 21251
W20260709 13:08:10.102705 21607 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:10.103046 15789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 896) took 2703 ms. Trace:
I20260709 13:08:10.103870 21265 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:10.101969 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800353a20 after lost signal to thread 21274
W20260709 13:08:10.106001 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800353620 after lost signal to thread 21316
I20260709 13:08:10.104745 21359 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:10.104136 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:10.103447 15789 rpcz_store.cc:276] 0709 13:08:07.399438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.399592 (+   154us) service_pool.cc:224] Handling call
0709 13:08:07.399921 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.903569 (+1503648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.903614 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.903673 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.903726 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.102634 (+1198908us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400307ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:10.102691 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.102871 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457417472}
I20260709 13:08:10.111464 15787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:10.112103 15787 raft_consensus.cc:606] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.112469 15787 raft_consensus.cc:614] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.114599 21439 consensus_queue.cc:1048] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:10.101511 21353 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:10.122531 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800335300 after lost signal to thread 21352
I20260709 13:08:10.126237 21544 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.126959 21544 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.129845 21544 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.131212 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 710) took 2791 ms. Trace:
I20260709 13:08:10.131717 15643 rpcz_store.cc:276] 0709 13:08:07.339442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.339565 (+   123us) service_pool.cc:224] Handling call
0709 13:08:07.339865 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.631821 (+2291956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.130858 (+499037us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b540028a354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:10.131114 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5208455936}
I20260709 13:08:10.133901 15642 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 15. Ops: [13.13-13.13]
I20260709 13:08:10.130266 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:10.135855 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2659) took 1747 ms. Trace:
I20260709 13:08:10.136612 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:10.137385 15668 debug-util.cc:398] Leaking SignalData structure 0x7b0800383680 after lost signal to thread 21364
I20260709 13:08:10.136196 15642 rpcz_store.cc:276] 0709 13:08:08.388622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.388923 (+   301us) service_pool.cc:224] Handling call
0709 13:08:10.133452 (+1744529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.134469 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.135570 (+  1101us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540028a350. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:10.135744 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4010890496}
I20260709 13:08:10.117878 20870 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.139564 21353 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.142277 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 895) took 2746 ms. Trace:
I20260709 13:08:10.142313 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.117684 21344 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.143563 15721 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:10.142699 15791 rpcz_store.cc:276] 0709 13:08:07.396154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.396469 (+   315us) service_pool.cc:224] Handling call
0709 13:08:07.396749 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.342312 (+945563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.141831 (+1799519us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54001f9ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:10.142105 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173319936}
W20260709 13:08:10.175647 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003df900 after lost signal to thread 21379
I20260709 13:08:10.178435 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.162453 20934 consensus_queue.cc:1048] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:08:10.179143 21439 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:10.179751 21265 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:10.208983 21265 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:10.210249 21265 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.213397 21189 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.218082 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:10.218120 21189 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.221325 21344 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:10.222594 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 99497.8us
W20260709 13:08:10.230232 15668 debug-util.cc:398] Leaking SignalData structure 0x7b080036c780 after lost signal to thread 21432
I20260709 13:08:10.231102 15720 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:10.232542 21458 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:10.232975 21458 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:10.213495 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:10.234189 21523 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:10.234265 21426 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.234972 21523 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.225348 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:10.233460 21458 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.233299 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:10.248010 21525 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:10.202170 21439 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:10.247257 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:10.254778 21523 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:10.270787 16298 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.643s (SENT)
I20260709 13:08:10.271430 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:10.273384 15668 debug-util.cc:398] Leaking SignalData structure 0x7b08003a33e0 after lost signal to thread 21483
W20260709 13:08:10.286231 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.289934 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 94034.4us
I20260709 13:08:10.291869 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.292958 15720 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:10.294538 15721 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:10.294986 15721 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:10.295938 15721 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.297161 15721 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.297550 21472 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.205026 21488 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.298309 21589 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:10.298211 21472 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.298978 21589 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.299943 21488 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.300506 21472 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.300707 21099 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:10.301218 21472 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.301491 21099 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:10.256785 21439 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.274672 21525 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.234974 21426 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:10.302645 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 646383us
I20260709 13:08:10.306139 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.310971 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3358) took 4742 ms. Trace:
I20260709 13:08:10.306108 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.309033 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.303120 21352 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.315470 15716 rpcz_store.cc:276] 0709 13:08:05.568678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.759225 (+190547us) service_pool.cc:224] Handling call
0709 13:08:05.759529 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.759704 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:05.795539 (+ 35835us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.274338 (+1478799us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b18003c6160. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:08:09.881787 (+2607449us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.310135 (+428348us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.310333 (+   198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.310389 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:10.310464 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.310562 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.310792 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2436120,"prepare.queue_time_us":307039,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":4993,"raft.queue_time_us":3197734,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":324,"spinlock_wait_cycles":2036608,"thread_start_us":441225,"threads_started":4,"wal-append.queue_time_us":1715441,"wal-append.run_cpu_time_us":1451,"wal-append.run_wall_time_us":1049135}
I20260709 13:08:10.512537 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.513309 15716 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.309947 21472 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.525326 15717 raft_consensus.cc:3060] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.302410 21593 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.526489 21593 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:10.526938 21593 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.301698 21589 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:10.359148 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.530934 15720 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.533241 15717 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:10.376400 15722 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:10.534070 21352 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.534693 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.535130 15713 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.535862 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.536276 21352 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.536486 15722 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.505029 21426 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.379297 15718 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.538079 21426 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.383937 21355 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:10.394846 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 102990us
I20260709 13:08:10.409277 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.542604 21355 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:10.543224 15610 leader_election.cc:400] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:08:10.543346 21398 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.543570 15610 leader_election.cc:403] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:10.543581 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.543632 21355 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.543959 21398 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.545101 21355 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.545291 15610 leader_election.cc:400] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:08:10.545312 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.542421 15713 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
W20260709 13:08:10.428586 15688 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47700 dropped due to backpressure: service queue is full with 50 items
I20260709 13:08:10.408047 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:10.546294 15719 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:08:10.546952 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 139183us
I20260709 13:08:10.546766 21398 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.548568 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:10.424288 15721 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:10.546489 15688 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47700 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 865)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3415)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2238)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2241)
I20260709 13:08:10.551294 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.551858 15721 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:10.552753 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.440546 21099 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:10.444888 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 86557.9us
I20260709 13:08:10.563316 21616 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.501574 21439 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.563796 21616 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.564181 21616 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.566026 21611 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:10.568118 21611 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.568470 21611 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.568785 21611 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.568814 21439 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.455518 15544 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:10.459205 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 233952us
I20260709 13:08:10.572891 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:10.573789 21249 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:10.463759 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.575299 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.576490 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.577102 15714 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:10.482807 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.545922 21359 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:08:10.578011 15715 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
W20260709 13:08:10.479351 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.578927 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.579527 15715 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.545689 15610 leader_election.cc:403] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:08:10.581357 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.582484 15716 raft_consensus.cc:2410] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:10.582690 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.583343 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.584085 15716 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:10.584403 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:10.584798 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.585001 15791 raft_consensus.cc:606] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.585353 15791 raft_consensus.cc:614] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.587308 21544 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:10.587874 21544 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:10.588855 21544 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.584514 21539 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16.
I20260709 13:08:10.590193 21539 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:10.592614 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.595479 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 326371us
I20260709 13:08:10.596300 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a882c727204be4b66080704cceb833"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:10.596923 15791 raft_consensus.cc:606] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.597249 15791 raft_consensus.cc:614] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.597561 15762 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:10.598986 21398 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:10.599653 21344 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:10.558158 15688 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47706 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 865)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2253)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2251)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3415)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2238)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2248)
I20260709 13:08:10.600353 21398 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:10.600903 21398 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:10.601097 21344 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:10.601305 21398 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.601559 21344 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:10.602619 21344 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.603529 21622 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:10.603919 21344 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.607023 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:10.607579 16325 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:08:10.608850 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:10.609666 16332 raft_consensus.cc:2368] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:10.612630 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:10.326778 21189 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:10.613358 21189 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:10.613883 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:10.614535 16332 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.617831 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:10.618428 15715 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
I20260709 13:08:10.620692 21398 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.626116 21539 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.627619 21398 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.627722 21189 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:10.632086 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.632697 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.638648 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.639496 16332 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:10.612998 15688 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:47706 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2263)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2256)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2257)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2258)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2259)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2261)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2251)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3415)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2238)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2248)
I20260709 13:08:10.650027 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:10.650926 15642 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:10.652140 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.657244 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.639295 15714 raft_consensus.cc:2376] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13. Re-sending same reply.
I20260709 13:08:10.671497 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:10.675817 15718 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:10.678144 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:10.679358 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:10.679986 15640 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.679409 21398 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.678391 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.685248 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.685585 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.688637 15720 raft_consensus.cc:2410] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:08:10.697419 21622 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.699815 21398 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.702008 21398 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:10.677597 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.705006 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.705229 15718 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:10.683183 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 133604us
I20260709 13:08:10.680150 15688 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47706 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2257)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2258)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2259)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2261)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2251)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3415)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2238)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2248)
I20260709 13:08:10.684446 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:10.706346 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.706460 15644 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.706540 15640 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.684383 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:10.697659 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 426949us
I20260709 13:08:10.735842 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.736506 15714 raft_consensus.cc:2376] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12. Re-sending same reply.
I20260709 13:08:10.737871 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.740713 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.741021 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.743680 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.744915 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.746235 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.747362 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.748714 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.749621 15713 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:10.753006 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.754806 15787 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:10.756528 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.757577 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.758072 15714 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:10.763855 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 137757us
I20260709 13:08:10.765152 15644 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:10.767851 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.768139 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.768707 15716 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:08:10.768658 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 163226us
I20260709 13:08:10.751442 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.771266 15714 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:10.764693 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.772331 21628 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:10.773080 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.766355 15721 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.778432 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.780431 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.751958 21426 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.781180 15720 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:10.777966 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.782761 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:10.783303 16298 leader_election.cc:336] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.673s (SENT)
I20260709 13:08:10.785136 15787 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:10.785174 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.752420 21472 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.786028 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.782635 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.785287 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.790320 15721 raft_consensus.cc:2376] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16. Re-sending same reply.
I20260709 13:08:10.788345 15719 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:10.806210 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.807161 15716 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:10.791869 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.804641 15718 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:10.810634 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.811928 15715 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:10.809495 15713 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:10.813131 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.813769 15720 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.814353 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:10.817619 15760 leader_election.cc:336] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.569s (SENT)
I20260709 13:08:10.836208 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.811561 15789 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:10.837378 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:10.840195 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.842444 15791 raft_consensus.cc:2410] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:10.844152 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:10.844571 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.845359 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.846377 15720 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:10.838563 15714 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:10.850103 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.850878 15715 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.857833 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.858676 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.860545 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:10.861120 15716 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.817267 21628 raft_consensus.cc:2764] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:10.793776 21426 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.863471 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.864703 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.869519 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.870203 15715 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.869800 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.884615 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.887815 15713 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.889348 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:10.889536 15714 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
W20260709 13:08:10.893028 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.887741 16325 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:10.897904 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.898178 15717 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.898533 15721 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:10.900321 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.900921 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.904001 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:10.890419 21626 log.cc:927] Time spent T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:08:10.906224 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.906890 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:10.908115 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:10.909118 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 136102us
I20260709 13:08:10.912479 15794 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:10.853363 21593 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.867156 21359 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:08:10.915254 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 108930us
I20260709 13:08:10.916998 15791 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:08:10.917814 15718 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 12: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:10.920331 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:10.920681 21432 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.921250 16334 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:10.914741 21352 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.922313 21352 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.923537 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:10.903582 21622 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.920483 21627 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:10.921144 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60612.8us
I20260709 13:08:10.931725 15713 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.933077 15789 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:10.917312 15685 connection.cc:256] RPC call timeout handler was delayed by -4.4317317730000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 13:08:10.940802 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:10.918572 21589 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:10.950074 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:10.954505 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:10.955492 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 180248us
I20260709 13:08:10.950227 16300 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:10.960773 21591 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.961416 15685 leader_election.cc:400] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:10.961788 15685 leader_election.cc:403] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:10.962803 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:10.972796 21573 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:10.972847 21602 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:10.973698 21602 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:10.975301 16300 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:10.976210 21249 raft_consensus.cc:2804] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:10.976823 21458 consensus_meta.cc:287] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.005s
I20260709 13:08:10.977716 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:10.978608 16330 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:10.971683 21589 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.980710 21589 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.982100 21426 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:10.982476 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:10.987890 21633 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.989928 21633 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:10.991101 15788 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.992552 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.992868 15787 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.993435 15788 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:10.993582 15790 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:10.994010 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.994655 15796 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:10.992102 21633 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:10.995663 15721 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:10.995949 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:10.996723 15794 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:10.997054 15721 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:10.945380 21627 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:10.997872 15719 pending_rounds.cc:85] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 12
I20260709 13:08:10.998214 15719 pending_rounds.cc:107] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:08:10.998461 15719 raft_consensus.cc:2889] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:10.998636 21627 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:11.000578 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:11.001080 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:11.001638 15641 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.001932 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:11.002650 15792 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:11.003365 21622 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.004072 21616 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:11.005453 15642 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:11.006592 15717 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:11.006906 15713 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.008030 15717 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.008416 15713 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:10.921198 21432 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:10.974963 21602 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:11.009330 15717 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.015239 15722 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:11.015684 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:08:11.017434 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.021230 15647 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:11.030534 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:11.022020 15791 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:11.033610 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.029668 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:11.043727 15716 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:10.977321 21458 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:11.046383 15721 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:11.047719 15789 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:11.051360 15722 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:11.051868 15722 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:11.048142 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:11.057024 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:11.058106 21426 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:11.042865 21591 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.061900 21265 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.070118 21591 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:11.089241 21355 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:08:11.456583 21591 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.086263 21249 raft_consensus.cc:697] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:11.651585 21352 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:11.838757 21643 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.840432 21643 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:11.840979 21643 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:11.803198 21593 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:11.899541 21616 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:11.899284 21249 consensus_queue.cc:237] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:11.958448 21458 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:11.980185 21642 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:08:11.992466 21611 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.423s	user 0.014s	sys 0.000s
W20260709 13:08:11.999800 21639 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:08:11.996889 21611 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:12.012586 21622 consensus_meta.cc:287] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.009s	user 0.009s	sys 0.000s
I20260709 13:08:12.014213 21643 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:12.122099 16298 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.311s	user 0.008s	sys 0.002s
W20260709 13:08:12.122599 16298 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.008s	sys 0.002s
W20260709 13:08:12.122937 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 1.3147e+06us
W20260709 13:08:12.124495 16300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.002s	sys 0.014s
W20260709 13:08:12.124993 16300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.002s	sys 0.014s
W20260709 13:08:12.016472 21189 consensus_meta.cc:287] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.369s	user 0.011s	sys 0.001s
I20260709 13:08:12.225873 21189 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.228610 21189 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.149214 21611 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.163864 21622 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:12.282835 16297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.004s	sys 0.002s
W20260709 13:08:12.283176 16297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.004s	sys 0.002s
W20260709 13:08:12.282545 16298 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.727s (SENT)
I20260709 13:08:12.291677 16298 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:12.293396 21426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.058s	sys 0.085s
I20260709 13:08:12.293769 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:12.293979 21426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.215s	user 0.059s	sys 0.085s
I20260709 13:08:12.294473 21426 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:12.294553 16334 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:12.294956 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.278056 21591 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.296048 21426 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.297521 21591 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:12.298822 21622 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.299342 21622 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:12.284094 21627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.001s	sys 0.010s
I20260709 13:08:12.303161 21622 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:12.304831 21627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.001s	sys 0.011s
W20260709 13:08:12.381973 15719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.014s	sys 0.006s
W20260709 13:08:12.382398 15719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.015s	sys 0.006s
I20260709 13:08:12.449273 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3416) took 1490 ms. Trace:
I20260709 13:08:12.449715 15717 rpcz_store.cc:276] 0709 13:08:10.958638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.025606 (+ 66968us) service_pool.cc:224] Handling call
0709 13:08:11.057353 (+ 31747us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:12.444959 (+1387606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.445012 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.445762 (+   750us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.446955 (+  1193us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.447009 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.447084 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.449006 (+  1922us) raft_consensus.cc:1685] finished
0709 13:08:12.449025 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.449210 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"thread_start_us":729,"threads_started":1,"wal-append.queue_time_us":1152}
W20260709 13:08:12.462466 15688 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.724s (SENT)
W20260709 13:08:12.466662 15688 connection.cc:256] RPC call timeout handler was delayed by -3.3980344850000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:08:12.470928 15688 connection.cc:256] RPC call timeout handler was delayed by -3.3107344850000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:08:12.471356 15688 connection.cc:256] RPC call timeout handler was delayed by -3.1287845160001098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:08:12.471752 15688 connection.cc:256] RPC call timeout handler was delayed by -3.0762327860001051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:08:12.472091 15688 connection.cc:256] RPC call timeout handler was delayed by -3.0510327860000643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:08:12.472406 15688 connection.cc:256] RPC call timeout handler was delayed by -3.0029344850000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:08:12.472736 15688 connection.cc:256] RPC call timeout handler was delayed by -2.9466327860000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 13:08:12.473062 15688 connection.cc:256] RPC call timeout handler was delayed by -2.7101040900000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2877s for a response
W20260709 13:08:12.473376 15688 connection.cc:256] RPC call timeout handler was delayed by -2.5501896630000829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3332s for a response
W20260709 13:08:12.473709 15688 connection.cc:256] RPC call timeout handler was delayed by -2.0286327860000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2844s for a response
W20260709 13:08:12.474108 15688 connection.cc:256] RPC call timeout handler was delayed by -1.8414228840000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33590000000000003s for a response
W20260709 13:08:12.474488 15688 connection.cc:256] RPC call timeout handler was delayed by -1.210839288000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4845s for a response
W20260709 13:08:12.478641 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.4322e+06us
I20260709 13:08:12.479729 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:12.478454 21591 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:12.481979 21591 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:12.483382 21591 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:12.485165 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.485376 21658 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:12.485879 21658 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:12.486305 21658 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.486379 21591 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:12.487042 21591 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.488045 21591 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.489353 21591 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.495252 21658 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.497997 21658 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.502534 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:12.503515 21658 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.503985 21658 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:12.504401 21658 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.514504 21602 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:12.516003 21602 consensus_queue.cc:1243] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:12.517064 21602 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:12.518302 21602 consensus_queue.cc:1243] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:12.518975 21602 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.519683 21602 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.522209 21602 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.515833 21658 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.526206 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:12.527275 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:12.527979 16334 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.529181 21591 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.529834 21591 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.530782 21591 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.531665 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3419) took 1572 ms. Trace:
I20260709 13:08:12.532114 21591 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.532059 15721 rpcz_store.cc:276] 0709 13:08:10.959470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.056564 (+ 97094us) service_pool.cc:224] Handling call
0709 13:08:12.530925 (+1474361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.531334 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.531369 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.531411 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.531450 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.531504 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.531612 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:12.534628 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49575.6us
I20260709 13:08:12.536345 21657 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.537819 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.539801 21657 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:12.540457 21657 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.542961 21657 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:12.543454 21657 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:12.543917 21657 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.544274 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3420) took 1584 ms. Trace:
I20260709 13:08:12.545087 16334 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:12.544648 15718 rpcz_store.cc:276] 0709 13:08:10.959753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.543440 (+1583687us) service_pool.cc:224] Handling call
0709 13:08:12.543774 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.543947 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.543977 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.544021 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.544061 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.544118 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.544222 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.546710 21659 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:12.547158 15743 debug-util.cc:398] Leaking SignalData structure 0x7b080032eaa0 after lost signal to thread 14519
I20260709 13:08:12.547358 21659 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:12.548229 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800330300 after lost signal to thread 15579
W20260709 13:08:12.549573 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800330480 after lost signal to thread 15671
W20260709 13:08:12.550279 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08003304c0 after lost signal to thread 15672
W20260709 13:08:12.551384 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800199400 after lost signal to thread 15746
W20260709 13:08:12.551651 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08002506c0 after lost signal to thread 15747
I20260709 13:08:12.554684 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.526667 21658 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.560565 21658 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:12.561127 21658 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.549573 21659 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:12.563337 21659 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.565558 21659 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.567443 21657 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.567857 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:12.575587 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:12.575865 21591 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:12.576342 21591 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:12.576740 21591 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.566267 21659 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:12.577805 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.578274 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.578051 21659 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.580441 21659 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:12.581001 21659 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:12.581316 15715 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 16: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:12.568426 21661 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.569049 21658 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.582046 21661 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:12.568712 15640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.655s	user 0.017s	sys 0.016s
I20260709 13:08:12.584344 21661 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:12.584525 15640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.018s	sys 0.017s
I20260709 13:08:12.569325 21660 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.585266 21660 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:12.578666 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.587613 21660 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.581471 21659 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.591118 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2251) took 2038 ms. Trace:
W20260709 13:08:12.592064 15759 connection.cc:256] RPC call timeout handler was delayed by -1.1153438920000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:08:12.592327 15715 rpcz_store.cc:276] 0709 13:08:10.552561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.870843 (+318282us) service_pool.cc:224] Handling call
0709 13:08:12.590883 (+1720040us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400179dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:12.591034 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3862734080}
I20260709 13:08:12.592185 21659 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.595299 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.595544 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.602522 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:12.609236 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.610805 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.611526 16334 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:12.614358 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:12.578680 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.616421 21657 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.614717 21591 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.642623 21657 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.643121 21657 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.644454 21591 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:12.645641 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 1.66676e+06us
I20260709 13:08:12.645959 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:12.646468 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.646637 16334 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.616562 21660 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.617089 15688 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.651989 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:12.649571 15642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 2562) took 1993 ms (client timeout 2447 ms). Trace:
I20260709 13:08:12.652817 21591 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:12.652647 15642 rpcz_store.cc:269] 0709 13:08:10.655812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.655949 (+   137us) service_pool.cc:224] Handling call
0709 13:08:12.649342 (+1993393us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54001beed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:12.649485 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684678912}
I20260709 13:08:12.634805 15638 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:12.630877 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:12.616357 15760 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.678s	user 0.026s	sys 0.065s
I20260709 13:08:12.639413 15716 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:12.627177 15715 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.653353 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.617364 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.658689 16334 raft_consensus.cc:2468] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:12.655185 15794 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:12.635346 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3417) took 1676 ms. Trace:
I20260709 13:08:12.660233 15685 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:12.662178 15713 rpcz_store.cc:276] 0709 13:08:10.958934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.051191 (+ 92257us) service_pool.cc:224] Handling call
0709 13:08:12.623325 (+1572134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.623596 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.623621 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.624140 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.634959 (+ 10819us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.635006 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.635075 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.635129 (+    54us) raft_consensus.cc:1685] finished
0709 13:08:12.635144 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.635287 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":5592,"threads_started":1,"wal-append.queue_time_us":4808}
W20260709 13:08:12.663872 15760 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.725s	user 0.027s	sys 0.065s
W20260709 13:08:12.664268 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 1.72983e+06us
I20260709 13:08:12.653724 21591 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.619192 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:12.665697 21659 raft_consensus.cc:2804] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:12.669386 21659 raft_consensus.cc:697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.670397 21659 consensus_queue.cc:237] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.653956 21622 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.673192 21658 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.665167 21660 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.673779 21658 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:12.674945 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 1.71555e+06us
I20260709 13:08:12.675678 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2560) took 2031 ms. Trace:
I20260709 13:08:12.677037 21658 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.676069 15646 rpcz_store.cc:276] 0709 13:08:10.644413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.644539 (+   126us) service_pool.cc:224] Handling call
0709 13:08:10.681290 (+ 36751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.779153 (+ 97863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.779181 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.812793 (+ 33612us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.914419 (+101626us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:10.934577 (+ 20158us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.936303 (+  1726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.936579 (+   276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.508604 (+1572025us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:08:12.675317 (+166713us) raft_consensus.cc:1685] finished
0709 13:08:12.675434 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.675615 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20939,"prepare.run_wall_time_us":4197,"raft.queue_time_us":6652,"raft.run_cpu_time_us":45115,"raft.run_wall_time_us":1561887,"spinlock_wait_cycles":15323264,"thread_start_us":126210,"threads_started":2,"wal-append.queue_time_us":142055,"wal-append.run_cpu_time_us":2450,"wal-append.run_wall_time_us":1002609}
I20260709 13:08:12.680962 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:12.685448 15791 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:12.674082 21622 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.686908 15688 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:12.673727 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 391201us
W20260709 13:08:12.687888 16298 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.765s (SENT)
I20260709 13:08:12.688359 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:12.688712 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:12.689963 21622 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:12.691041 16298 leader_election.cc:336] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.860s (SENT)
I20260709 13:08:12.691542 16298 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.691690 21657 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.693301 21649 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.701934 21661 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.702310 21649 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:12.694324 21591 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:12.703290 21591 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:12.702973 21649 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.703776 21591 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.706730 21657 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:12.705487 21649 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:12.708197 16298 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.602s (SENT)
W20260709 13:08:12.709043 16298 connection.cc:256] RPC call timeout handler was delayed by -1.6633673010001075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:08:12.709385 16298 connection.cc:256] RPC call timeout handler was delayed by -1.060012972000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:08:12.709702 16298 connection.cc:256] RPC call timeout handler was delayed by -1.0184538350000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:08:12.710846 21658 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:12.711495 21658 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.712489 21658 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.732059 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.737582 15792 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:12.739867 16334 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:12.740995 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:12.746124 21622 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:12.749531 16330 raft_consensus.cc:1217] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 13:08:12.750353 16330 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:12.751847 16332 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:12.752228 16332 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:12.753046 16332 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.754209 16332 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.744563 21249 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.756371 21249 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.756784 21249 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.759429 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:12.759140 21622 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:12.759902 21622 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:12.762036 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:12.748973 21591 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.767892 21591 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:12.767963 21622 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.769945 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.776546 16332 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:08:12.781011 16327 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.777294 16334 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:12.786439 16332 pending_rounds.cc:85] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 12
I20260709 13:08:12.782059 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.788380 16332 pending_rounds.cc:107] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:12.788791 16332 raft_consensus.cc:2889] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.790126 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.776211 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.792160 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3418) took 1833 ms. Trace:
I20260709 13:08:12.792583 15716 rpcz_store.cc:276] 0709 13:08:10.959223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.054185 (+ 94962us) service_pool.cc:224] Handling call
0709 13:08:12.639202 (+1585017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.655580 (+ 16378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.791956 (+136376us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400179dd0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:12.792104 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644169984}
I20260709 13:08:12.792743 21665 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.791281 16331 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:12.789623 21622 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.790813 16329 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:08:12.795893 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 49305.8us
I20260709 13:08:12.802781 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.802997 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:08:12.808375 15639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.826s	user 0.013s	sys 0.005s
W20260709 13:08:12.808804 15639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.850s	user 0.014s	sys 0.005s
I20260709 13:08:12.810403 16334 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:12.812425 21525 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:12.796511 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50499.2us
W20260709 13:08:12.814463 21644 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.915s	user 0.011s	sys 0.003s
W20260709 13:08:12.814702 15743 debug-util.cc:398] Leaking SignalData structure 0x7b080030a2a0 after lost signal to thread 15820
W20260709 13:08:12.816241 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800052d40 after lost signal to thread 16358
W20260709 13:08:12.816555 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08000a63e0 after lost signal to thread 16359
W20260709 13:08:12.817044 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3aa0 after lost signal to thread 21336
I20260709 13:08:12.817288 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 858) took 2456 ms. Trace:
W20260709 13:08:12.817723 15743 debug-util.cc:398] Leaking SignalData structure 0x7b080026bde0 after lost signal to thread 21558
I20260709 13:08:12.819264 15719 rpcz_store.cc:276] 0709 13:08:10.361325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.997353 (+636028us) service_pool.cc:224] Handling call
0709 13:08:10.997688 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.999096 (+  1408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.999127 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.999559 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.382800 (+1383241us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:12.384537 (+  1737us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.385121 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.385226 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.813779 (+428553us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:12.816975 (+  3196us) raft_consensus.cc:1685] finished
0709 13:08:12.817079 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.817230 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2017,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":660,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":3513216,"thread_start_us":1384092,"threads_started":2,"wal-append.queue_time_us":899364}
I20260709 13:08:12.821600 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:12.826571 21432 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:12.809316 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.831372 21249 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:12.831971 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 1.75753e+06us
I20260709 13:08:12.834124 16328 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.835177 21249 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:12.834928 15722 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.836277 15722 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.838460 21668 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:12.839682 21432 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:12.842075 15641 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 1.840s	user 0.015s	sys 0.003s
I20260709 13:08:12.842525 15641 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:12.840616 21658 consensus_queue.cc:1059] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:12.843622 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:12.844177 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.844519 15796 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.844615 21658 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:12.844991 15794 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:12.844832 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:12.845230 21658 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.846334 21658 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.847050 15792 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:12.847673 21658 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.848143 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.848774 15791 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:12.798485 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:12.850349 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.853039 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:12.854153 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:12.843078 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 2568) took 1842 ms (client timeout 1843 ms). Trace:
W20260709 13:08:12.857337 15641 rpcz_store.cc:269] 0709 13:08:11.000549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.000863 (+   314us) service_pool.cc:224] Handling call
0709 13:08:12.843022 (+1842159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.863466 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:12.864460 15791 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.863484 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.866756 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.867630 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.865693 15792 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:12.869241 15793 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.868268 15788 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:12.870224 15722 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:08:12.870592 15722 pending_rounds.cc:85] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 8
I20260709 13:08:12.870851 15722 pending_rounds.cc:107] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:08:12.869586 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3421) took 1859 ms. Trace:
I20260709 13:08:12.869160 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.871140 15722 raft_consensus.cc:2889] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.871652 15715 rpcz_store.cc:276] 0709 13:08:11.010543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.593680 (+1583137us) service_pool.cc:224] Handling call
0709 13:08:12.594043 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.656420 (+ 62377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.869327 (+212907us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54003863d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:12.869525 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75708288}
W20260709 13:08:12.879544 15638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42130 (request call id 2554) took 2273 ms (client timeout 2291 ms). Trace:
W20260709 13:08:12.879992 15638 rpcz_store.cc:269] 0709 13:08:10.606536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.606730 (+   194us) service_pool.cc:224] Handling call
0709 13:08:12.879288 (+2272558us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000a9e54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:12.879448 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4661398272}
I20260709 13:08:12.871543 21665 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:12.882265 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83863.2us
I20260709 13:08:12.882479 21665 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:12.883554 21665 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.887362 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3422) took 1855 ms. Trace:
I20260709 13:08:12.887506 15796 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:12.888135 15793 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
W20260709 13:08:12.897583 21602 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:08:10.984865 15544 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 6 to 7, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 7 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.897635 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2248) took 2345 ms. Trace:
I20260709 13:08:12.900619 15722 rpcz_store.cc:276] 0709 13:08:10.551775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.015988 (+464213us) service_pool.cc:224] Handling call
0709 13:08:11.016364 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.897342 (+1880978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.897581 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.888254 15719 rpcz_store.cc:276] 0709 13:08:11.032229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.822834 (+1790605us) service_pool.cc:224] Handling call
0709 13:08:12.823162 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.823566 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:12.823596 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.824082 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.867650 (+ 43568us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:12.867692 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.867754 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.887164 (+ 19410us) raft_consensus.cc:1685] finished
0709 13:08:12.887182 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.887306 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1858,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":42964,"threads_started":1,"wal-append.queue_time_us":50272}
I20260709 13:08:12.905071 15791 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:12.909214 21265 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:12.913892 21265 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.918315 21189 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:12.918968 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:12.919549 21189 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.919967 21189 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:12.920208 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.923576 21668 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.922410 21249 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:12.924898 21249 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:12.926016 21249 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.920920 21189 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.931818 21189 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.936784 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.937602 15794 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:08:12.938035 15688 leader_election.cc:336] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.041s (SENT)
W20260709 13:08:12.939128 15688 leader_election.cc:336] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.069s (SENT)
I20260709 13:08:12.939558 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:12.939970 21525 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.940382 21659 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.948596 21670 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:12.955186 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:12.957535 15787 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:12.961069 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:12.964207 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:12.940409 21525 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:12.966470 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:12.949302 21670 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:12.972779 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:12.974295 15721 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.978247 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:12.978561 21488 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.979225 21488 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.979910 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2567) took 2292 ms. Trace:
I20260709 13:08:12.981686 21660 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.982317 21660 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:12.984138 21670 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:12.971078 21439 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:08:12.985204 21660 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:12.986788 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 367646us
W20260709 13:08:12.987221 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.989106 21355 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.989948 21638 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:12.990429 21638 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:12.990814 21638 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.992268 21613 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:12.992919 21613 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:12.993963 15760 connection.cc:256] RPC call timeout handler was delayed by -2.1007073430000673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:08:12.994405 15760 connection.cc:256] RPC call timeout handler was delayed by -2.0863073430000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 13:08:12.994711 15760 connection.cc:256] RPC call timeout handler was delayed by -2.0249556960000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2832s for a response
I20260709 13:08:12.980280 15640 rpcz_store.cc:276] 0709 13:08:10.687426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.775965 (+ 88539us) service_pool.cc:224] Handling call
0709 13:08:10.786930 (+ 10965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.867558 (+ 80628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.867586 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.883435 (+ 15849us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.584991 (+1701556us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.607085 (+ 22094us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.979623 (+372538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.979695 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.979733 (+    38us) raft_consensus.cc:1685] finished
0709 13:08:12.979744 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.979858 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364256,"prepare.queue_time_us":1328,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":107930,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6690,"thread_start_us":1758486,"threads_started":3,"wal-append.queue_time_us":183863}
W20260709 13:08:12.994967 15760 connection.cc:256] RPC call timeout handler was delayed by -2.01061650500003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 13:08:12.995059 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:12.996889 15718 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:12.989660 21355 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.007463 15722 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:13.007349 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 136143us
I20260709 13:08:13.014165 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.023104 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.023893 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.024557 16333 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:13.025348 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:13.025925 16332 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.022397 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:13.035028 21544 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:13.041042 21544 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.044186 21544 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:13.036149 15760 leader_election.cc:336] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.761s (SENT)
I20260709 13:08:13.045537 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:13.004571 21627 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:13.056370 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:13.026885 21658 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:13.061182 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.062090 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:13.065783 15793 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.062304 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.074482 21624 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:13.075392 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.075201 21624 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.076081 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:13.077116 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.074091 21525 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.064402 15794 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:13.088375 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:13.091470 15787 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.052613 21353 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.095909 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.022733 21634 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:13.063086 21659 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.092692 21670 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.099083 21353 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.112627 21353 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:13.088899 21424 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:08:13.092965 21488 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:13.124023 21673 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.220s	user 0.002s	sys 0.001s
I20260709 13:08:13.225005 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.227255 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.227965 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.229013 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:13.229682 15796 raft_consensus.cc:2376] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12. Re-sending same reply.
I20260709 13:08:13.225404 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:08:13.253968 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.234707 15647 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 13:08:13.255569 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 232433us
I20260709 13:08:13.232707 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.265277 15544 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 8 to 11, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 11 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:08:13.270047 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 272271us
I20260709 13:08:13.273959 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:13.274784 15719 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.282886 15794 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 12: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:13.077687 21602 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:08:13.286058 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:13.287715 15645 raft_consensus.cc:2376] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17. Re-sending same reply.
W20260709 13:08:13.294371 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 232115us
I20260709 13:08:13.295360 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:13.296622 15760 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.864s (SENT)
I20260709 13:08:13.060110 21627 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.297149 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.297168 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:13.298058 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.310133 15789 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:13.299754 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.300091 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.102157 21659 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.302083 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:13.302387 15793 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:13.323467 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:13.326404 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.326537 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:13.327319 15718 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:13.329306 15713 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:13.331491 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2550532770000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 13:08:13.333317 15716 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:13.312348 15720 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:13.315433 16332 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:13.316257 15721 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:13.090111 21658 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.317771 15790 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:13.317709 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:13.340139 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2557) took 2698 ms. Trace:
I20260709 13:08:13.340899 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.338776 15788 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:13.331849 21359 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.349411 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.317356 21591 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.363415 15718 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:13.318498 21525 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.303685 21432 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.328902 21659 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.371100 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.369388 15718 pending_rounds.cc:85] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 8
I20260709 13:08:13.382627 15721 raft_consensus.cc:1240] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:13.382860 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 80860.2us
I20260709 13:08:13.385226 15718 pending_rounds.cc:107] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 15.9
W20260709 13:08:13.384943 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 115658us
I20260709 13:08:13.386224 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.386886 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.340561 15639 rpcz_store.cc:276] 0709 13:08:10.641390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.641527 (+   137us) service_pool.cc:224] Handling call
0709 13:08:10.682402 (+ 40875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.682534 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:10.958480 (+275946us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.339808 (+2381328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.339859 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:13.339910 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.339975 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.340087 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253680,"prepare.queue_time_us":109001,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2266,"raft.queue_time_us":240725,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3213,"thread_start_us":2372943,"threads_started":3,"wal-append.queue_time_us":857327,"wal-append.run_cpu_time_us":2082,"wal-append.run_wall_time_us":1160211}
I20260709 13:08:13.387095 15718 raft_consensus.cc:2889] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.390218 21660 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.349772 21634 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.344439 21623 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:13.297012 21488 consensus_queue.cc:1059] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:08:13.394805 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.350032 21353 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:13.368443 21591 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:13.398241 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 478053us
I20260709 13:08:13.403682 15647 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:13.362600 21616 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:13.397461 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.407552 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.416672 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.418403 15642 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:13.417047 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.420727 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.392472 21344 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:13.420336 15647 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:13.427906 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.383931 21670 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:08:13.366474 21665 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.409341 21634 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.429494 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.422384 15720 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:13.412169 21591 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.409149 21624 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.407912 21684 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.433604 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.459198 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.405584 21623 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:13.446625 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 178335us
I20260709 13:08:13.378113 21359 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.430124 21613 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:13.476096 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.478389 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:13.492237 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.492437 15644 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:13.478598 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.493270 15647 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:13.432261 21680 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:13.492736 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.417840 21616 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.489056 15762 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:13.437494 21682 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.499547 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080033d580 after lost signal to thread 14519
W20260709 13:08:13.507042 15817 debug-util.cc:398] Leaking SignalData structure 0x7b0800280ac0 after lost signal to thread 15579
W20260709 13:08:13.508292 15817 debug-util.cc:398] Leaking SignalData structure 0x7b0800339ca0 after lost signal to thread 15671
I20260709 13:08:13.419478 21353 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.512898 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:13.514916 15817 debug-util.cc:398] Leaking SignalData structure 0x7b0800040f20 after lost signal to thread 15746
W20260709 13:08:13.596346 15817 debug-util.cc:398] Leaking SignalData structure 0x7b0800042e40 after lost signal to thread 15747
W20260709 13:08:13.597370 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080033fe40 after lost signal to thread 15820
I20260709 13:08:13.518263 15645 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:08:13.598682 15817 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3740 after lost signal to thread 16358
W20260709 13:08:13.518134 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 221538us
I20260709 13:08:13.518824 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:13.522166 21685 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:08:13.522716 21359 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.522200 21678 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.532035 21439 raft_consensus.cc:3055] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:13.534644 21355 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:13.509251 21638 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.006s
I20260709 13:08:13.539482 21623 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:13.499976 21622 consensus_meta.cc:287] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.696s	user 0.031s	sys 0.008s
W20260709 13:08:13.553905 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.510382 15643 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:13.553511 15787 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
W20260709 13:08:13.615125 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 126168us
W20260709 13:08:13.623507 15817 debug-util.cc:398] Leaking SignalData structure 0x7b0800368f60 after lost signal to thread 16359
W20260709 13:08:13.653861 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 191566us
W20260709 13:08:13.628893 15760 leader_election.cc:336] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.866s (SENT)
I20260709 13:08:13.629283 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.628755 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.490541 21624 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 13:08:13.630990 21398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.009s	sys 0.001s
W20260709 13:08:13.642050 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 255442us
I20260709 13:08:13.665266 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.465546 21684 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.646314 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.648765 15714 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:13.643282 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.666999 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.667024 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:13.679088 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.680761 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:13.684437 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 55581.7us
I20260709 13:08:13.685160 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.692389 15644 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:13.639458 21439 raft_consensus.cc:740] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:13.687822 15647 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:13.508791 21680 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.683940 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.701535 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.705587 16334 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.706199 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.706966 16332 raft_consensus.cc:2393] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:13.714289 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.664474 21398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.010s	sys 0.001s
I20260709 13:08:13.731594 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.700842 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.755789 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.770862 15719 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:13.683305 21602 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:13.671959 21658 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.659026 21649 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:08:13.683513 21432 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.683117 21355 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:13.795526 21677 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:13.645809 21678 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.798188 21696 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:13.800202 21678 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.802820 15639 raft_consensus.cc:2410] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:13.800868 21665 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:13.776494 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.694166 21627 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:13.766410 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.716399 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.828578 15647 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:13.783378 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.783571 21686 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:13.784117 21676 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.787683 21353 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.827346 16331 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:13.633551 21682 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.648144 21638 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.808280 21684 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.776258 21602 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:13.697943 21359 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:08:13.801344 21355 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:13.809998 21634 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:13.810289 21544 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:13.810395 21439 consensus_queue.cc:260] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.811014 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.811161 21696 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:13.811745 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.811933 21678 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:13.863159 21602 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.775727 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.834260 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 153559us
I20260709 13:08:13.884445 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:13.885776 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.805474 21616 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.840704 16330 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:13.841030 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.841068 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.773829 21668 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.845253 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.892792 15719 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:13.894079 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.894773 15719 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:13.847144 15643 raft_consensus.cc:2393] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
W20260709 13:08:13.850903 15760 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.868s (SENT)
W20260709 13:08:13.896142 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 177647us
I20260709 13:08:13.855155 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.856508 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.849376 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:13.869912 15716 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
W20260709 13:08:13.816190 21189 consensus_meta.cc:287] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.884s	user 0.011s	sys 0.001s
I20260709 13:08:13.846276 21432 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:13.871400 15721 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:13.873000 21355 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.873623 21544 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:13.903469 21544 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:13.874169 21359 consensus_queue.cc:1243] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:13.879318 21638 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:13.848555 21686 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:13.880085 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:13.880823 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:13.883509 15646 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.887048 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.899986 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:13.900311 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:13.901902 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:13.919638 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.903730 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52851.1us
I20260709 13:08:13.905503 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:13.935158 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.934523 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.937177 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:13.909653 15638 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.904799 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:13.862519 21591 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:13.891053 21525 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.948139 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.943246 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56269.9us
I20260709 13:08:13.943506 15645 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:13.954525 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.940121 16329 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:13.949308 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 100024us
W20260709 13:08:13.941983 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.954581 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:13.951085 15760 connection.cc:256] RPC call timeout handler was delayed by -1.9856014040000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 13:08:13.950974 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:13.957106 15716 raft_consensus.cc:2410] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:13.940882 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:13.957938 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.960515 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.961151 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:13.956043 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:13.961889 15716 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:13.962183 15760 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.912s (SENT)
I20260709 13:08:13.962419 15717 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:13.962666 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:13.963423 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.956081 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:13.964030 21659 consensus_meta.cc:287] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.004s
I20260709 13:08:13.964612 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:13.964461 21659 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.965533 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:13.966042 15719 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:13.966323 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.966574 21684 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.967020 21684 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.940038 21699 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:13.971117 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.971819 15647 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:13.961231 15643 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:13.965183 21686 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:13.905444 21700 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:13.960624 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:13.983865 15760 connection.cc:256] RPC call timeout handler was delayed by -1.9750618699999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:08:13.967674 21684 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.905169 21682 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:13.971271 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:13.934103 21355 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.983171 21525 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.983822 21688 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.940266 21696 consensus_queue.cc:1243] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:13.906497 21432 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:13.984989 15644 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:13.962347 21658 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.964493 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:13.966953 21634 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:13.947432 21668 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:14.125080 21714 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:08:14.125468 21708 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:14.125877 21668 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.126879 15644 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.128216 15644 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:14.128876 15641 raft_consensus.cc:1217] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.8->[17.9-17.9]   Dedup: 17.9->[]
W20260709 13:08:13.971767 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.958840 21359 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:14.002009 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:14.002684 15716 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:13.785374 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:14.013724 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.131081 15714 raft_consensus.cc:2393] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:13.962141 21591 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:14.046393 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.047991 15643 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:14.091574 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 1183) took 1207 ms. Trace:
I20260709 13:08:14.136833 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:14.142416 16330 rpcz_store.cc:276] 0709 13:08:12.799599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.802735 (+  3136us) service_pool.cc:224] Handling call
0709 13:08:14.006706 (+1203971us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54005f2b54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:14.006887 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978919680}
W20260709 13:08:14.149712 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.033192 21688 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:14.159356 15715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.026s	sys 0.054s
W20260709 13:08:14.159858 15715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.026s	sys 0.054s
W20260709 13:08:14.031711 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 329026us
W20260709 13:08:14.121714 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 128852us
W20260709 13:08:14.123608 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 152379us
W20260709 13:08:14.161932 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 192655us
I20260709 13:08:13.971305 21099 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:08:14.121891 21525 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.994107 21544 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.124394 21711 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.122119 21634 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:14.123831 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 89559.2us
I20260709 13:08:14.129470 15641 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:08:14.130021 15647 raft_consensus.cc:2376] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15. Re-sending same reply.
I20260709 13:08:14.140280 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.173250 15718 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:14.090118 21658 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:14.162714 15685 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:14.164209 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.167812 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54100.5us
I20260709 13:08:14.179834 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.128922 21698 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.119273 15645 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:14.153169 21359 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:14.162690 21696 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.162950 21688 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.166168 21525 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:14.196354 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.198673 15718 raft_consensus.cc:2393] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:14.171927 21711 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.187670 21659 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.176796 21634 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.198362 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:14.189216 21698 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:14.194339 21544 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.186801 21658 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.210387 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:14.202593 15688 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.201114 21525 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.191932 21720 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.207840 21713 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:08:14.204552 15760 connection.cc:256] RPC call timeout handler was delayed by -1.8197556960000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30600000000000005s for a response
W20260709 13:08:14.242053 15760 connection.cc:256] RPC call timeout handler was delayed by -1.7603556960000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3126s for a response
W20260709 13:08:14.242522 15760 connection.cc:256] RPC call timeout handler was delayed by -1.58333608800001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:08:14.242899 15760 connection.cc:256] RPC call timeout handler was delayed by -1.5200277980001147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 13:08:14.243266 15760 connection.cc:256] RPC call timeout handler was delayed by -1.4819654610000725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:08:14.243655 15760 connection.cc:256] RPC call timeout handler was delayed by -1.3388115020001123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:08:14.244020 15760 connection.cc:256] RPC call timeout handler was delayed by -1.1486659920000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2836s for a response
I20260709 13:08:14.194725 21680 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.188207 21591 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:14.239703 15685 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:14.246325 21729 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.204185 21711 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.209060 21624 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.197997 21665 consensus_queue.cc:1059] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
W20260709 13:08:14.264582 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45188.4us
I20260709 13:08:14.214208 21699 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:14.262583 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.218729 21698 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.212394 21623 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.235850 21689 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.256482 21678 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.237010 21539 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:14.244385 15760 connection.cc:256] RPC call timeout handler was delayed by -1.0345638000001145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
I20260709 13:08:14.279081 21724 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.276463 21359 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.302711 21732 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.315040 15794 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:14.317638 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.265045 21659 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.323551 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.323352 21424 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:14.328042 21726 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.327925 21732 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.328907 21726 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.327113 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.327030 21613 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:14.329435 21726 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:14.240619 21432 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.305542 21678 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:14.275205 21680 consensus_queue.cc:1059] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:08:14.337702 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:14.342537 15645 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.335309 15794 pending_rounds.cc:85] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 7
I20260709 13:08:14.343082 15794 pending_rounds.cc:107] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:14.343330 15794 raft_consensus.cc:2889] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.271377 21624 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.368965 21649 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.368791 21684 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.369531 21649 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.370018 21624 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.341393 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:14.370863 21705 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.371327 15641 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:14.372025 21732 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.372421 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:14.333889 21627 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:14.373339 21353 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:14.354622 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:14.373836 21353 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:14.374447 15791 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:14.374892 21353 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.376281 21353 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.378266 21616 raft_consensus.cc:3055] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:14.378801 21616 raft_consensus.cc:740] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:14.379694 21616 consensus_queue.cc:260] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.344844 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:14.355619 21723 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:14.356321 15647 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:08:14.356667 21718 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:14.339249 21665 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:14.383494 21665 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.266695 21729 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.254189 21720 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.341012 21659 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.318130 21539 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.306354 21623 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.358038 21699 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.416623 21684 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.359946 21591 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:14.362771 21692 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.584s	user 0.004s	sys 0.002s
I20260709 13:08:14.327116 21725 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.367329 21722 raft_consensus.cc:3055] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:14.355348 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:14.381582 21616 raft_consensus.cc:3060] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.385711 15641 raft_consensus.cc:1240] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.382766 15644 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
W20260709 13:08:14.400486 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.408263 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.409474 15645 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
W20260709 13:08:14.409580 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 207063us
I20260709 13:08:14.414310 15792 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:14.413944 21698 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.341298 21678 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.371333 21705 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:14.420560 21665 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.419214 21659 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.426244 15788 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:14.427227 15642 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:14.430017 21660 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:14.430768 21658 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.431550 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3434) took 1083 ms. Trace:
I20260709 13:08:14.454916 15722 rpcz_store.cc:276] 0709 13:08:13.347837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.357244 (+  9407us) service_pool.cc:224] Handling call
0709 13:08:13.364057 (+  6813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.364274 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.364297 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.379545 (+ 15248us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.506698 (+127153us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:13.506739 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.506812 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.361844 (+855032us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:14.431209 (+ 69365us) raft_consensus.cc:1685] finished
0709 13:08:14.431233 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.431483 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8614144,"thread_start_us":93779,"threads_started":1,"wal-append.queue_time_us":253266}
I20260709 13:08:14.382304 21525 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.432367 21720 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.433349 21623 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.382719 21602 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.437817 15647 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:14.438892 15643 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.462941 21705 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.464344 21705 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.465301 21698 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.467231 21659 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.434813 21722 raft_consensus.cc:740] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:14.439589 21649 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:14.440182 21539 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.325403 21724 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.440996 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:14.447588 21726 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.470230 15640 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.470769 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2578) took 1243 ms. Trace:
I20260709 13:08:14.471189 15646 rpcz_store.cc:276] 0709 13:08:13.227280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.227402 (+   122us) service_pool.cc:224] Handling call
0709 13:08:13.299632 (+ 72230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.947556 (+647924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.470520 (+522964us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54003eb2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:14.470714 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316780288}
I20260709 13:08:14.434168 21729 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:14.440771 21688 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.442332 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.474300 21525 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.474546 15719 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:14.475214 15714 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.475303 21602 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.475543 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:14.476130 15719 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.476037 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:14.443223 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2685) took 1027 ms. Trace:
I20260709 13:08:14.474422 21724 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.477905 15639 rpcz_store.cc:276] 0709 13:08:13.416294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.416410 (+   116us) service_pool.cc:224] Handling call
0709 13:08:14.443011 (+1026601us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002dbc54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:14.443146 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885385472}
W20260709 13:08:14.480825 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.481254 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:14.482266 21539 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:14.468537 21722 consensus_queue.cc:260] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.483696 21722 raft_consensus.cc:3060] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.483937 15640 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
W20260709 13:08:14.446755 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.444202 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.408346 21740 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.452358 15793 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.453176 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.453848 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.457717 15790 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:14.487182 15719 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:14.487787 15639 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:14.506819 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.507133 15789 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:14.500943 15643 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
I20260709 13:08:14.508428 15796 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:14.460547 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.482867 21539 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.511134 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:14.437319 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3433) took 1116 ms. Trace:
I20260709 13:08:14.422811 21696 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:14.511811 15720 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.512358 15713 rpcz_store.cc:276] 0709 13:08:13.320757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.342849 (+ 22092us) service_pool.cc:224] Handling call
0709 13:08:13.369026 (+ 26177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.691607 (+322581us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:13.996330 (+304723us) log.cc:844] Serialized 14 byte log entry
0709 13:08:14.418023 (+421693us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.424235 (+  6212us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.424584 (+   349us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:14.424650 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.424760 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.437144 (+ 12384us) raft_consensus.cc:1685] finished
0709 13:08:14.437165 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.437270 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3882,"prepare.queue_time_us":189855,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":87611,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":20309,"thread_start_us":650993,"threads_started":4,"wal-append.queue_time_us":186796}
I20260709 13:08:14.511752 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:14.517432 15721 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:14.528607 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.522852 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.534420 15788 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:14.536728 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 92593.2us
I20260709 13:08:14.537353 15641 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:14.538354 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.539289 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.540160 15719 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:14.542675 15796 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.544234 15718 raft_consensus.cc:1240] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.536607 21724 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.538460 21638 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.548276 21638 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:14.518173 21539 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.548897 21688 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:14.550951 15610 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.605s (SENT) [suppressed 46 similar messages]
I20260709 13:08:14.551425 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:14.574331 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:14.577101 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 314537us
I20260709 13:08:14.593021 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:14.597339 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:14.563043 21659 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:14.600297 15720 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:14.510468 21265 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:08:14.607121 15720 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:14.609146 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.609892 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.549309 21638 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.608990 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.620450 15713 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:14.622201 15720 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.626689 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.636332 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.604033 21688 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.544462 21711 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.519475 21740 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.610244 21602 raft_consensus.cc:2764] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:14.646584 16334 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:14.650831 15713 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.673296 15688 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
W20260709 13:08:14.657804 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.670718 15789 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:14.663884 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:14.687323 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:14.687996 15796 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.620317 21649 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.691876 15720 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:14.671053 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:14.685416 15788 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:14.670684 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:14.695318 16331 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.666549 21658 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.698678 21741 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.699575 21702 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.701821 21738 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:08:14.702515 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:14.702747 21649 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:14.703382 15713 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.641479 21688 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:14.671325 21678 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.641431 21696 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.612555 21659 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.664153 21731 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.642208 21699 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.706020 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2690) took 1268 ms. Trace:
I20260709 13:08:14.794055 15638 rpcz_store.cc:276] 0709 13:08:13.437824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.458527 (+ 20703us) service_pool.cc:224] Handling call
0709 13:08:13.909402 (+450875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.950182 (+ 40780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.705792 (+755610us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54000aa350. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:14.705940 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968020224}
I20260709 13:08:14.734053 15645 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:14.711511 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2701) took 1168 ms. Trace:
I20260709 13:08:14.795948 15642 rpcz_store.cc:276] 0709 13:08:13.543346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.966094 (+422748us) service_pool.cc:224] Handling call
0709 13:08:14.711290 (+745196us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54000a9454. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:14.711444 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057805184}
W20260709 13:08:14.708873 21736 log.cc:927] Time spent T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:08:14.732798 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 120441us
I20260709 13:08:14.726011 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:14.800175 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.718976 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.718221 16330 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:14.801328 16332 raft_consensus.cc:1275] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:14.801398 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.802757 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.722108 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.805964 21748 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.732878 15641 raft_consensus.cc:1240] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.722776 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:14.807678 21751 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:08:14.762892 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.671016 21744 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:14.722427 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.737561 21688 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.727198 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:14.787242 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:14.720463 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.803903 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.809119 15790 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:14.719240 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.805179 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.811957 15646 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:14.693432 21725 raft_consensus.cc:2804] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:14.705633 21690 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.816998 15791 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:14.720629 21439 raft_consensus.cc:3060] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.721110 15717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3428) took 1445 ms. Trace:
I20260709 13:08:14.891353 15717 rpcz_store.cc:276] 0709 13:08:13.275841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.275982 (+   141us) service_pool.cc:224] Handling call
0709 13:08:13.318833 (+ 42851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.962940 (+644107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.720857 (+757917us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54001e7154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:14.721037 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479524096}
I20260709 13:08:14.823272 15713 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:14.852279 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.734414 21634 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:14.857538 21665 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.903002 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.673573 21726 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:08:14.866443 21659 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.734126 20934 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:14.728698 21676 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:14.707217 21660 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:14.877382 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3439) took 1069 ms. Trace:
I20260709 13:08:14.873672 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.940577 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.940867 15795 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.884814 21649 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:14.873715 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 86570.3us
I20260709 13:08:14.883137 15792 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:14.888655 16331 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:14.902263 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:14.937043 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.871011 15642 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:14.940608 15716 rpcz_store.cc:276] 0709 13:08:13.808043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.130726 (+322683us) service_pool.cc:224] Handling call
0709 13:08:14.160039 (+ 29313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.340047 (+180008us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:14.340098 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.485556 (+145458us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.649827 (+164271us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:14.649882 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.649982 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.877076 (+227094us) raft_consensus.cc:1685] finished
0709 13:08:14.877108 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.877302 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25908,"raft.queue_time_us":100709,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":14335,"thread_start_us":279395,"threads_started":2,"wal-append.queue_time_us":331588}
W20260709 13:08:14.933764 21751 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:14.954370 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.700235 21702 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:14.954155 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.951108 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:14.889394 21700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.006s	sys 0.009s
W20260709 13:08:14.992605 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.902660 21711 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:14.936659 20934 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:14.887470 21539 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.024933 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:14.940639 21732 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:14.903157 21725 raft_consensus.cc:697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:14.939970 21676 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:15.027958 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:15.028518 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.944308 21660 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:15.028220 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 77211.1us
I20260709 13:08:15.030570 15790 raft_consensus.cc:2376] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 15. Re-sending same reply.
W20260709 13:08:15.027253 21722 consensus_meta.cc:287] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
W20260709 13:08:15.034130 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.026813 21700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.008s	sys 0.014s
I20260709 13:08:15.034797 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:15.037899 15796 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:15.038347 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:15.038492 21725 consensus_queue.cc:237] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.038929 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.935173 21665 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.039994 15640 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:15.041978 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:14.954690 21698 consensus_queue.cc:1059] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:15.031920 21355 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:15.046371 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:15.054217 15790 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.054349 15795 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:15.031904 21634 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:14.903317 21690 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.060917 21702 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.067384 21665 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:15.069942 21679 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:15.080404 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.037650 21700 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:15.084168 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:15.044482 21611 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:08:14.701244 21672 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.342s
I20260709 13:08:15.086206 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3446) took 1276 ms. Trace:
I20260709 13:08:14.700775 21710 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.364s
I20260709 13:08:15.045588 21682 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:08:15.098452 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 203090us
I20260709 13:08:15.097210 15715 rpcz_store.cc:276] 0709 13:08:13.809879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.290685 (+480806us) service_pool.cc:224] Handling call
0709 13:08:14.291082 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.324751 (+ 33669us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:14.336984 (+ 12233us) log.cc:844] Serialized 14 byte log entry
0709 13:08:14.490818 (+153834us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18003dd740. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:08:14.627429 (+136611us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.627872 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.627994 (+   122us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:14.628022 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.628081 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.081775 (+453694us) raft_consensus.cc:1685] finished
0709 13:08:15.086039 (+  4264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.086158 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35050,"prepare.queue_time_us":14469,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":133202,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":2716,"spinlock_wait_cycles":3247232,"thread_start_us":119552,"threads_started":1,"wal-append.queue_time_us":341764}
I20260709 13:08:15.102627 15789 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:15.103426 15795 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:15.109123 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.111284 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:15.114508 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.117921 15760 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:15.120203 15641 raft_consensus.cc:1275] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:15.120954 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.123642 15642 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:15.121523 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:15.126435 21700 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.083978 21353 raft_consensus.cc:3055] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:15.146317 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:15.149312 16300 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:15.150208 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.150738 21687 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.144672 21668 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.151701 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.089886 21734 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:08:15.152837 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.158728 15638 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:15.095887 21634 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:08:15.114068 21678 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.086938 21679 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.131152 21722 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.141803 21682 consensus_queue.cc:1243] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:15.131024 21683 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:15.178994 21683 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.151135 21690 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:15.145062 21710 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:15.145206 21353 raft_consensus.cc:740] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.174041 21649 raft_consensus.cc:2804] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:15.178411 16325 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:15.146992 21698 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.089556 21676 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:15.184182 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 102562us
I20260709 13:08:15.187105 15791 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:15.168051 21687 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:15.168232 21668 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:15.191315 15760 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:15.182588 21724 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:15.198395 21687 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.249517 15792 raft_consensus.cc:2468] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:15.180008 21722 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:15.255226 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.261276 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 70053us
I20260709 13:08:15.204924 21539 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.193612 21690 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:08:15.236244 21616 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:15.275279 15760 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:15.274817 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3458) took 1024 ms. Trace:
I20260709 13:08:15.239564 21676 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.280335 15718 rpcz_store.cc:276] 0709 13:08:14.250883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.568161 (+317278us) service_pool.cc:224] Handling call
0709 13:08:14.568465 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.867523 (+299058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.867557 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:14.867600 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:14.867632 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.271714 (+404082us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400438d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:15.274609 (+  2895us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.274759 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574161152}
I20260709 13:08:15.198489 21668 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.274338 21732 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:15.194139 21355 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.198483 21649 raft_consensus.cc:697] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:15.204859 21672 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.277611 21686 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.276933 21757 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.294135 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:15.318189 15715 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.318084 21757 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.319027 21686 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:15.295246 15717 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:15.275660 21756 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 13:08:15.295964 21696 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:15.301585 21355 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.290831 21732 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.303268 21649 consensus_queue.cc:237] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.298547 21488 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.294407 21698 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.332466 21688 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.341207 21698 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.342940 21688 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.343688 15714 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.320055 21686 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.346159 21686 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.349012 15715 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:15.239566 21724 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.352927 21724 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:15.354111 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.353358 21732 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:15.357362 21755 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:08:15.358353 21732 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.328472 21696 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.332414 21757 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.359368 21359 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.359874 21359 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.364776 21679 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:15.360702 21359 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.334301 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:15.369092 15717 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.330111 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:15.370048 15718 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.371331 21722 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:15.372920 21683 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:15.368322 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.375837 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.376505 15645 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.377341 15717 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:15.252234 21353 consensus_queue.cc:260] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.359397 21696 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.388583 21611 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:15.389213 21611 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.389629 21696 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.390400 21611 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.391939 21611 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.402678 15760 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:15.405475 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:15.415537 21679 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.445056 15639 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.419006 21705 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:15.423604 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.425019 21353 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.426007 21683 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:15.430419 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 231485us
I20260709 13:08:15.491048 21702 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:15.492007 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:15.423008 15645 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
W20260709 13:08:15.435489 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.441355 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.498131 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.500948 15642 raft_consensus.cc:2410] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 17 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:08:15.499495 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.452176 15790 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
W20260709 13:08:15.458244 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52868.7us
I20260709 13:08:15.358034 21687 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:15.461409 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.505137 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.414328 21668 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.463851 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:15.509479 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45716us
I20260709 13:08:15.509671 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:15.510314 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:15.510573 15792 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:15.511893 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.513164 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.513077 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:15.462551 21488 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.517274 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.518724 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:15.495064 21763 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
W20260709 13:08:15.515467 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.515226 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.369099 21359 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.518854 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.519711 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:15.462795 21705 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.521592 15791 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:15.516175 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:15.473806 21740 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.528970 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.530582 15792 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:15.543226 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:15.532608 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.543659 15795 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:15.438527 21616 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:08:15.526371 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:15.506821 21722 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:15.541640 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:15.559540 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.508860 21698 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:15.544903 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:15.552397 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 43860.7us
I20260709 13:08:15.485713 21731 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:08:15.557721 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:15.563639 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:15.559406 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:15.564833 15714 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:15.566721 15638 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:15.528425 21724 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.560595 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:15.528092 21634 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.538681 21702 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:15.562069 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:15.557864 21677 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:15.570354 15719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3455) took 1602 ms. Trace:
I20260709 13:08:15.570472 21659 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:15.571405 21700 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:15.547798 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:15.572329 21660 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.003s
I20260709 13:08:15.595000 21660 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.596323 15716 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:15.597422 21660 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.549621 21726 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:15.603523 21668 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.603699 21726 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:15.417709 20934 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.588563 21705 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.588059 15719 rpcz_store.cc:276] 0709 13:08:13.967583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.540999 (+573416us) service_pool.cc:224] Handling call
0709 13:08:14.550679 (+  9680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.551192 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.551243 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.558170 (+  6927us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.944690 (+386520us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:14.944754 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.944863 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.356775 (+411912us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:15.560463 (+203688us) raft_consensus.cc:1685] finished
0709 13:08:15.560517 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.570281 (+  9764us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8656,"spinlock_wait_cycles":10728192,"thread_start_us":329816,"threads_started":1,"wal-append.queue_time_us":517829}
I20260709 13:08:15.591218 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:15.591919 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 259267us
W20260709 13:08:15.575984 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.572458 21488 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.599538 21687 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:15.600152 21758 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:08:15.601325 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:15.576984 21634 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.602052 21638 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:15.605233 15688 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:15.579540 15640 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:15.621753 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 449424us
I20260709 13:08:15.650187 15760 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:15.542446 21679 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:15.565012 21740 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:15.658969 15718 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:15.604455 21659 consensus_queue.cc:1048] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:08:15.675776 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.604599 20934 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.575232 21702 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:15.721246 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.683301 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 78166.5us
I20260709 13:08:15.677455 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:15.724436 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:15.568369 21722 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.727029 15646 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:15.730563 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53036.7us
I20260709 13:08:15.731701 15611 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:15.576537 21711 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:08:15.678594 21762 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:15.738065 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.736369 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.679302 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:15.714011 21734 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:08:15.675108 21740 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:15.768822 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 89602.8us
I20260709 13:08:15.771656 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:15.772452 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:15.725904 21702 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.719667 21688 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:15.604636 21726 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:15.770870 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 46594us
I20260709 13:08:15.762982 21769 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.765797 21732 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:15.765595 21678 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:15.764585 21731 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.726485 21757 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:15.783249 21751 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:15.796486 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:15.660190 21638 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.799522 15718 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.800211 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:15.838610 15719 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.773818 21740 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.809158 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39124 (request call id 881) took 1083 ms. Trace:
I20260709 13:08:15.839306 15721 rpcz_store.cc:276] 0709 13:08:14.726201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.735721 (+  9520us) service_pool.cc:224] Handling call
0709 13:08:14.736064 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.738605 (+  2541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.738644 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.799963 (+ 61319us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.096589 (+296626us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:15.096650 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.096742 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.599577 (+502835us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:15.801473 (+201896us) raft_consensus.cc:1685] finished
0709 13:08:15.801501 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.809077 (+  7576us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2128,"raft.queue_time_us":2438,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10174,"spinlock_wait_cycles":13127424,"thread_start_us":229380,"threads_started":1,"wal-append.queue_time_us":340156}
I20260709 13:08:15.773998 21665 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:15.725819 21687 consensus_queue.cc:1048] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:08:15.834030 16325 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.896436 21634 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.835363 16331 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.837553 16330 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.842372 16329 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:15.842249 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:15.802080 21768 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:15.773027 21762 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:15.809877 21659 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 13:08:15.842950 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:15.845942 21732 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:15.846535 21678 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:15.606608 21710 consensus_queue.cc:1175] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fec10611791a4ab384f86b212249410e" responder_term: 13 status { last_received { term: 12 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:15.833210 21734 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:15.862331 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:15.869761 21702 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.871505 15647 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:15.889582 21665 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.808699 21769 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:15.893110 21722 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:15.805893 21688 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:15.907377 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.938728 21768 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.940527 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:15.999099 16325 raft_consensus.cc:2468] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:15.941720 15643 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:16.000430 15544 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 6 to 10, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 10 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.944252 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:16.002748 16327 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:15.946637 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
W20260709 13:08:15.899356 21686 consensus_meta.cc:287] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.000s
W20260709 13:08:15.921854 21611 consensus_meta.cc:287] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:08:16.003961 16328 raft_consensus.cc:2376] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 16. Re-sending same reply.
I20260709 13:08:15.947206 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:15.900966 21676 consensus_meta.cc:287] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.002s
I20260709 13:08:15.841217 21683 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:15.981706 21725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.027s	sys 0.063s
W20260709 13:08:15.985865 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.988430 15719 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:15.939073 16333 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:16.012945 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:16.010671 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.017824 16334 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.981899 21665 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:16.023237 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.026392 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:16.028015 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:16.033375 16331 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:08:16.037232 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.059341 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.012172 21725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.028s	sys 0.063s
I20260709 13:08:16.066363 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:16.070382 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:16.074952 16333 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.070524 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:16.005719 21768 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.085667 16334 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
W20260709 13:08:16.087419 15685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.020s
W20260709 13:08:16.089416 15685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.016s	sys 0.020s
I20260709 13:08:15.906241 21638 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.023365 21676 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.102988 15641 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
W20260709 13:08:16.092047 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 529223us
W20260709 13:08:16.104737 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 335344us
W20260709 13:08:16.107653 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.013s
I20260709 13:08:16.108466 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:16.110186 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.006s	sys 0.013s
W20260709 13:08:16.110558 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 536916us
I20260709 13:08:16.110560 16331 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:16.105677 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:16.109124 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:16.125082 16327 raft_consensus.cc:2410] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:08:16.126065 16298 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.019s	sys 0.060s
W20260709 13:08:16.129007 16298 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.019s	sys 0.060s
W20260709 13:08:16.129355 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 321530us
W20260709 13:08:16.129503 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 662727us
I20260709 13:08:16.130143 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:16.134794 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:16.118599 21638 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.125895 21355 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:16.128407 20934 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:16.128429 21677 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:16.148527 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:16.146054 15611 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:16.155910 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:16.124847 21725 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:08:16.097579 21732 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.125052 21660 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:08:16.094645 21678 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.156687 15714 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:16.191969 15721 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:16.195050 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:16.196457 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:16.157253 21731 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.152288 21677 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:16.200624 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:16.201232 15721 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.201819 15717 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:16.161998 21355 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:16.132580 21688 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:16.187829 21359 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.001s
W20260709 13:08:16.203853 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 622593us
I20260709 13:08:16.217389 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:16.154268 21616 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:08:16.156169 20934 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.229084 15714 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:16.224082 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:16.198278 21634 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:16.232311 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 105440us
I20260709 13:08:16.207923 21779 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:16.215945 21690 raft_consensus.cc:2764] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:08:16.255525 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.256008 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.257225 15721 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:16.263453 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:16.265152 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:16.184399 21726 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:16.266396 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:16.267961 15787 raft_consensus.cc:2393] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:08:16.269959 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 152229us
I20260709 13:08:16.218544 21762 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:16.276875 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:16.272917 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:08:16.287539 21776 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:08:16.274107 15760 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:16.291697 16333 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:16.294708 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:16.253376 21634 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:16.257805 21702 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:16.296331 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:16.308722 15793 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.252532 21731 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.264614 21724 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:16.313104 15791 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:16.272132 21771 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:08:16.263217 21711 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.317540 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:16.317531 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:16.325652 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.325644 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:16.327103 15721 raft_consensus.cc:2376] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13. Re-sending same reply.
W20260709 13:08:16.338084 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.266911 21672 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:16.319833 21725 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:16.347659 15787 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.268390 21779 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:16.296296 21785 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 13:08:16.340598 21775 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:08:16.306385 21781 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:16.271934 21677 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:16.358975 21774 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:08:16.322620 21724 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:16.422003 15787 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
W20260709 13:08:16.425424 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.399569 15793 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:16.319725 21731 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.327418 21790 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:08:16.417237 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 99757.4us
I20260709 13:08:16.429466 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:16.386680 21778 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:08:16.385191 21711 raft_consensus.cc:2764] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:16.384697 21782 raft_consensus.cc:2764] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:16.329133 21355 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.458739 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3477) took 1177 ms. Trace:
I20260709 13:08:16.457599 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:16.455279 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 160964us
I20260709 13:08:16.459826 15715 rpcz_store.cc:276] 0709 13:08:15.281666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.354236 (+ 72570us) service_pool.cc:224] Handling call
0709 13:08:15.354601 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.354989 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.355018 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.355547 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.720328 (+364781us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:15.720396 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.733981 (+ 13585us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.458480 (+724499us) raft_consensus.cc:1685] finished
0709 13:08:16.458508 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.458668 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1143,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"thread_start_us":364343,"threads_started":1,"wal-append.queue_time_us":709570}
I20260709 13:08:16.388012 21726 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:16.421893 21668 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.446638 21677 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.456553 21189 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:16.466498 21780 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
W20260709 13:08:16.503638 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.459977 21783 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.409324 21634 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:16.512610 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.524011 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.535861 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:16.553925 15639 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:16.566187 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 248705us
I20260709 13:08:16.506259 21359 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:16.497228 21769 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:16.477790 21791 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.609855 21359 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:16.570170 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 117925us
W20260709 13:08:16.616173 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.529654 21189 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:16.573190 21784 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:08:16.569394 21705 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:16.605558 21801 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:08:16.660558 21785 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.661368 21785 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:16.662177 21711 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.662851 21711 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:16.664296 21785 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:16.664152 21711 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:16.570479 21665 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
W20260709 13:08:16.672531 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.682734 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.505918 21782 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.471791 21668 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:16.692701 21668 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:16.647042 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.506086 21797 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:16.644832 21189 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:16.659354 21740 consensus_meta.cc:287] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 13:08:16.700513 21740 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.660238 21781 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.484935 20934 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:16.617949 21790 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.723371 21797 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.700925 21782 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:16.619078 21725 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:16.735462 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 168300us
W20260709 13:08:16.737006 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.734987 21801 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:08:16.760937 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.668063 21813 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.764219 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 955) took 1255 ms. Trace:
W20260709 13:08:16.747181 21821 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:16.774763 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:16.711057 21665 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:16.800303 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:16.711347 21781 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.776544 21806 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.775287 21833 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:16.805858 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.780055 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:16.803546 16332 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:16.794885 16329 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:08:16.794912 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.807236 16330 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.794327 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2740) took 1286 ms. Trace:
I20260709 13:08:16.817073 15638 rpcz_store.cc:276] 0709 13:08:15.507404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.567644 (+ 60240us) service_pool.cc:224] Handling call
0709 13:08:15.586827 (+ 19183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.600296 (+ 13469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.600332 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.600853 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.087958 (+487105us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:16.088001 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.088068 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.794027 (+705959us) raft_consensus.cc:1685] finished
0709 13:08:16.794050 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.794244 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1646,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":486714,"threads_started":1,"wal-append.queue_time_us":634579}
W20260709 13:08:16.810711 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44237.2us
I20260709 13:08:16.820717 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:16.794528 15794 rpcz_store.cc:276] 0709 13:08:15.509266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.517566 (+  8300us) service_pool.cc:224] Handling call
0709 13:08:15.517994 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.528430 (+ 10436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.528457 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.534816 (+  6359us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.024555 (+489739us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:16.024593 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.024755 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.763977 (+739222us) raft_consensus.cc:1685] finished
0709 13:08:16.764001 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.764152 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9974,"raft.queue_time_us":10869,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12086,"thread_start_us":452325,"threads_started":1,"wal-append.queue_time_us":574622}
I20260709 13:08:16.797870 21725 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.828373 21802 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.828730 21833 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:16.829447 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.822232 21806 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:16.801164 21808 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:08:16.800621 21805 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
I20260709 13:08:16.730465 21359 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:16.834457 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:16.803388 21740 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:16.802933 21672 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.792361 21779 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:16.911134 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:17.079737 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 168678us
W20260709 13:08:16.932066 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.024700 21757 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:16.821427 21660 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.935155 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.921430 21724 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:16.804802 21790 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:08:16.846467 21665 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:17.094420 21665 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.094975 21797 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:17.095227 21665 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.098740 21660 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.099385 21806 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.101157 21660 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.088244 21757 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.903239 21800 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.003935 15641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2733) took 1506 ms (client timeout 1823 ms). Trace:
W20260709 13:08:17.103627 15641 rpcz_store.cc:269] 0709 13:08:15.497585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.499185 (+  1600us) service_pool.cc:224] Handling call
0709 13:08:17.003647 (+1504462us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54000aa854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:17.003840 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154843520}
I20260709 13:08:16.932053 21731 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:17.014544 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 193877us
W20260709 13:08:17.015746 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.043370 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.109270 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:17.110503 15760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.031s	sys 0.044s
W20260709 13:08:17.110862 15760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.031s	sys 0.044s
I20260709 13:08:16.951566 21812 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.020131 21698 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:17.075596 16325 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:17.076288 16332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56434 (request call id 784) took 1090 ms. Trace:
W20260709 13:08:17.082472 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.120028 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.933215 21768 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.004s
I20260709 13:08:17.082901 21672 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:17.090657 15545 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 276) took 26882 ms (client timeout 15000 ms). Trace:
W20260709 13:08:17.107642 15639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2731) took 1610 ms (client timeout 1661 ms). Trace:
I20260709 13:08:17.122396 15719 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:17.121042 16332 rpcz_store.cc:276] 0709 13:08:15.986049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.987039 (+   990us) service_pool.cc:224] Handling call
0709 13:08:17.075013 (+1087974us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54004e2354. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:17.076196 (+  1183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816316160}
W20260709 13:08:17.122912 15639 rpcz_store.cc:269] 0709 13:08:15.496934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.511588 (+ 14654us) service_pool.cc:224] Handling call
0709 13:08:17.107397 (+1595809us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540045fbd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:17.107558 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641864576}
I20260709 13:08:17.102811 21359 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:17.131598 15643 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:17.133601 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 676054us
I20260709 13:08:17.133844 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:17.032831 21802 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.146551 15716 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.123081 21702 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:17.122376 21731 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:17.118949 21698 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:17.151388 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:17.121934 21732 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.158604 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.144521 21638 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.990s	user 0.013s	sys 0.000s
I20260709 13:08:16.967610 21782 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.163437 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:17.122440 21682 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:17.112936 21800 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.122491 21734 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:08:17.130511 21660 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:17.166131 21724 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.132326 21768 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.151599 21817 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:17.174470 21842 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.174690 21825 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:17.175782 21818 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:17.174906 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:17.178189 21686 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.165001 21702 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:17.202474 15646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.006s	sys 0.024s
W20260709 13:08:17.206164 15646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.006s	sys 0.024s
W20260709 13:08:17.185073 21824 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:08:17.247746 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.192010 21823 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.381s	user 0.002s	sys 0.000s
I20260709 13:08:17.284404 16331 raft_consensus.cc:1240] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 13:08:17.285131 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.288594 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 113762us
I20260709 13:08:17.186098 21665 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.186159 21812 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.164544 21732 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.192003 21842 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:17.193379 21781 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:17.304386 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:17.312618 15639 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:17.202797 21686 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:17.308692 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 193796us
I20260709 13:08:17.310009 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:17.321203 21686 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.321923 21786 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.322364 21686 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.323149 21838 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:08:17.310170 21842 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.302187 21722 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.307940 21812 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.328795 21812 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:17.189950 21724 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.331290 21724 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.332136 16327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 1015) took 1072 ms. Trace:
I20260709 13:08:17.332580 16327 rpcz_store.cc:276] 0709 13:08:16.259396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.267195 (+  7799us) service_pool.cc:224] Handling call
0709 13:08:16.271429 (+  4234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.318316 (+ 46887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.318346 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.336062 (+ 17716us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.747623 (+411561us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:16.747690 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.747802 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.331842 (+584040us) raft_consensus.cc:1685] finished
0709 13:08:17.331865 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.332069 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19145,"raft.queue_time_us":19365,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7841,"thread_start_us":354740,"threads_started":2,"wal-append.queue_time_us":693754}
W20260709 13:08:17.335664 15610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.563s	user 0.012s	sys 0.031s
W20260709 13:08:17.336107 15610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.012s	sys 0.031s
W20260709 13:08:17.122758 15545 rpcz_store.cc:269] 0709 13:07:50.208552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.230250 (+ 21698us) service_pool.cc:224] Handling call
0709 13:08:17.090378 (+26860128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:01.279082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:01.304487 (+ 25405us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:01.304542 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:08:01.304579 (+    37us) tablet.cc:662] Decoding operations
0709 13:08:01.366544 (+ 61965us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:01.366693 (+   149us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:01.366745 (+    52us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:08:01.560392 (+193647us) tablet.cc:701] Row locks acquired
0709 13:08:01.560436 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:08:01.560611 (+   175us) write_op.cc:270] Start()
0709 13:08:01.560759 (+   148us) write_op.cc:276] Timestamp: P: 1783602481560550 usec, L: 0
0709 13:08:01.560777 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:01.561594 (+   817us) log.cc:844] Serialized 12379 byte log entry
0709 13:08:02.821728 (+1260134us) op_driver.cc:464] REPLICATION: finished
0709 13:08:03.126391 (+304663us) write_op.cc:301] APPLY: starting
0709 13:08:03.126517 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:03.769404 (+642887us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:03.769549 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:05.176275 (+1406726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:05.176722 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0709 13:08:05.176768 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:05.366723 (+189955us) log.cc:844] Serialized 276 byte log entry
0709 13:08:05.517118 (+150395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:05.556203 (+ 39085us) write_op.cc:454] Released schema lock
0709 13:08:05.577869 (+ 21666us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:05.587486 (+  9617us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:05.589382 (+  1896us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2007181,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":287781,"apply.run_cpu_time_us":72377,"apply.run_wall_time_us":2452004,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137759,"num_ops":32,"prepare.queue_time_us":404945,"prepare.run_cpu_time_us":21403,"prepare.run_wall_time_us":442432,"raft.queue_time_us":789910,"raft.run_cpu_time_us":9807,"raft.run_wall_time_us":245522,"replication_time_us":1225480,"thread_start_us":791701,"threads_started":5,"wal-append.queue_time_us":405373,"wal-append.run_cpu_time_us":37326,"wal-append.run_wall_time_us":2839513}]]}
W20260709 13:08:17.294431 21688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.015s
I20260709 13:08:17.319262 16326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 783) took 1239 ms. Trace:
W20260709 13:08:17.319939 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.288676 21785 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.347232 16327 raft_consensus.cc:1275] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:17.318315 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:17.354779 15646 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:08:17.358064 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.358862 15642 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:08:17.344734 21688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.003s	sys 0.016s
I20260709 13:08:17.378123 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:17.380014 21810 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.380538 21810 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:17.342355 21842 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.383500 21842 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:17.384261 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2750) took 1090 ms. Trace:
I20260709 13:08:17.384361 21842 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:17.384748 15787 rpcz_store.cc:276] 0709 13:08:16.293780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.294381 (+   601us) service_pool.cc:224] Handling call
0709 13:08:17.384027 (+1089646us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b5400421dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:17.384173 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120259968}
I20260709 13:08:17.386189 21786 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:17.386986 21786 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:17.387878 21800 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:17.380304 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:17.198858 21698 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.199494 21817 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.386822 21672 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:17.354391 21785 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.345713 16326 rpcz_store.cc:276] 0709 13:08:15.942752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.999169 (+ 56417us) service_pool.cc:224] Handling call
0709 13:08:16.019426 (+ 20257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.019672 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:08:16.212760 (+193088us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.931137 (+718377us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b1800434da0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a
0709 13:08:17.181201 (+250064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.181276 (+    75us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:17.181352 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.181449 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.181615 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4039,"prepare.queue_time_us":376176,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":151709,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16622,"spinlock_wait_cycles":34583296,"thread_start_us":581307,"threads_started":3,"wal-append.queue_time_us":251758}
I20260709 13:08:17.421399 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2749) took 1129 ms. Trace:
I20260709 13:08:17.388672 21786 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:17.428750 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48564us
I20260709 13:08:17.411602 21785 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.421934 15796 rpcz_store.cc:276] 0709 13:08:16.291760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.293401 (+  1641us) service_pool.cc:224] Handling call
0709 13:08:16.315270 (+ 21869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.321171 (+  5901us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:16.321201 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.327064 (+  5863us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.567701 (+240637us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:16.567747 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.567818 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.421160 (+853342us) raft_consensus.cc:1685] finished
0709 13:08:17.421182 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.421328 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6262,"raft.queue_time_us":142639,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3069,"thread_start_us":240235,"threads_started":1,"wal-append.queue_time_us":408136}
I20260709 13:08:17.393368 21833 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.433622 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:17.409724 21488 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.381562 21810 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.442298 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:17.426533 21698 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.444650 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:17.441016 21672 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.438534 21842 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.440457 21802 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:17.485661 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.498893 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.502238 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.502622 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.502938 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.437388 21677 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:08:17.450088 21676 raft_consensus.cc:2764] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:17.448242 21781 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.454402 21810 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.463449 21795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.012s	sys 0.016s
I20260709 13:08:17.430284 21702 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.525097 16331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 1013) took 1285 ms. Trace:
W20260709 13:08:17.546530 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.547008 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.547734 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.549829 21833 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.547039 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:17.550395 21732 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:17.550659 21659 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.551210 21659 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.515326 21768 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:17.553382 21659 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:17.555510 21853 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:08:17.526301 21850 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:17.542521 16331 rpcz_store.cc:276] 0709 13:08:16.239751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.258408 (+ 18657us) service_pool.cc:224] Handling call
0709 13:08:16.288135 (+ 29727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.287933 (+999798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.524805 (+236872us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54007805d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:17.525024 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290411264}
I20260709 13:08:17.550403 21833 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:17.534471 21851 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:17.559697 21833 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:17.507246 21842 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.559706 16328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56434 (request call id 785) took 1553 ms. Trace:
I20260709 13:08:17.546922 21817 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:17.560698 16328 rpcz_store.cc:276] 0709 13:08:16.006166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.006574 (+   408us) service_pool.cc:224] Handling call
0709 13:08:16.020442 (+ 13868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.033015 (+ 12573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.033063 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.069769 (+ 36706us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.138789 (+1069020us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003811c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:08:17.297529 (+158740us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:17.297590 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.298422 (+   832us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.559333 (+260911us) raft_consensus.cc:1685] finished
0709 13:08:17.559361 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.559616 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1220,"raft.queue_time_us":87,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":41491,"spinlock_wait_cycles":23119616,"thread_start_us":158498,"threads_started":1,"wal-append.queue_time_us":1350153}
I20260709 13:08:17.562388 21842 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:17.562525 21705 consensus_meta.cc:287] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.000s
W20260709 13:08:17.563144 21832 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.629s	user 0.002s	sys 0.002s
I20260709 13:08:17.563690 15640 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:17.564359 15642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2610) took 1276 ms. Trace:
I20260709 13:08:17.564713 15642 rpcz_store.cc:276] 0709 13:08:16.287971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.289446 (+  1475us) service_pool.cc:224] Handling call
0709 13:08:16.306831 (+ 17385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.366669 (+1059838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.564126 (+197457us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540019c154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:17.564305 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419958272}
I20260709 13:08:17.566156 21848 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.566787 21848 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.565629 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2744) took 1836 ms. Trace:
I20260709 13:08:17.568497 15640 rpcz_store.cc:276] 0709 13:08:15.729283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.729927 (+   644us) service_pool.cc:224] Handling call
0709 13:08:15.770242 (+ 40315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.564035 (+1793793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.565335 (+  1300us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400344c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:17.565560 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4123712256}
W20260709 13:08:17.514990 21795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.012s	sys 0.017s
I20260709 13:08:17.574946 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.575783 15721 raft_consensus.cc:2376] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15. Re-sending same reply.
I20260709 13:08:17.577080 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:17.571856 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.578506 15721 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.582509 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.565336 21757 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.587878 15713 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:17.588513 21757 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.589123 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.590327 15713 raft_consensus.cc:2393] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:17.590432 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.591321 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.592355 15713 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:17.584528 15720 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:17.586638 15716 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:17.584565 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.593279 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:17.593918 16328 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:17.597378 16334 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:17.597697 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:17.600337 15713 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:17.601574 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.603161 15787 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
W20260709 13:08:17.605413 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.576085 21817 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.573494 21800 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:17.605666 15720 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:17.607527 15715 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:17.608198 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.608953 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:17.609015 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.610674 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:17.603845 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.607280 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.629545 15794 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:08:17.619793 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:17.619793 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.620441 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:17.620733 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.630151 16334 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:17.628255 15715 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:08:17.630707 15795 raft_consensus.cc:2410] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:17.630875 15713 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:17.585156 21659 consensus_queue.cc:1059] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:08:17.621285 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.622907 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.623064 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:17.623318 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:17.637773 15716 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:17.624040 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.638863 15788 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:08:17.625818 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.639957 15719 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:17.640568 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:17.641121 15714 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:17.628243 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.614130 21686 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.644270 21686 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.625787 15721 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
W20260709 13:08:17.633559 21837 log.cc:927] Time spent T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.600s	user 0.005s	sys 0.000s
I20260709 13:08:17.650079 21659 raft_consensus.cc:3055] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:17.650532 21659 raft_consensus.cc:740] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:17.635418 21660 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:17.651387 21660 consensus_queue.cc:1243] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:17.651518 21659 consensus_queue.cc:260] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.652768 21659 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.624990 21800 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.660681 21800 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.618754 21817 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:17.663076 21846 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:08:17.663595 21817 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.665015 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2608) took 1377 ms. Trace:
I20260709 13:08:17.665429 15643 rpcz_store.cc:276] 0709 13:08:16.287442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.288896 (+  1454us) service_pool.cc:224] Handling call
0709 13:08:16.289167 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.135100 (+845933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.664780 (+529680us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54002dc154. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:17.664957 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936772992}
I20260709 13:08:17.666520 21734 consensus_queue.cc:1059] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:17.667328 21705 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:17.635412 21785 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.642683 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:17.666019 21820 log.cc:927] Time spent T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.731s	user 0.005s	sys 0.016s
I20260709 13:08:17.619437 16297 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:17.655521 16325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 1016) took 1382 ms. Trace:
I20260709 13:08:17.684700 16325 rpcz_store.cc:276] 0709 13:08:16.272922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.273075 (+   153us) service_pool.cc:224] Handling call
0709 13:08:17.075221 (+802146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.119169 (+ 43948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.655254 (+536085us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54004e2350. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:17.655447 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843950336}
W20260709 13:08:17.685119 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65787us
I20260709 13:08:17.687203 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:17.638362 21688 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:17.683241 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.690699 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:17.692456 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.692873 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.673648 15790 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:17.694336 15719 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:17.694911 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:17.702592 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.667706 21705 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:17.741822 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 52340us
W20260709 13:08:17.743005 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.749801 15722 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:17.754317 16330 pending_rounds.cc:85] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 10
I20260709 13:08:17.754803 16330 pending_rounds.cc:107] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:08:17.755137 16330 raft_consensus.cc:2889] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:17.757779 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 399826us
I20260709 13:08:17.684110 21682 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.760115 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.689265 21807 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.763293 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:17.772231 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.760298 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.773003 15714 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:17.764925 15795 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:17.763458 15722 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:17.759821 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.784345 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2607) took 1497 ms. Trace:
I20260709 13:08:17.720922 21660 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:17.703995 21688 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.804258 15714 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:17.798122 15647 rpcz_store.cc:276] 0709 13:08:16.287134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.287261 (+   127us) service_pool.cc:224] Handling call
0709 13:08:16.287641 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.288000 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.288028 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.288595 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:08:16.717265 (+428670us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:16.717904 (+   639us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.732024 (+ 14120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.732132 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.665389 (+933257us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:17.784033 (+118644us) raft_consensus.cc:1685] finished
0709 13:08:17.784134 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.784282 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13224,"prepare.queue_time_us":236,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":6087,"raft.queue_time_us":15958,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":12729,"spinlock_wait_cycles":39720320,"thread_start_us":428213,"threads_started":1,"wal-append.queue_time_us":645744}
I20260709 13:08:17.809381 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:17.792598 21852 log.cc:927] Time spent T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.274s	user 0.000s	sys 0.006s
I20260709 13:08:17.811021 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:17.816707 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.819288 15795 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
W20260709 13:08:17.776774 21359 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.002s
I20260709 13:08:17.760411 21638 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.789924 21807 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.822021 15713 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:17.831712 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:17.805420 21725 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:17.801888 21660 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:17.761336 21757 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:17.809242 21688 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:17.840768 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.853711 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:17.860829 15795 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:17.799405 21806 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:08:17.784524 21682 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.864522 15719 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:17.834098 21807 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.865677 15789 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:17.866313 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.876611 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:17.882743 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:17.859733 21660 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.824769 21788 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:17.862003 21711 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.833923 21638 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:17.840835 21849 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:17.938619 21734 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.938896 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.939263 21734 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.890390 21189 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:08:17.940699 21863 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:17.941061 21189 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:17.825882 21705 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:17.941706 21189 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:17.860126 21725 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:17.960126 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83577.3us
I20260709 13:08:17.961086 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:17.942847 21810 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.972090 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:17.976357 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.974056 21781 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:17.981695 21856 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:08:17.987597 21781 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.992864 21682 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:17.995206 21638 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:17.944653 21818 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:08:18.001456 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 202170us
W20260709 13:08:18.002209 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.002545 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 191237us
W20260709 13:08:17.974509 21805 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:17.946483 21786 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.026036 15719 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:18.026363 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.027382 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.029716 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.035472 15717 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:18.040025 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:18.035465 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.042526 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.031131 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.969460 21798 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.020784 21822 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.044880 15760 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.066556 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:18.066910 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.067301 15639 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:18.017534 21734 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.069814 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:17.996470 21711 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:18.071369 15795 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:18.072422 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.074688 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:18.076097 15610 connection.cc:256] RPC call timeout handler was delayed by -1.3927423330000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:08:18.076408 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.078872 15642 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 15: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:18.076159 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.049124 21698 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.037101 21634 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:08:18.097498 15793 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:18.098308 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.064985 21781 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.043656 21810 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:18.041222 21359 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:18.041502 21682 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:08:18.120385 21865 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:08:18.122570 21864 log.cc:927] Time spent T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:08:18.123306 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.042258 21786 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.084311 21638 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.073637 21710 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:18.102303 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.148164 15610 connection.cc:256] RPC call timeout handler was delayed by -1.26189070800001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:08:18.148722 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2537907079999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:08:18.149425 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2370423329999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:08:18.149945 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2370423329999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:08:18.150509 15610 connection.cc:256] RPC call timeout handler was delayed by -1.2119488240000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:08:18.150988 15610 connection.cc:256] RPC call timeout handler was delayed by -1.136790708000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 13:08:18.082459 21677 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:18.152199 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 76637.9us
I20260709 13:08:18.077299 21488 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:18.104151 21842 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:18.153620 15640 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.152004 21677 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.154379 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.072026 21798 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.164150 21798 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.164044 15760 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:18.103890 21698 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.076766 21189 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.159963 21355 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.168466 21677 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.184463 21786 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.160060 21488 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.187812 21488 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.157660 21710 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.189205 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:18.189895 15788 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.190584 21725 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.156478 21638 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.192269 21189 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.193025 21638 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.193936 15793 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:18.196333 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.158887 21781 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:18.179778 21355 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.169118 21842 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.158380 21660 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.197721 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.204847 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.224356 15793 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:18.206451 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:18.213825 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 316996us
I20260709 13:08:18.220672 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:18.229063 15788 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:18.178066 21711 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.198374 21710 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.237217 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:08:18.213660 21659 consensus_meta.cc:287] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
W20260709 13:08:18.242890 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.239073 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.277539 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:18.277709 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.282516 15788 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 12.
I20260709 13:08:18.285895 15720 raft_consensus.cc:2410] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:18.299006 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.301249 15793 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:18.302147 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.200297 21355 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.233170 21871 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.214695 21817 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:18.212263 21686 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.216361 21786 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.187817 21698 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.212477 21842 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.313292 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.235117 21711 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.274917 21884 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.281847 21812 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.217156 21882 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:18.323400 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.220556 21638 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:08:18.205819 21807 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.300164 21816 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:18.327198 15787 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:18.329772 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.310369 21886 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:18.331040 15787 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 14 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
W20260709 13:08:18.327162 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 112666us
I20260709 13:08:18.310685 21871 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.330861 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.275595 21690 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.333410 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:18.333592 15788 raft_consensus.cc:2410] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:08:18.327576 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 90516.4us
I20260709 13:08:18.322005 21711 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.320663 21885 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:18.335148 21871 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.332406 21816 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:18.319038 21817 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.333357 21886 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:18.321960 21786 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.333979 21882 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:18.342090 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:18.328327 21884 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.339365 21822 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.339087 21688 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.381690 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.383105 21688 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.340471 21885 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.383828 21677 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.385684 21885 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.355767 21791 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:18.386592 21791 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:18.387301 21807 leader_election.cc:290] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.388471 21660 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:18.361963 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.370411 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.329238 21812 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.373445 15713 raft_consensus.cc:1240] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:18.341455 21810 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:18.378937 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.395040 15715 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:18.398527 21812 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.398833 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:18.411180 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:18.411669 15796 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.412060 16331 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.400699 21677 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.341499 21488 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:18.422240 21488 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:18.338581 21690 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:18.423208 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.424484 21690 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.401670 15722 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
I20260709 13:08:18.426033 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:18.427161 21873 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.427661 21873 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.428040 21873 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.410305 15788 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:18.416551 21359 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:18.416947 21892 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:18.417603 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:18.415848 21882 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.419912 21786 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.430692 16333 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:18.415781 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 73746.3us
I20260709 13:08:18.430137 21892 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.439086 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:18.433238 21702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.009s	sys 0.024s
W20260709 13:08:18.443470 21702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.009s	sys 0.024s
I20260709 13:08:18.463762 16331 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:18.465193 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.465770 16333 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:18.466100 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:18.467119 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:18.467864 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.439572 21812 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.479009 15796 raft_consensus.cc:2468] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
W20260709 13:08:18.479764 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.441869 21892 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.481820 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.448243 21885 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.489800 21634 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.490451 21634 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.490972 21884 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.492965 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.494892 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.495569 15638 raft_consensus.cc:2376] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14. Re-sending same reply.
I20260709 13:08:18.496387 21871 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.497629 21634 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.481230 21659 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.453720 21886 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.498304 21659 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:18.498760 21659 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.389798 21816 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.433666 21355 consensus_queue.cc:1059] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:08:18.479794 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.500499 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.500377 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.502547 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.483011 15643 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:18.508251 15639 raft_consensus.cc:2368] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16.
I20260709 13:08:18.508955 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.508316 15722 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:18.510313 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.506857 15713 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:18.511394 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:18.511560 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.505426 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.512199 15643 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:18.512247 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.512580 15638 raft_consensus.cc:2376] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18. Re-sending same reply.
I20260709 13:08:18.509070 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.510830 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.515383 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.516286 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.518268 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.481096 21660 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:18.517685 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.516882 15722 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:18.530951 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.531306 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:18.532045 15722 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.519284 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.533027 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:18.520442 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.524550 21873 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.517949 21893 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.525947 21731 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:18.518731 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.526947 21830 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:18.528613 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.554807 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.528733 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.479398 21790 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.536871 21893 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:18.566983 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:18.551241 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.556138 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:18.560670 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.560878 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:18.569228 15688 leader_election.cc:336] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.661s (SENT)
I20260709 13:08:18.569726 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:18.529572 21884 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:18.580256 15722 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
W20260709 13:08:18.582959 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64269.4us
I20260709 13:08:18.583861 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.536139 21634 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:18.586529 15639 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:18.586694 15638 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:18.587764 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:18.484546 21812 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.588837 15639 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:18.590137 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:18.591286 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.591846 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.550659 21660 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:18.594568 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.554967 21830 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:18.599139 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:18.607607 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46826.5us
I20260709 13:08:18.608716 15610 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:18.596179 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.570848 21893 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.571118 21355 raft_consensus.cc:2764] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:08:18.585758 21884 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:18.613637 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.590463 21757 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.616878 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:18.591056 21816 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.591787 21882 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.588392 21634 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.617549 15713 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:18.593191 21790 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.589781 21786 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:18.607168 21788 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.628433 15721 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:18.606231 21677 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.617357 21682 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.638804 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:18.621862 21806 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:18.629974 21888 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.623154 21757 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.612440 21711 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.660218 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.633595 21634 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.634137 21790 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:18.661657 21897 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:18.716116 21710 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:18.684928 21810 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:18.716665 21710 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.717119 21710 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.722326 21848 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.723517 21873 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:18.725917 15793 raft_consensus.cc:2393] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:18.726976 21711 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.728056 21710 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.729839 21892 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.732036 21892 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.732888 15641 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:18.736232 21887 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:18.661486 21686 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.663550 21871 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:18.741907 15688 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.823s (SENT)
I20260709 13:08:18.742444 15688 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:18.655354 21677 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.743880 15795 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:18.744168 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:18.745422 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:18.750706 21833 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:18.751683 21901 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:08:18.752113 21677 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.661154 21910 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:18.753356 21910 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:18.754240 21812 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:18.754627 21910 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.756481 21638 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:18.756896 21638 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:18.700574 21660 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.761504 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:18.762338 15721 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.765853 16330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56432 (request call id 1026) took 1012 ms. Trace:
W20260709 13:08:18.766332 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 149531us
I20260709 13:08:18.766224 16330 rpcz_store.cc:276] 0709 13:08:17.753596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.753775 (+   179us) service_pool.cc:224] Handling call
0709 13:08:17.754114 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:17.755998 (+  1884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.756048 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:17.762273 (+  6225us) log.cc:844] Serialized 52 byte log entry
0709 13:08:18.018876 (+256603us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:18.048170 (+ 29294us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.048381 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.048460 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.729490 (+681030us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800313180. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:18.752533 (+ 23043us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b1800313180. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:18.765625 (+ 13092us) raft_consensus.cc:1685] finished
0709 13:08:18.765645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.765800 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29063,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1836,"raft.queue_time_us":1834,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":25644,"spinlock_wait_cycles":53636096,"thread_start_us":200733,"threads_started":1,"wal-append.queue_time_us":271687}
I20260709 13:08:18.662170 21788 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:18.774570 15688 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.864s (SENT)
I20260709 13:08:18.681504 21757 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.655174 21842 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:08:18.687031 21790 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:18.789989 21898 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:08:18.637676 21786 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.792053 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.793211 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:18.793919 21786 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.794486 21788 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.796904 21782 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.770926 21884 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.757668 21638 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.803706 21638 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.804003 16297 leader_election.cc:304] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:18.805972 21690 raft_consensus.cc:2804] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:18.636822 21882 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.788287 15721 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:18.809875 15787 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:18.821540 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.806344 21355 consensus_queue.cc:1175] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" responder_term: 18 status { last_received { term: 18 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 18 index: 15 } }
I20260709 13:08:18.828231 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.831347 15721 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:18.810186 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:18.830241 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.828420 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.831911 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.834815 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:18.667593 21830 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:18.838508 21830 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.842133 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:18.842816 21900 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:08:18.842993 15639 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:18.844044 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:18.806552 21690 raft_consensus.cc:697] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:18.850555 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.851329 15644 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.858811 21882 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:18.861107 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.861657 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.787268 21682 consensus_queue.cc:1048] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:08:18.868548 15791 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:18.874420 15791 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.848758 21785 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:18.900164 15641 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:18.900758 15641 pending_rounds.cc:85] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 10
I20260709 13:08:18.901037 15641 pending_rounds.cc:107] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:18.901331 15641 raft_consensus.cc:2889] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.873989 21731 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:18.893266 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 156869us
I20260709 13:08:18.928233 15792 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:18.932855 21911 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.909698 21731 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:18.941156 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:18.930778 21898 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:08:18.957062 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.959547 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:18.917938 21769 consensus_queue.cc:1059] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:08:18.969655 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 121795us
W20260709 13:08:18.983287 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.996169 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 180170us
I20260709 13:08:19.000569 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:19.007513 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 415647us
I20260709 13:08:19.017892 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:19.023473 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:19.024627 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:19.031217 15644 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:19.016058 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:19.035811 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.036041 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.000813 21886 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:19.014086 21659 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.007s
I20260709 13:08:19.042665 15713 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:18.954058 21690 consensus_queue.cc:237] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.045056 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.041034 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 975) took 1276 ms. Trace:
I20260709 13:08:19.045848 15638 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 9.
I20260709 13:08:19.044268 15642 raft_consensus.cc:2410] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:08:19.046325 15787 rpcz_store.cc:276] 0709 13:08:17.764431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.336542 (+572111us) service_pool.cc:224] Handling call
0709 13:08:18.809538 (+472996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.810536 (+   998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.040828 (+230292us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540047ccd0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.040973 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071006080}
I20260709 13:08:19.014452 21839 raft_consensus.cc:3055] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:19.048255 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:19.051923 21659 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.061393 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.073020 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.060576 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:19.063557 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.055068 15686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.082780 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.083839 15794 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:19.078931 15642 raft_consensus.cc:2376] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13. Re-sending same reply.
W20260709 13:08:19.088768 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 150471us
I20260709 13:08:19.085361 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.045706 21785 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:19.090694 15794 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
W20260709 13:08:19.061175 21913 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:08:19.101110 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.074995 21911 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:19.070788 21817 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.102950 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.054024 21839 raft_consensus.cc:740] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:19.106010 16330 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:19.054733 21914 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.049713 21915 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:19.103071 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.060082 21688 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:19.108325 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 123684us
I20260709 13:08:19.104876 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.134197 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:19.098839 21785 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:19.150864 21912 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:08:19.177856 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.149765 21785 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.182502 15787 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:19.145958 21634 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.145602 21659 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.101363 21790 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:19.156356 15610 connection.cc:256] RPC call timeout handler was delayed by -1.6680029960000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 13:08:19.201357 15610 leader_election.cc:336] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.514s (SENT)
I20260709 13:08:19.171669 21817 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:19.202039 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:19.219669 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 147300us
W20260709 13:08:19.223136 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.223644 15643 raft_consensus.cc:2368] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19.
I20260709 13:08:19.149379 21914 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.228241 16330 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:19.228578 16331 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:19.230033 15789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 3051) took 1621 ms (client timeout 1514 ms). Trace:
I20260709 13:08:19.230345 15793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2758) took 1116 ms. Trace:
I20260709 13:08:19.230861 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:19.240091 15789 rpcz_store.cc:269] 0709 13:08:17.608375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.608497 (+   122us) service_pool.cc:224] Handling call
0709 13:08:19.229840 (+1621343us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540047b3d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.229955 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524715264}
I20260709 13:08:19.231127 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:19.233373 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.240577 15793 rpcz_store.cc:276] 0709 13:08:18.113640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.728002 (+614362us) service_pool.cc:224] Handling call
0709 13:08:18.728366 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.728769 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.728795 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.729246 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.855608 (+126362us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:18.855664 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.855754 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.230150 (+374396us) raft_consensus.cc:1685] finished
0709 13:08:19.230170 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.230290 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3731,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"thread_start_us":123244,"threads_started":1,"wal-append.queue_time_us":210946}
I20260709 13:08:19.234287 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:19.234385 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.244861 15787 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 12.
W20260709 13:08:19.235325 15610 leader_election.cc:336] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.534s (SENT)
W20260709 13:08:19.247198 15610 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.605s (SENT)
W20260709 13:08:19.248708 15610 leader_election.cc:336] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 1.642s (SENT)
I20260709 13:08:19.249333 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:19.238121 21638 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.250711 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:19.252986 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:19.237066 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:19.232051 21919 log.cc:927] Time spent T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:08:19.262254 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.263475 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.263576 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.264530 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.258944 16332 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:19.265424 15640 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:19.267089 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.269286 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.270421 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.270924 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.272038 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:19.272163 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.273132 15638 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:19.276062 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.277222 15642 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:19.277849 15790 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:19.280786 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.281919 15640 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:19.203359 21911 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.284911 15646 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:19.289381 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.261555 21935 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:19.292472 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.298596 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.299847 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.205374 21839 consensus_queue.cc:260] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.301677 15789 raft_consensus.cc:2376] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 13. Re-sending same reply.
W20260709 13:08:19.302079 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.281144 21798 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.307459 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.308291 15789 raft_consensus.cc:2368] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:19.312398 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:19.312965 21918 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:19.313159 15789 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:19.313673 21918 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.314517 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:19.315135 15789 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:19.322685 21920 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:08:19.323213 21790 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.324129 21790 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:19.325913 21934 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:19.330176 21634 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:19.330423 21924 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:08:19.331831 21922 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:08:19.333026 21798 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.307822 21740 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:19.334416 21757 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.006s
I20260709 13:08:19.334290 21740 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.334932 21757 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.336195 15719 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:19.336956 21740 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.339017 21790 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:19.339826 21830 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.008s
I20260709 13:08:19.339840 21790 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.363653 15638 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:19.295272 21769 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:19.341141 21893 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.003s
I20260709 13:08:19.337611 21740 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:19.365013 21757 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.387109 15789 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:19.389663 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:19.390882 15789 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.370522 21918 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:19.401274 15720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47700 (request call id 3505) took 1629 ms (client timeout 1721 ms). Trace:
W20260709 13:08:19.401798 15720 rpcz_store.cc:269] 0709 13:08:17.771522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.772006 (+   484us) service_pool.cc:224] Handling call
0709 13:08:19.401034 (+1629028us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54003863d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.401206 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178884480}
I20260709 13:08:19.385747 21740 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:19.371662 21893 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.410429 15789 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:19.387804 21710 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:19.421648 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.497932 15796 raft_consensus.cc:2410] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:19.412096 21918 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.508623 21918 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.398396 21757 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:19.510079 21757 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.512013 21918 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:19.512349 21757 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:19.413407 21740 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.514628 21705 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.515605 21893 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.518070 21914 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:19.519958 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.519709 21791 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:19.520390 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.521832 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.524711 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.540937 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:19.541864 15720 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:19.543902 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.549849 15721 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:19.394737 21785 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.556843 15714 raft_consensus.cc:1240] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:19.506937 21734 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:19.565239 21740 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.391707 21938 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
W20260709 13:08:19.572821 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.574168 21937 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:19.585938 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 976) took 1568 ms. Trace:
I20260709 13:08:19.586520 15788 rpcz_store.cc:276] 0709 13:08:18.017949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.338684 (+320735us) service_pool.cc:224] Handling call
0709 13:08:18.344192 (+  5508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.429940 (+ 85748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.585618 (+1155678us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b540047a9d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:19.585851 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150801792}
I20260709 13:08:19.559022 21791 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:19.593555 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.593449 21937 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:19.595692 21937 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:19.596132 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2757) took 1482 ms. Trace:
I20260709 13:08:19.598270 21930 consensus_queue.cc:1059] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:08:19.599754 21930 raft_consensus.cc:3055] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:19.600205 21930 raft_consensus.cc:740] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:19.596652 15795 rpcz_store.cc:276] 0709 13:08:18.113484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.635915 (+522431us) service_pool.cc:224] Handling call
0709 13:08:18.636209 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.744203 (+107994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.595814 (+851611us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400219dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:19.596058 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246672640}
I20260709 13:08:19.572921 21734 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:19.610667 21734 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.611495 21740 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:19.613150 21790 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:19.617650 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.618539 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.625674 21888 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.943s	user 0.012s	sys 0.000s
I20260709 13:08:19.626391 21888 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.627560 15641 raft_consensus.cc:2410] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:08:19.628666 21638 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:19.630127 15790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56124 (request call id 3060) took 2012 ms (client timeout 1780 ms). Trace:
W20260709 13:08:19.630662 15790 rpcz_store.cc:269] 0709 13:08:17.617503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.772959 (+155456us) service_pool.cc:224] Handling call
0709 13:08:19.629869 (+1856910us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001f9ad4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.630023 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3375127936}
I20260709 13:08:19.631177 21785 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:19.638675 21930 consensus_queue.cc:260] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.640493 21930 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.596887 21937 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.645895 21937 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.612278 21734 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:19.655190 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.655845 21683 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:19.656421 21683 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.657316 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 2773) took 1187 ms. Trace:
I20260709 13:08:19.657716 15796 rpcz_store.cc:276] 0709 13:08:18.469930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.518162 (+ 48232us) service_pool.cc:224] Handling call
0709 13:08:19.657116 (+1138954us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400152554. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.657260 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137621888}
I20260709 13:08:19.658526 21683 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:19.663764 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.669597 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.706146 15644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.012s	sys 0.069s
W20260709 13:08:19.708326 15644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.012s	sys 0.069s
W20260709 13:08:19.710057 15685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.113s (SENT) [suppressed 35 similar messages]
W20260709 13:08:19.716179 15686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.015s	sys 0.055s
W20260709 13:08:19.716741 15686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.015s	sys 0.056s
I20260709 13:08:19.710383 15645 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:19.736904 15720 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:19.728291 21927 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.744550 21806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.055s	sys 0.074s
W20260709 13:08:19.747710 21688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.001s	sys 0.034s
W20260709 13:08:19.760470 16333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.020s	sys 0.013s
W20260709 13:08:19.784029 16333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.020s	sys 0.013s
W20260709 13:08:19.755963 21682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.017s
W20260709 13:08:19.783246 21806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.057s	sys 0.075s
W20260709 13:08:19.783954 21688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.001s	sys 0.034s
W20260709 13:08:19.786000 21682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.013s	sys 0.017s
W20260709 13:08:19.800920 16300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.013s
W20260709 13:08:19.803422 16300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.013s
I20260709 13:08:19.786288 21927 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:19.789361 21816 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.028s	sys 0.046s
W20260709 13:08:19.814116 21816 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.028s	sys 0.046s
I20260709 13:08:19.789812 21688 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:19.814687 21944 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:08:19.809124 21873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.012s	sys 0.006s
W20260709 13:08:19.824713 21731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.016s
W20260709 13:08:19.823948 21659 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.035s	sys 0.036s
W20260709 13:08:19.832906 21731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.003s	sys 0.016s
W20260709 13:08:19.830780 21873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.012s	sys 0.006s
W20260709 13:08:19.845990 21939 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:08:19.888536 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.890022 15642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.015s	sys 0.027s
W20260709 13:08:19.890093 15610 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.002s	sys 0.007s
W20260709 13:08:19.890653 15642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.015s	sys 0.027s
W20260709 13:08:19.890805 15610 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.002s	sys 0.007s
W20260709 13:08:19.891626 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 623141us
I20260709 13:08:19.894418 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 771) took 1028 ms. Trace:
W20260709 13:08:19.896341 15610 leader_election.cc:336] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.088s (SENT)
I20260709 13:08:19.895043 15647 rpcz_store.cc:276] 0709 13:08:18.865897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.866050 (+   153us) service_pool.cc:224] Handling call
0709 13:08:18.897399 (+ 31349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.034716 (+137317us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:19.034858 (+   142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.095114 (+ 60256us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.304766 (+209652us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:19.304807 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.304878 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.893833 (+588955us) raft_consensus.cc:1685] finished
0709 13:08:19.893871 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.894209 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29438,"raft.queue_time_us":200356,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6522,"thread_start_us":321254,"threads_started":2,"wal-append.queue_time_us":610511}
I20260709 13:08:19.897078 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:19.888710 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.904116 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3514) took 1684 ms. Trace:
I20260709 13:08:19.904735 15715 raft_consensus.cc:1217] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 13.5->[14.6-16.7]   Dedup: 16.7->[]
I20260709 13:08:19.905665 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2753) took 1403 ms. Trace:
I20260709 13:08:19.906056 15715 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: [14.6-16.7]
I20260709 13:08:19.906109 15645 rpcz_store.cc:276] 0709 13:08:18.501494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.501621 (+   127us) service_pool.cc:224] Handling call
0709 13:08:19.905111 (+1403490us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000e74d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.905331 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699673344}
I20260709 13:08:19.904706 15718 rpcz_store.cc:276] 0709 13:08:18.219486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.219614 (+   128us) service_pool.cc:224] Handling call
0709 13:08:18.236645 (+ 17031us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:18.237188 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.237241 (+    53us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:18.279383 (+ 42142us) log.cc:844] Serialized 78 byte log entry
0709 13:08:19.572077 (+1292694us) spinlock_profiling.cc:243] Waited 892 us on lock 0x7b180025a140. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:08:19.902196 (+330119us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:19.902853 (+   657us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.903245 (+   392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.903363 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.903421 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:19.903539 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.903797 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38747,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":17930,"spinlock_wait_cycles":2052352,"thread_start_us":329608,"threads_started":1,"wal-append.queue_time_us":1538810}
I20260709 13:08:19.909689 15643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42122 (request call id 2755) took 1407 ms. Trace:
I20260709 13:08:19.910125 15643 rpcz_store.cc:276] 0709 13:08:18.502411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.520147 (+ 17736us) service_pool.cc:224] Handling call
0709 13:08:19.909264 (+1389117us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540028a854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:19.909521 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585019776}
I20260709 13:08:19.920185 15611 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:19.922591 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 687164us
W20260709 13:08:19.925153 15610 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.099s (SENT)
W20260709 13:08:19.927189 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.928160 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2772) took 1458 ms. Trace:
W20260709 13:08:19.928390 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.930177 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.931916 15792 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:18.868088 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.946341 15791 rpcz_store.cc:276] 0709 13:08:18.469576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.918428 (+448852us) service_pool.cc:224] Handling call
0709 13:08:18.918783 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.919038 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:18.943497 (+ 24459us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.207243 (+263746us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.921603 (+714360us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b1800484420. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad253fe060 00007fad25410716 00007fad25421287 00007fad25421208
0709 13:08:19.927222 (+  5619us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.927334 (+   112us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.927436 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.927592 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.927828 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11914,"prepare.queue_time_us":39040,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":3239,"raft.queue_time_us":12748,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6109,"spinlock_wait_cycles":25999488,"thread_start_us":262132,"threads_started":1,"wal-append.queue_time_us":816248}
W20260709 13:08:19.954841 21659 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.036s	sys 0.036s
I20260709 13:08:19.958622 21688 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:19.963982 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.968845 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:19.969925 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 707884us
I20260709 13:08:19.979373 15643 raft_consensus.cc:1217] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Deduplicated request from leader. Original: 14.6->[16.7-16.7]   Dedup: 16.7->[]
I20260709 13:08:19.980348 15643 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 13:08:19.980564 21806 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:19.982391 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:19.983843 21724 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:19.984704 21724 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:19.986343 21710 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:19.987090 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:19.987504 21710 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:19.988369 21672 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.990324 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.990175 21931 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:19.997443 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.998924 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.989207 21672 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:20.007565 15688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.004s	sys 0.016s
I20260709 13:08:20.010725 21732 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:20.014829 21816 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:20.016264 21816 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.020725 21946 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:20.022104 21946 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.015139 21711 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:20.026674 21711 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.027655 21935 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:20.030833 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 76856.8us
I20260709 13:08:20.031770 21732 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:20.033540 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62371.1us
I20260709 13:08:20.033645 21732 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:20.048635 15688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.005s	sys 0.016s
I20260709 13:08:20.037705 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:20.075660 16298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.076813 21886 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.078334 21710 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.079077 21710 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:20.079936 21710 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.079936 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 3064) took 1006 ms. Trace:
I20260709 13:08:20.084080 15792 rpcz_store.cc:276] 0709 13:08:19.073361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.073552 (+   191us) service_pool.cc:224] Handling call
0709 13:08:19.073902 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.952122 (+878220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.079525 (+127403us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540047c2d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:20.079857 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970010880}
I20260709 13:08:20.051406 21946 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.092558 21711 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.092849 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.093225 21439 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.099737 21839 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.077694 21886 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.107074 21894 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:20.108750 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.091360 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 802897us
W20260709 13:08:20.129992 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.039203 21687 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:08:20.040839 21947 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
W20260709 13:08:20.143050 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 218031us
W20260709 13:08:20.144610 15610 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.158s (SENT)
I20260709 13:08:20.145078 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:20.147046 21884 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.148227 21724 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:20.150167 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.150501 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.151322 21927 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:20.152261 15610 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Timed out: RequestConsensusVote RPC to 127.14.45.3:35499 timed out after 2.178s (SENT)
I20260709 13:08:20.136909 21439 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.124070 21711 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.159312 16333 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:20.151316 21899 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.178756 21439 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.183931 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:20.208107 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.209105 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.195544 21710 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:20.211081 21925 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.982s	user 0.008s	sys 0.007s
I20260709 13:08:20.213900 21932 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:20.214506 21734 consensus_meta.cc:287] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.013s
I20260709 13:08:20.214358 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:20.215790 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.216586 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 179256us
I20260709 13:08:20.217600 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:20.215288 21711 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.218866 21683 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:20.219313 21683 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:20.219686 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.220384 21711 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.221117 21711 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.219755 21683 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.217402 15762 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.184227 21672 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:20.243532 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.247433 21960 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.248488 21798 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.248626 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.249709 16332 raft_consensus.cc:2393] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:20.250124 21816 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.239698 21882 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:20.250672 21731 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:20.250777 21439 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:20.251331 21731 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:20.251380 21882 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.251648 21439 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:20.255441 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.249858 21702 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.264201 21439 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.270741 21873 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:20.271562 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 121334us
I20260709 13:08:20.271840 21873 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.274360 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.275566 16332 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 13: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
W20260709 13:08:20.277987 21930 consensus_meta.cc:287] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.637s	user 0.002s	sys 0.023s
W20260709 13:08:20.270790 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53631.7us
I20260709 13:08:20.221700 21711 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.284723 15762 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.287249 21711 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:20.288422 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.289390 15716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3515) took 1921 ms. Trace:
I20260709 13:08:20.292016 21948 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.300523 21882 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.302817 21873 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.304935 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:20.305619 21439 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.252628 21731 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.305789 21672 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:20.308194 15544 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 151) took 43353 ms (client timeout 15000 ms). Trace:
I20260709 13:08:20.273406 15688 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:20.297587 21937 consensus_meta.cc:287] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.010s
I20260709 13:08:20.313678 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:20.343575 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.329095 21734 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.325258 15716 rpcz_store.cc:276] 0709 13:08:18.368110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.370617 (+  2507us) service_pool.cc:224] Handling call
0709 13:08:18.381554 (+ 10937us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:18.410485 (+ 28931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.410515 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:18.416930 (+  6415us) log.cc:844] Serialized 78 byte log entry
0709 13:08:18.846385 (+429455us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b180012bbc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa60d1 00007fad253c1a0f
0709 13:08:18.969724 (+123339us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:18.992944 (+ 23220us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.000443 (+  7499us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.000813 (+   370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.400946 (+400133us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b180012bbc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:19.636605 (+235659us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b180012bbc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222e72a6 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419
0709 13:08:19.637552 (+   947us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54001a77d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:19.637619 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.644302 (+  6683us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b180012bbc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22319522 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:20.033815 (+389513us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b180012bbc0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:20.108273 (+ 74458us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:20.288773 (+180500us) raft_consensus.cc:1685] finished
0709 13:08:20.288805 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.289146 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18834,"prepare.queue_time_us":1069060,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":15860,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":18764,"spinlock_wait_cycles":144784640,"thread_start_us":123067,"threads_started":1,"wal-append.queue_time_us":787500}
I20260709 13:08:20.354394 21882 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:20.347688 21816 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.352461 21731 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:20.358266 21882 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.362413 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.365852 21734 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.366906 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:20.370617 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.371304 15762 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.375689 21886 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.383059 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.381021 21882 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:20.418850 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.307993 15539 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.422914 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.422490 15539 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 3 to 9, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 9 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:20.435734 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 162714us
I20260709 13:08:20.396649 21886 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:20.378831 21948 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:20.451251 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 84496.5us
W20260709 13:08:20.455545 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70449.5us
I20260709 13:08:20.457450 21660 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:20.465592 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:20.468796 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 161770us
I20260709 13:08:20.471398 15539 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 8 to 11, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 11 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.472950 21937 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:20.475610 21886 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.475867 21439 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.462280 21660 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.476759 21886 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.483378 21660 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.483940 21710 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.508791 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.508661 21710 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.511288 21710 leader_election.cc:290] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:20.331676 15544 rpcz_store.cc:269] 0709 13:07:36.959676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.967702 (+  8026us) service_pool.cc:224] Handling call
0709 13:08:20.307883 (+43340181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.459178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.486484 (+ 27306us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.486534 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:08:16.486572 (+    38us) tablet.cc:662] Decoding operations
0709 13:08:16.605751 (+119179us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.645213 (+ 39462us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.666691 (+ 21478us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:16.929589 (+262898us) tablet.cc:701] Row locks acquired
0709 13:08:16.929638 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:08:16.929888 (+   250us) write_op.cc:270] Start()
0709 13:08:16.930122 (+   234us) write_op.cc:276] Timestamp: P: 1783602496929792 usec, L: 0
0709 13:08:16.930167 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.931035 (+   868us) log.cc:844] Serialized 1662 byte log entry
0709 13:08:17.338578 (+407543us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad222fc0ac 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b
0709 13:08:18.165911 (+827333us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.416369 (+250458us) write_op.cc:301] APPLY: starting
0709 13:08:18.416476 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.420129 (+  3653us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.420173 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.523123 (+102950us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.523378 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:18.523439 (+    61us) write_op.cc:312] APPLY: finished
0709 13:08:18.523760 (+   321us) log.cc:844] Serialized 49 byte log entry
0709 13:08:18.523945 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.524045 (+   100us) write_op.cc:454] Released schema lock
0709 13:08:18.524105 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.524595 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.524628 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3791652,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":208207,"apply.run_cpu_time_us":9224,"apply.run_wall_time_us":108185,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"num_ops":4,"prepare.queue_time_us":296904,"prepare.run_cpu_time_us":33824,"prepare.run_wall_time_us":1195517,"raft.queue_time_us":110379,"raft.run_cpu_time_us":45304,"raft.run_wall_time_us":229023,"replication_time_us":1188017,"spinlock_wait_cycles":60377856,"thread_start_us":968338,"threads_started":4,"wal-append.queue_time_us":692526,"wal-append.run_cpu_time_us":11956,"wal-append.run_wall_time_us":1910970}]]}
I20260709 13:08:20.515527 21927 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.516396 21927 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.519834 21683 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.522451 21849 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.523512 21849 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:20.525529 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 121875us
I20260709 13:08:20.526484 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.530313 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.533007 21948 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:20.533215 21968 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.002s
I20260709 13:08:20.493548 21798 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.536798 21927 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.538091 21710 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:20.504534 21439 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.539852 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:20.540381 21734 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.541334 21439 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.541872 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.545583 21930 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.544584 21439 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:20.546227 21930 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.547016 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.547626 21439 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.548834 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:20.550132 21871 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:20.550369 21711 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:20.539906 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 74702.7us
I20260709 13:08:20.555262 21802 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.555902 21802 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.550665 21732 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:20.558328 21802 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.550899 21672 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:20.542979 21710 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.543222 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:20.558929 21802 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:20.542297 21886 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.551170 21798 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:20.550181 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.550956 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:20.564720 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.568353 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:20.570950 15715 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:20.575225 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:20.564049 21970 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.006s
I20260709 13:08:20.573976 21798 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:20.579257 21886 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.604014 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:20.598024 21930 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.603554 21705 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.608714 15716 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:20.559252 15539 catalog_manager.cc:5697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 7 to 11, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 11 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.613008 15688 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:20.619882 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 69035.4us
I20260709 13:08:20.622771 21798 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.626783 16325 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:08:20.631022 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 230776us
I20260709 13:08:20.633844 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:20.630676 21969 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
W20260709 13:08:20.640446 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 97414.2us
I20260709 13:08:20.642585 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:20.642859 15715 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:20.649801 21945 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 13:08:20.654225 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54917.9us
I20260709 13:08:20.635325 21947 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:20.641010 21966 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:08:20.658684 15718 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:20.663455 21687 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.666812 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118091us
I20260709 13:08:20.670528 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:20.664165 21687 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.636768 21802 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:08:20.675041 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:20.660423 21849 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.673885 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.676285 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.676222 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:20.668407 21683 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.686383 21816 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.687388 21705 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:20.687889 21705 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.688254 21705 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.696115 16332 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:20.676772 21932 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.662919 21882 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.700325 16326 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
W20260709 13:08:20.703095 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.683693 21732 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:20.703687 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:20.710364 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77556.2us
W20260709 13:08:20.711971 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.716333 16325 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:20.705996 21439 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:20.722815 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44068.1us
I20260709 13:08:20.711977 21732 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.702399 21937 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:08:20.728762 21932 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.715222 21873 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:20.695199 21710 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:08:20.727707 21732 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.739130 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:20.745272 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.735122 21873 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.734941 21882 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.695241 15539 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:20.757390 21687 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.756506 15539 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:20.752259 21873 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.759891 21932 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.746744 21731 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:08:20.761933 21660 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.764367 15539 catalog_manager.cc:5697] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 6 to 9, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:08:20.775665 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.783113 16328 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:20.780313 21839 consensus_meta.cc:287] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.002s
I20260709 13:08:20.775363 21710 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:20.794214 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 51799.6us
W20260709 13:08:20.794214 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66307.5us
I20260709 13:08:20.775652 21930 raft_consensus.cc:2764] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:08:20.800961 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65270.3us
I20260709 13:08:20.801397 16327 raft_consensus.cc:2410] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:20.801600 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:20.804569 16325 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.824047 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:20.828635 21439 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.829274 21439 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.831399 21439 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:20.832165 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.833081 15792 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:08:20.825773 16327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56442 (request call id 1214) took 1589 ms (client timeout 1906 ms). Trace:
I20260709 13:08:20.816706 21932 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.841236 15759 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:20.841851 16327 rpcz_store.cc:269] 0709 13:08:19.232927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.233087 (+   160us) service_pool.cc:224] Handling call
0709 13:08:20.809783 (+1576696us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002440d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:20.822129 (+ 12346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3576027392}
I20260709 13:08:20.852172 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.856730 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:20.857438 15794 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.860765 21705 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.862639 15793 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:20.863072 21705 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.864809 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:20.869912 16300 leader_election.cc:336] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.689s (SENT)
I20260709 13:08:20.870452 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:20.871873 16300 leader_election.cc:336] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.704s (SENT)
I20260709 13:08:20.872287 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:20.873056 21687 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.873683 21839 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.874763 15792 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:20.845835 21937 raft_consensus.cc:2764] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:20.881865 15794 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:20.820380 21886 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:08:20.890334 15759 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:20.849232 21439 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:20.847728 21660 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.899483 21726 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:20.899590 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:20.899943 21798 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:20.900295 15792 raft_consensus.cc:3060] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.900234 21726 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.901217 21798 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:20.901952 21710 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:20.902420 21710 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.895360 21439 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.901583 21798 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:20.903954 21710 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.908336 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.913702 15791 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:08:20.915875 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 94930.1us
I20260709 13:08:20.854296 21932 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.909968 21439 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.924197 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:20.925875 21937 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.926456 21937 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.928647 21937 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:20.929352 15792 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:20.934356 15795 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:20.934211 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:20.935721 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:20.939386 15796 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:20.952015 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.952754 15787 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:20.953896 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.955513 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.956295 15795 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:20.957410 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.959681 15796 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:20.960453 21798 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.961931 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:20.964195 21937 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:20.965242 21937 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:20.962193 21798 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:20.959856 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.907714 21873 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:20.971962 21873 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.974534 21726 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:20.975241 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:20.977279 15788 raft_consensus.cc:1275] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:20.895453 15539 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.981247 15539 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 8 to 11, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 11 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.987735 21732 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:20.988325 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:20.989471 15720 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.000490 21932 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.002234 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.002954 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.004381 15795 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:21.006810 21816 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.007385 21816 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.002974 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.012075 15793 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:21.013026 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.009830 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.016525 21816 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.013645 15793 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:21.020493 21937 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:21.027275 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.028034 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.028559 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.030705 16325 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:21.033631 21839 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.034734 21839 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.036957 21687 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.037376 21687 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:21.037910 21683 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.038321 21683 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:21.039148 21683 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.040347 21683 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:21.041591 15688 connection.cc:256] RPC call timeout handler was delayed by -1.3873904089999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:08:21.007282 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:21.044540 15720 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:21.046165 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.074915 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:21.077513 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:21.082482 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:21.083484 15794 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:21.089653 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 43573.9us
W20260709 13:08:21.091604 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.068744 21886 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.091827 15759 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.013540 21710 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:21.131994 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.126086 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:21.143323 16300 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.858s (SENT)
I20260709 13:08:21.091246 21816 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.147207 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.147953 15792 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 15: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:21.096714 21937 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:21.124972 21873 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:21.134701 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 102320us
I20260709 13:08:21.149348 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.096670 21945 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:21.132962 21660 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:21.132843 21439 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.170441 15720 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.154819 21660 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.167622 15685 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:08:21.176709 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 169600us
I20260709 13:08:21.145982 21732 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.150467 21937 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.181926 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.198144 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:21.201045 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 115792us
W20260709 13:08:21.202078 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 67921.6us
I20260709 13:08:21.201030 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.204933 15796 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:21.143965 21886 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.170159 21873 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:21.171609 21932 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.176266 21798 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:21.219540 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.197803 21731 raft_consensus.cc:2804] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:21.198485 21937 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.220911 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:21.226732 15796 raft_consensus.cc:2376] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15. Re-sending same reply.
I20260709 13:08:21.181109 21945 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.237632 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.215173 21732 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.263479 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 48521.6us
I20260709 13:08:21.212276 21816 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:21.268868 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.272948 15718 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:21.273844 15796 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:21.240895 21731 raft_consensus.cc:697] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:21.276964 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51778.5us
I20260709 13:08:21.283495 15720 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:21.287125 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:21.295558 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88987.5us
I20260709 13:08:21.221058 21687 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.266393 21732 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.311059 15722 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:21.315853 15794 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:21.286043 21993 consensus_queue.cc:1048] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:08:21.321237 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.323464 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.327742 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.322649 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.330296 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.333431 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.334020 15642 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:21.335153 15717 raft_consensus.cc:1240] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:21.333598 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:21.334205 21988 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:08:21.339493 15643 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:21.338377 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.345003 15792 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
W20260709 13:08:21.342679 21989 log.cc:927] Time spent T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:21.355312 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.322160 21997 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.359867 15717 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:21.366101 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.363579 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:21.356715 21991 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:08:21.368059 15645 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:21.313144 21873 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.368150 15643 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:21.373153 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.376185 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.378118 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:21.378824 21992 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.224s	user 0.003s	sys 0.002s
I20260709 13:08:21.379431 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.382071 21886 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:21.383919 15719 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:21.388271 21816 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:21.389060 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.389113 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.390435 15717 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:21.391475 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:21.392077 15642 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.392272 21439 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:21.393855 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.394243 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.394570 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.395115 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:21.395730 15641 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.396623 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.376304 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.397765 15762 leader_election.cc:304] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.399132 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:21.421561 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.363481 21726 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:08:21.437342 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.438617 15719 raft_consensus.cc:2410] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:21.440375 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.441183 15795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "493304a609d247829052517242c00e96"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:21.442787 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:21.443411 16326 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.438099 15647 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:21.346089 21731 consensus_queue.cc:237] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.405845 21672 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:21.403390 21886 raft_consensus.cc:2764] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:21.426002 21816 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.437631 21660 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:21.437868 21802 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:21.372421 21997 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.445899 21705 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:21.462167 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 65629.3us
I20260709 13:08:21.439579 22006 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:21.464572 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:21.463070 15762 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.468075 15647 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.465951 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.480391 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:21.460587 21930 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:21.483531 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:21.490022 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 126870us
I20260709 13:08:21.490965 15645 raft_consensus.cc:2410] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:21.463050 21945 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:21.493273 15642 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:21.493438 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:21.502835 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.503897 21726 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:21.504015 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:21.504338 21726 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:21.504747 21726 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.482297 22000 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:21.505245 22000 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:21.493033 21930 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:21.506502 21930 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.508899 21710 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:21.505658 22000 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:21.511286 22002 log.cc:927] Time spent T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:08:21.513036 22003 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:21.515818 21687 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.517294 15647 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:21.526168 21660 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:21.526430 22006 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.527159 21660 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.528502 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:21.496851 15641 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:21.493008 21732 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.540387 15795 raft_consensus.cc:606] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:21.527601 21660 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.541677 15795 raft_consensus.cc:614] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.548032 15685 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:21.550335 21731 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:21.553231 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 109361us
I20260709 13:08:21.556780 21726 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.559209 21726 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.563241 21816 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.565965 22000 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.561596 21997 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.574044 21726 raft_consensus.cc:2804] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:21.574249 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.574721 21726 raft_consensus.cc:697] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:21.495167 21802 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:08:21.581413 15720 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:21.551023 21731 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:21.546833 21660 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.602187 22000 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:21.603289 21726 consensus_queue.cc:237] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:21.605008 21683 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.000s
W20260709 13:08:21.608882 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 160642us
I20260709 13:08:21.616881 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.620836 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.596381 21816 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.623783 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.612793 21731 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.626798 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:21.626852 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.627437 16333 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.627970 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.624358 15721 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:21.631122 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:21.631672 15647 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:21.651477 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 77300.7us
I20260709 13:08:21.653146 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.653445 22001 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:21.654112 21886 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.654713 21886 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.656900 21886 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:21.657545 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.657797 21980 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:21.658439 21980 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:21.658666 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.659550 21980 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.660627 22001 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:21.637867 21945 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.661608 22001 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.662096 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.663520 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.666433 22006 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:21.657632 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.672183 15647 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:21.652480 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:21.676010 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 132615us
I20260709 13:08:21.676276 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.670620 21710 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:21.687306 16326 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:21.688436 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.637705 21732 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:21.692080 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.690413 15762 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.695000 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.684114 21802 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:21.701058 15787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76331ca323724c289906034e280e8274"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:21.703498 15787 raft_consensus.cc:606] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:21.703859 15647 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:21.703959 15787 raft_consensus.cc:614] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.700675 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:21.694149 21947 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.717288 16333 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:21.697067 21710 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:21.719105 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.702258 21802 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.702059 22006 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:21.727576 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.729094 15638 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 12.
W20260709 13:08:21.734951 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.735796 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:21.662220 21945 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:21.747236 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 49402.3us
I20260709 13:08:21.748551 16327 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:21.750041 22020 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:21.750530 21945 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.750610 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.761070 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.762173 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:21.764160 22011 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:21.765091 21439 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:21.766526 22014 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:08:21.767588 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.769917 15716 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:08:21.727355 21802 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.770291 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.706576 21732 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.782637 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
W20260709 13:08:21.794094 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 108477us
I20260709 13:08:21.789929 21798 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.787868 15716 pending_rounds.cc:85] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 10
I20260709 13:08:21.794221 15791 raft_consensus.cc:606] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:21.796756 15791 raft_consensus.cc:614] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.790086 15718 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:21.736303 22006 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:21.797498 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.794852 22020 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:21.799044 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.794453 15715 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:21.804250 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54198.4us
I20260709 13:08:21.805465 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:21.796339 15716 pending_rounds.cc:107] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:08:21.807366 15716 raft_consensus.cc:2889] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.812745 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.813158 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.812996 22006 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.795830 21798 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:21.825688 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.828799 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:21.829412 15796 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 13: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:08:21.831287 22005 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:21.824939 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:21.834229 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.839951 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.840306 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:21.840585 15789 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:21.841826 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:21.841007 15796 raft_consensus.cc:2376] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16. Re-sending same reply.
I20260709 13:08:21.845412 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.826736 21798 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.825081 21849 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.845980 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.845335 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:21.825973 21930 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:21.854879 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.857247 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:21.862748 21930 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:21.863006 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:21.863538 22017 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:08:21.865104 15688 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.968s (SENT)
I20260709 13:08:21.865166 21849 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:21.863112 21660 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.865711 15688 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.865875 21849 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:21.848523 21884 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:21.874528 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:21.881614 15793 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.879304 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:21.819335 21710 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:21.876029 21937 consensus_meta.cc:287] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.006s
I20260709 13:08:21.905566 16333 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:21.869705 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.908619 15760 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.916072 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.870353 21849 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.874187 21884 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.912393 21672 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:21.923219 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 110165us
I20260709 13:08:21.925174 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.878433 21732 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:21.928607 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58995.4us
I20260709 13:08:21.950197 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:21.931689 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:21.955034 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.957605 21993 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.958163 21993 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.958001 21687 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:21.958585 21993 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.959746 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:21.923194 21884 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:21.954398 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 105651us
I20260709 13:08:21.973138 21687 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:21.973845 21687 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:21.975396 21687 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:21.977131 21687 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.947147 21882 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:21.947348 21683 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:21.921801 21937 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.002974 21690 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.010838 22028 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:22.014014 22015 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:22.015857 21802 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.017064 21660 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:21.968636 22007 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.013250 21873 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:21.981678 21672 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.921399 22020 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:21.999924 21683 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:22.077538 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:22.080875 21683 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:22.029256 22024 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:08:22.096421 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 136773us
I20260709 13:08:22.102660 15639 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:08:22.106281 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 156204us
I20260709 13:08:22.111503 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.119277 21980 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.119876 21980 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:22.120896 22032 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:08:22.095034 21873 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.124459 21873 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:22.124933 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 153796us
I20260709 13:08:22.125377 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.127727 15610 leader_election.cc:400] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:22.128759 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:22.134596 21731 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:22.146041 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.145658 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.149075 22001 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:22.149724 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:22.105647 21930 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.085433 21993 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.163620 15722 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:22.156299 21882 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.166808 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:22.169406 15787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:22.170071 15787 raft_consensus.cc:606] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:22.175104 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.165683 22001 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:22.167933 21980 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:22.211396 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:22.202271 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 73606.1us
W20260709 13:08:22.214259 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 108248us
I20260709 13:08:22.178625 22029 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:22.218267 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:22.223647 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 358553us
I20260709 13:08:22.198555 22000 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:22.206828 21731 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.207027 21993 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.198220 22045 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.214797 22001 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:22.208204 21683 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.227036 21886 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:22.236403 22042 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.237236 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:22.238418 22009 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:22.224556 21802 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.238570 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:22.251451 15788 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.252611 21683 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.252511 22001 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.220880 22029 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.254490 22029 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:22.215072 21980 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:22.233292 21798 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.257129 21798 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:22.245124 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.260825 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.261873 21731 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.262416 21731 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.264736 21731 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.261572 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.266404 21884 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.267385 21937 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.270378 21849 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:22.275633 22043 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:08:22.282349 15793 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:22.283032 21439 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:22.279376 21884 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.286857 22042 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.290607 15788 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
W20260709 13:08:22.296386 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64812.5us
W20260709 13:08:22.299358 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49691.9us
I20260709 13:08:22.296681 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:22.310858 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.315032 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:22.315918 15720 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.320973 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.321964 15647 raft_consensus.cc:2410] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:08:22.322656 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.319877 21945 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:22.328490 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.320874 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:22.326201 21945 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.330837 15788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:22.331391 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.337218 15639 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.337627 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:22.332306 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:22.309144 21997 raft_consensus.cc:2764] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:22.340145 22042 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:22.341827 22006 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.344913 22029 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.338145 21945 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.336675 15788 raft_consensus.cc:606] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:22.348649 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:22.319559 21882 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:22.321979 22009 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:22.352010 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 114890us
I20260709 13:08:22.353937 15720 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:22.356827 15685 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:22.312482 21937 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:08:22.363569 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.371306 22029 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.362689 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:22.350603 21731 raft_consensus.cc:2764] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:22.361052 22044 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.398779 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:22.399966 22020 raft_consensus.cc:2764] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:08:22.402333 22037 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:22.402969 22037 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.403573 21798 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:22.404260 21798 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:22.397424 22029 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:22.407295 22029 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:22.407581 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:22.408150 22029 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.410113 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:22.412863 21849 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:22.413784 21849 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:22.414618 21882 raft_consensus.cc:993] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:22.415119 21882 raft_consensus.cc:1081] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:22.415015 21849 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.417328 22009 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.409514 22029 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:22.419262 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.412726 22025 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.421370 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:22.428114 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 80961.2us
I20260709 13:08:22.428491 15639 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:22.429519 15789 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:22.429005 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.431787 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:22.452910 15795 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.405275 21798 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.432646 15792 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:22.432792 16329 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:22.434186 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:22.436043 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.437233 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:22.438257 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:08:22.439342 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.468408 15791 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.441071 15638 raft_consensus.cc:1240] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:22.441347 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.403894 22037 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.442200 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.427821 22044 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:22.443073 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.443305 15645 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:22.443244 21953 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.443629 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.444070 15641 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:22.445086 15644 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:22.446501 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.451821 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:22.481987 15787 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.465387 15717 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.473315 15789 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:22.473763 15796 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:22.467434 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:22.471973 16298 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:22.479059 16327 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:22.486567 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:22.487255 15792 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:22.494374 15794 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:22.506181 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.506960 21798 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.510241 22036 consensus_queue.cc:1059] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:22.511315 22036 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:22.511655 21726 raft_consensus.cc:3055] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:22.512073 21726 raft_consensus.cc:740] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.512974 21726 consensus_queue.cc:260] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.506208 22027 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:22.514294 22027 consensus_queue.cc:1243] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:22.518306 15642 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:22.522655 15647 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:22.523533 15717 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:22.506965 15646 raft_consensus.cc:2376] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17. Re-sending same reply.
I20260709 13:08:22.470901 21997 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:22.538389 15795 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:22.542443 15787 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:22.514317 21726 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:22.546309 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 335090us
I20260709 13:08:22.515529 21683 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:22.514904 22027 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:22.551069 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:22.551337 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:22.547096 15688 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.651s (SENT)
I20260709 13:08:22.556591 16332 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:22.544217 15640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42130
I20260709 13:08:22.566077 15640 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.566486 15640 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.570425 16300 leader_election.cc:336] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.154s (SENT)
I20260709 13:08:22.570927 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.572009 21839 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:22.582432 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.583921 21997 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.584684 22045 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.585227 22045 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.557278 22007 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:22.586246 22007 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:22.587124 22007 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.587707 22001 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:22.567184 15760 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.590011 22013 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:22.591279 21882 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.601334 15791 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:22.492400 21953 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.594549 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:22.617848 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.553665 22027 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.618633 15645 raft_consensus.cc:1217] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Deduplicated request from leader. Original: 17.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:08:22.619175 15645 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:22.619122 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.619462 22027 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.620254 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.490491 22044 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.622659 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.608841 21660 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:08:22.623286 15638 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:22.624290 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.606258 22006 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:22.625320 22057 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.620317 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.625627 15638 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:08:22.626749 15788 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:22.627664 15638 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:22.623188 22044 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.621474 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.631465 15640 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.635959 15644 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:22.639906 15641 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:22.625861 22057 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.641927 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.642649 15645 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:22.639093 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:22.649644 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.651063 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.654243 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:22.679808 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 132738us
W20260709 13:08:22.680193 16300 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.216s (SENT)
I20260709 13:08:22.680877 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.684536 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.643409 22057 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:22.639219 22025 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.693411 15640 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:22.690990 16298 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:22.694053 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 121980us
W20260709 13:08:22.689128 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.677862 22044 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:22.700227 15688 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.908s (SENT)
I20260709 13:08:22.639472 22036 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:08:22.693471 22027 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.693367 22025 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.696319 21660 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:22.712018 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 99009.5us
I20260709 13:08:22.696395 21690 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.682459 21945 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.714308 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.702726 21683 raft_consensus.cc:2804] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:22.643893 22020 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:08:22.716393 15685 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:22.717336 15529 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3d1a63ae20354b95b7bd0e7365b598f8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c1927141dc2540dab644a00fd6843fc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:08:22.727924 22058 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:08:22.728461 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76849us
I20260709 13:08:22.732766 15643 raft_consensus.cc:2468] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
W20260709 13:08:22.747381 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.761512 15642 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:22.712677 22025 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.772336 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.774245 15717 raft_consensus.cc:2368] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:22.779345 15639 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:08:22.766798 22062 log.cc:927] Time spent T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:22.764103 15529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66329.5us
W20260709 13:08:22.786926 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70573.6us
I20260709 13:08:22.787551 15646 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:22.775529 21683 raft_consensus.cc:697] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:22.801788 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.802497 15643 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 9.
I20260709 13:08:22.803238 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.804922 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:22.805459 15795 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 13.
I20260709 13:08:22.737591 21660 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.791320 22020 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:22.827900 15643 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:22.807350 21798 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.837931 15647 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:22.839115 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.840329 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.840552 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.841372 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.842909 15647 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:22.835857 21798 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.841995 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.844511 15643 raft_consensus.cc:3060] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.846082 21798 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:22.846745 21945 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:22.853632 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 158053us
I20260709 13:08:22.854902 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.858865 15647 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.868517 21947 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:22.869076 21947 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.853987 15643 raft_consensus.cc:2468] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:22.873699 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.876058 15643 raft_consensus.cc:2376] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16. Re-sending same reply.
I20260709 13:08:22.878649 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.884578 15640 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
W20260709 13:08:22.884799 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 85257.6us
I20260709 13:08:22.886804 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.888013 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.889207 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.890125 15720 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:22.891950 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:22.892367 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.896600 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.897512 15722 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:22.855811 22020 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.899411 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.903689 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:22.904538 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
W20260709 13:08:22.905560 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.863610 21997 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:22.905633 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.903743 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.907546 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:22.912464 15719 raft_consensus.cc:2410] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
W20260709 13:08:22.920506 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 117350us
I20260709 13:08:22.919337 15647 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:22.921442 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:22.921557 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.924701 15640 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:22.926025 15643 raft_consensus.cc:1275] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:22.928617 15760 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:22.898554 22044 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:22.907385 21947 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:22.933907 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.934048 21882 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.936673 22045 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:22.936856 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.939985 15647 raft_consensus.cc:1275] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:22.993104 15647 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:22.993510 15647 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:22.993209 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:22.994369 15647 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.995571 15718 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:22.943090 15762 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:22.888052 22013 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:08:22.996583 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 53542.5us
I20260709 13:08:22.997728 22013 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:22.943429 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:22.998148 22013 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.942485 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:22.998557 22013 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.913589 21683 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:22.947052 21953 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:22.950042 22020 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:22.950860 22066 raft_consensus.cc:993] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:22.950057 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:22.957536 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.927961 21798 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.960655 15611 leader_election.cc:400] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:22.995699 15647 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.927780 21439 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:08:22.945962 22069 consensus_queue.cc:1059] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:22.999670 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:23.012193 15719 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:22.960105 21882 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.008263 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.010151 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.010774 15611 leader_election.cc:403] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.944360 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:23.012835 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.022831 15643 raft_consensus.cc:2376] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19. Re-sending same reply.
W20260709 13:08:23.022935 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 64435.8us
I20260709 13:08:23.011554 22045 raft_consensus.cc:1081] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
W20260709 13:08:23.025200 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 75221.7us
I20260709 13:08:23.025621 22045 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.022972 15647 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:23.015710 15644 raft_consensus.cc:2376] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15. Re-sending same reply.
W20260709 13:08:23.034035 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.407s (SENT)
I20260709 13:08:23.034802 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.008409 21798 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.037261 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.003288 22033 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:22.930565 21660 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.022835 21882 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.028292 22042 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.030045 21997 raft_consensus.cc:3060] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.055810 15717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:08:23.056814 15717 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.057308 15717 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.071491 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.072165 15642 raft_consensus.cc:2376] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17. Re-sending same reply.
I20260709 13:08:23.072260 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.073099 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.074167 22033 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:23.074361 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.074618 22033 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:23.076318 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.077183 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.038447 21798 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.074193 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.081846 22068 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:23.082288 22068 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:23.083493 15642 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:23.083187 22068 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:23.084409 22068 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.037309 22000 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:08:23.091030 22040 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.035228 22025 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.096158 22025 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:23.097342 15646 raft_consensus.cc:2376] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18. Re-sending same reply.
I20260709 13:08:23.097728 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:23.113937 15716 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:23.113652 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.117878 15715 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:23.121783 22033 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.123188 22033 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.116535 22040 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.127730 15717 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:23.118793 22079 log.cc:927] Time spent T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:08:23.129920 22073 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:08:23.136813 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 134445us
I20260709 13:08:23.147085 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:23.130396 22040 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.152619 15717 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:23.102794 22044 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.166930 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:23.167593 16329 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.168485 15787 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:23.156427 22040 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.154119 22036 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.150470 21849 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:23.207218 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.186637 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.182505 22036 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:23.208110 15791 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:23.208379 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.200893 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.169416 21798 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.211553 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:23.212325 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 181357us
W20260709 13:08:23.212888 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.214607 15794 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:23.214830 21947 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.215553 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.216070 15794 raft_consensus.cc:2376] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 13. Re-sending same reply.
I20260709 13:08:23.216830 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.219390 21882 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:23.202471 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.202764 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.221376 15793 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.203322 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.204324 15795 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:23.205009 21997 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:23.208632 15791 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:23.209372 15792 raft_consensus.cc:2368] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17.
I20260709 13:08:23.199421 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.243295 15787 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.210978 22036 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:23.245522 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.246287 15796 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18.
I20260709 13:08:23.246542 15789 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:23.250892 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:23.251488 15719 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.257153 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.250380 15791 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.212841 21798 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:23.260871 15791 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.269624 15794 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:23.246388 21683 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:23.269512 15793 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:23.263155 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.276531 15717 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:23.289484 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.291931 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.293642 15787 raft_consensus.cc:2468] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
W20260709 13:08:23.296239 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.296821 16297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.302991 15791 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:23.305938 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.306777 15794 raft_consensus.cc:2368] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18.
I20260709 13:08:23.309291 15794 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:23.310788 15794 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:08:23.312518 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 98962us
I20260709 13:08:23.314474 16332 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:23.304673 15685 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:23.316285 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.316915 15795 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:23.298434 21690 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.322273 15787 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:23.270409 22013 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:23.331979 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.332836 15791 raft_consensus.cc:2410] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:23.337165 15793 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:23.346076 15795 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:23.347398 15643 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:23.299782 22044 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:23.348901 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.352845 16327 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 10.
I20260709 13:08:23.292128 21683 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:23.358049 16299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.371518 15644 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:23.323736 21731 raft_consensus.cc:2804] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:23.368696 22091 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:23.312587 22025 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:23.398712 15791 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 16. Ops: []
I20260709 13:08:23.374128 15790 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
W20260709 13:08:23.374831 16300 leader_election.cc:336] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.112s (SENT)
I20260709 13:08:23.376293 21439 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:23.378753 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.380525 15793 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 16. Ops: [14.11-14.11]
I20260709 13:08:23.390808 15720 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:23.370239 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.391687 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:23.375178 16329 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
W20260709 13:08:23.409875 15610 connection.cc:256] RPC call timeout handler was delayed by -2.5363752479998993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 13:08:23.410482 15610 connection.cc:256] RPC call timeout handler was delayed by -2.378875247999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:08:23.410902 15610 connection.cc:256] RPC call timeout handler was delayed by -2.1862752479999017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:08:23.411284 15610 connection.cc:256] RPC call timeout handler was delayed by -2.1520752479998464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
I20260709 13:08:23.340037 21690 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:23.415879 16300 leader_election.cc:336] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.445s (SENT)
I20260709 13:08:23.416371 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.336067 22084 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:08:23.421026 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.439250 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:23.439636 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.442421 16326 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:23.442749 15787 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.442479 21953 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.409225 21731 raft_consensus.cc:697] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:23.440455 22037 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:08:23.447021 21690 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:23.446851 21731 consensus_queue.cc:237] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.448807 22013 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:23.453187 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.453830 21882 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:23.453876 15788 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.454438 22040 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:23.455575 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:23.455817 16334 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:23.456812 22040 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:23.457077 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:23.458078 21849 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.458829 22029 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.459592 22029 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.462780 15788 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
W20260709 13:08:23.463220 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 47373us
I20260709 13:08:23.464138 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.465969 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.466286 16329 raft_consensus.cc:1240] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:23.466678 16331 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:23.467299 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:23.465358 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.467981 15788 raft_consensus.cc:2376] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fec10611791a4ab384f86b212249410e in term 17. Re-sending same reply.
I20260709 13:08:23.468784 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.470139 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.471349 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.472649 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.477298 15719 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:23.481199 15788 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:23.484288 16329 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:23.494118 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.495023 16329 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 10: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:23.441671 22028 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:23.490514 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.506719 15788 raft_consensus.cc:2410] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:08:23.513607 16329 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:23.515884 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:23.516578 16329 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.523481 15787 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:23.524937 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.526362 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:23.513370 22044 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:08:23.531129 21683 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:23.514765 22028 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:23.535291 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.536335 15788 raft_consensus.cc:2368] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:08:23.538718 15787 raft_consensus.cc:2368] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:23.539834 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.541292 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.544636 16329 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:23.545378 15788 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:23.547434 15788 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:08:23.551930 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 94956.6us
I20260709 13:08:23.556494 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.534363 22028 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.557930 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.559757 21947 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:23.560211 22097 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.561105 22097 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:23.567960 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.568744 22033 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.572293 22033 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.574534 22104 consensus_queue.cc:1048] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.578539 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:23.578576 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.579797 22104 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.581512 22104 consensus_queue.cc:1048] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:23.579645 22009 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.584259 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.585191 22104 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.581252 22036 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.588253 22104 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.589304 22036 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:23.592092 22009 consensus_queue.cc:1059] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:23.592921 22009 consensus_queue.cc:1243] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:23.593385 21937 raft_consensus.cc:3055] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:23.593875 21937 raft_consensus.cc:740] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:23.594189 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:23.594741 21937 consensus_queue.cc:260] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:23.595606 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:23.598023 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:23.598615 16329 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.596052 21937 raft_consensus.cc:3060] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.602272 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:23.603991 15787 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:23.606695 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.614174 16329 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:23.619813 15759 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:23.634023 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:23.622481 21726 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:23.640317 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.636884 22102 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:23.644690 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:23.632141 21439 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:23.649755 21439 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:23.650720 21439 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:23.637212 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.657409 16333 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:23.658929 22033 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.659065 21945 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:23.659521 21945 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:23.659245 22066 consensus_queue.cc:1059] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:23.659974 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.660847 22033 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.660421 21945 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.667533 15787 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:23.671628 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:23.646301 22102 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.637820 21947 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.624701 22013 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:23.679461 21945 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:23.696105 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:23.693217 21726 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:23.687202 21683 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:08:23.736336 22106 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:08:23.761344 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 165796us
W20260709 13:08:23.762344 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.763682 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:23.764930 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.765609 15640 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:23.766149 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44044.1us
W20260709 13:08:23.761232 22103 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:08:23.768656 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.769251 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.772454 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.787154 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.787904 15642 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 19.
I20260709 13:08:23.791118 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.792833 15647 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:23.794675 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.795964 15647 raft_consensus.cc:2410] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:23.798287 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.798561 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.799841 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.800798 15642 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:23.803797 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.785917 22102 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:23.770875 21798 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:23.811510 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.814239 15645 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.815366 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.816263 15641 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 19.
I20260709 13:08:23.767166 21937 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:08:23.828424 15640 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:23.828714 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.832026 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.833956 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:23.839974 22107 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:23.830178 22102 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:23.841473 22102 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:23.845170 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.846808 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.847430 15646 raft_consensus.cc:2376] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15. Re-sending same reply.
I20260709 13:08:23.847602 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.848747 15646 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:08:23.938412 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.951231 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:23.952255 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.958524 15645 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 10.
I20260709 13:08:23.962585 15646 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:23.963073 15646 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:23.963887 15646 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.965023 15646 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.838543 21798 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:23.966876 21798 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:23.973909 15642 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:23.975692 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:23.976506 15640 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:23.977604 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:23.979657 15647 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.850625 21726 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:24.029158 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.065248 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.065938 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46917.8us
I20260709 13:08:24.096554 15640 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:24.064973 22115 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.079250 22066 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.109014 15647 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
W20260709 13:08:24.135774 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.120172 22066 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.119349 22115 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:24.213476 21945 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.001s
W20260709 13:08:24.242153 22129 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:08:24.243875 22114 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.244472 22114 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:24.257875 22124 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:24.258663 22114 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:24.259562 22066 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:24.261021 22115 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:24.266467 22123 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 13:08:24.268851 22115 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.269470 22115 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:24.282799 22125 log.cc:927] Time spent T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:08:24.308380 22069 raft_consensus.cc:3055] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:24.309067 22069 raft_consensus.cc:740] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:24.311896 22089 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.999s	user 0.005s	sys 0.005s
I20260709 13:08:24.319919 22069 consensus_queue.cc:260] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:24.368121 22114 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:24.368637 22068 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:24.369139 22114 consensus_queue.cc:1243] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:24.369311 22068 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.372503 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:24.374051 15718 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:24.375468 22131 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.376052 22131 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.378573 22131 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:24.384357 22084 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.385123 22084 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:24.386824 15720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2352) took 1495 ms (client timeout 1784 ms). Trace:
I20260709 13:08:24.387115 15714 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:24.387296 15720 rpcz_store.cc:269] 0709 13:08:22.891502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.891678 (+   176us) service_pool.cc:224] Handling call
0709 13:08:24.386602 (+1494924us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001e6c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:24.386743 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124019584}
I20260709 13:08:24.389519 22027 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.390241 22027 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.406713 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:24.417955 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:24.420571 22133 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.421217 22133 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.427204 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:24.431614 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:24.433188 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:24.433964 15719 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:24.413139 21945 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.448812 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:24.429884 22069 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:24.412222 22068 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:24.453131 22115 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:24.454551 22037 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:24.469599 22040 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.436628 21687 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.477306 21687 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:24.455567 21945 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.481454 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:24.481276 22053 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:24.484509 21945 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:24.480293 21687 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:24.494201 22133 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:24.455170 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:24.529351 15721 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:24.542680 15715 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 16. Ops: []
I20260709 13:08:24.545179 15722 raft_consensus.cc:1240] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 16. Ops: []
I20260709 13:08:24.547883 15718 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:24.567958 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:24.594851 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:24.596797 15792 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:24.572305 21798 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.603389 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:24.603446 22136 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:08:24.618748 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 274036us
W20260709 13:08:24.621577 16300 leader_election.cc:336] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.581s (SENT)
I20260709 13:08:24.569983 22001 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:08:24.634260 15792 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:24.637086 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.637693 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.638019 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.624291 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:24.630363 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:24.630568 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:24.572038 22113 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:24.640738 15788 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:24.680011 16334 raft_consensus.cc:1240] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:24.694667 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 3099) took 1406 ms. Trace:
I20260709 13:08:24.696130 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:24.704814 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 101508us
I20260709 13:08:24.706492 15714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2364) took 1580 ms. Trace:
I20260709 13:08:24.707078 15714 rpcz_store.cc:276] 0709 13:08:23.126098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.126253 (+   155us) service_pool.cc:224] Handling call
0709 13:08:24.386766 (+1260513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.387536 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.706217 (+318681us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001e6c50. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad254058ad 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:24.706405 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878950272}
I20260709 13:08:24.695231 15794 rpcz_store.cc:276] 0709 13:08:23.288032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.318251 (+ 30219us) service_pool.cc:224] Handling call
0709 13:08:23.346540 (+ 28289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.346746 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:23.424344 (+ 77598us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.288500 (+864156us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b1800409060. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a 00007fad25410a2a
0709 13:08:24.694238 (+405738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:24.694302 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:24.694353 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.694427 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.694571 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11948,"prepare.queue_time_us":157069,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":68,"raft.queue_time_us":12089,"spinlock_wait_cycles":7155968,"thread_start_us":422420,"threads_started":2}
W20260709 13:08:24.713150 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.714346 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:24.678470 21953 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.722851 15643 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:24.725904 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:24.700296 21937 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.729314 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:24.698292 22138 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:24.734321 15646 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:24.733314 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 338286us
W20260709 13:08:24.746835 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 295076us
I20260709 13:08:24.770124 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:24.772873 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:24.773789 15639 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:24.783943 15646 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 11.
I20260709 13:08:24.785238 15642 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:24.785585 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.794104 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:24.802850 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:24.810765 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:24.812425 15646 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:24.831168 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:24.718140 21849 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.832604 15646 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:24.860723 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:24.873814 16334 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:24.878626 15646 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:24.879607 15646 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:24.728056 22029 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:24.884729 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 161996us
W20260709 13:08:24.871750 22136 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:08:24.727643 22149 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:24.734921 22113 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:24.910871 15645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2845) took 1062 ms. Trace:
W20260709 13:08:24.911238 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.871884 22132 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:24.921187 15646 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.911487 15645 rpcz_store.cc:276] 0709 13:08:23.848255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.094646 (+246391us) service_pool.cc:224] Handling call
0709 13:08:24.116252 (+ 21606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.122254 (+  6002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.122301 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.147351 (+ 25050us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.209951 (+ 62600us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:24.577640 (+367689us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.909109 (+331469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.909407 (+   298us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.909722 (+   315us) raft_consensus.cc:1685] finished
0709 13:08:24.910296 (+   574us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.910789 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72879,"prepare.queue_time_us":232613,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":10526,"raft.queue_time_us":176411,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":19546,"thread_start_us":669744,"threads_started":3,"wal-append.queue_time_us":121997}
I20260709 13:08:24.930770 15610 leader_election.cc:400] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17.
I20260709 13:08:24.882043 21798 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.883293 21953 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:24.885457 22140 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:24.856892 21937 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.897661 22121 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:24.897142 22068 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:24.953326 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 249644us
I20260709 13:08:25.060499 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:24.897444 22114 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:24.979058 15646 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.869241 22138 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:24.908370 21802 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.910343 22001 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:24.876250 21849 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:25.019133 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 271353us
I20260709 13:08:25.038102 22027 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:25.060804 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 152287us
I20260709 13:08:24.901309 22029 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.070132 15643 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:25.072716 15646 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:25.063798 22123 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:25.078660 15610 leader_election.cc:400] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18.
W20260709 13:08:25.081493 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 298124us
I20260709 13:08:25.084959 16328 raft_consensus.cc:1240] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:24.933135 22113 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:25.099313 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 238648us
I20260709 13:08:25.068933 22001 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.980876 21798 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.077494 22040 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.971496 22132 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:25.124066 15638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.001s	sys 0.012s
W20260709 13:08:25.125051 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 252056us
W20260709 13:08:25.129853 15638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.001s	sys 0.012s
I20260709 13:08:25.063920 22068 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.132519 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:25.067657 22114 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.072259 21802 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.058445 22140 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.121618 22001 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.061829 22121 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.130788 22083 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:25.161358 15639 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:25.124981 22053 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.170382 22036 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.191534 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.117977 22130 consensus_queue.cc:1059] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:08:25.100817 22135 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.436s
I20260709 13:08:25.195845 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2842) took 1342 ms. Trace:
W20260709 13:08:25.197782 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 179020us
I20260709 13:08:25.188974 22155 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.161798 22042 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:25.166328 21882 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:25.199694 22147 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.313s	user 0.004s	sys 0.000s
I20260709 13:08:25.180028 22083 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:25.200722 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.205384 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 63350.2us
I20260709 13:08:25.202400 22130 consensus_queue.cc:1243] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:08:25.200306 22028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.013s	sys 0.041s
I20260709 13:08:25.193230 22117 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.285s
W20260709 13:08:25.225284 22141 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.437s	user 0.000s	sys 0.001s
I20260709 13:08:25.226930 22117 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.227279 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2846) took 1378 ms. Trace:
I20260709 13:08:25.213279 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.224771 22130 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.227785 15640 rpcz_store.cc:276] 0709 13:08:23.848508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.102808 (+254300us) service_pool.cc:224] Handling call
0709 13:08:24.103293 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.185143 (+ 81850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.185177 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.193608 (+  8431us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.525504 (+331896us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:24.531672 (+  6168us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.638630 (+106958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.638702 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.227039 (+588337us) raft_consensus.cc:1685] finished
0709 13:08:25.227063 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.227218 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106711,"prepare.queue_time_us":5376,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3892,"raft.queue_time_us":218956,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":23761,"thread_start_us":398615,"threads_started":2,"wal-append.queue_time_us":404804}
I20260709 13:08:25.197209 15638 rpcz_store.cc:276] 0709 13:08:23.847544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.982681 (+135137us) service_pool.cc:224] Handling call
0709 13:08:23.983052 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.067996 (+ 84944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.068034 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.240253 (+172219us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b2c000014c8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:08:24.240812 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.274206 (+ 33394us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:25.132225 (+858019us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.164416 (+ 32191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.164490 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.164530 (+    40us) raft_consensus.cc:1685] finished
0709 13:08:25.179636 (+ 15106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.190292 (+ 10656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12303,"prepare.queue_time_us":206389,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3715,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":25752832,"thread_start_us":727248,"threads_started":2,"wal-append.queue_time_us":28179}
W20260709 13:08:25.209218 22139 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.433s	user 0.001s	sys 0.000s
I20260709 13:08:25.213557 22083 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:25.235458 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.200004 22036 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:25.223786 22028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.013s	sys 0.042s
W20260709 13:08:25.213342 22143 log.cc:927] Time spent T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:25.221688 22158 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:25.236564 21937 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.200482 22053 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.208968 22042 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.227546 22117 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.203931 22155 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.211741 21882 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:25.272379 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65875.8us
W20260709 13:08:25.284706 22144 log.cc:927] Time spent T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:08:25.284809 22171 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:25.286043 22165 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:25.286199 22155 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.286801 22153 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:25.287369 21882 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.287590 22153 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.287997 22042 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.288981 22114 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.281752 21849 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.289896 21849 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.290366 21849 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.290958 15716 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.291844 15714 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:25.292384 21849 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.290387 22140 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.296003 21798 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.296267 22159 consensus_queue.cc:1059] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:08:25.286895 22155 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:25.297243 22159 consensus_queue.cc:1243] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:08:25.297700 22148 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 13:08:25.297714 22155 raft_consensus.cc:3055] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.298979 22155 raft_consensus.cc:740] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:25.299577 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.299767 22155 consensus_queue.cc:260] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.303298 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.278152 22097 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:25.269879 22138 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:25.313119 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:08:25.244131 22130 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.304019 22155 raft_consensus.cc:3060] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.321079 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.321203 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.301404 22029 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.335096 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.336741 22068 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.268229 22158 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.316020 22113 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.315783 22167 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.284739 22176 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:25.315382 22140 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:25.351887 15610 leader_election.cc:400] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18.
I20260709 13:08:25.338181 22132 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.357970 22174 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.358400 22140 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:25.358830 22140 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:25.359395 22177 log.cc:927] Time spent T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:25.359769 22140 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.321027 22159 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:25.360942 22140 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:25.352854 22168 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:08:25.363798 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.366492 22181 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.369158 22036 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.338002 21802 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.370921 22084 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:25.372048 22154 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:08:25.372470 22164 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:08:25.373270 15641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2849) took 1408 ms. Trace:
I20260709 13:08:25.349454 22153 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.373911 22113 raft_consensus.cc:3055] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:25.374362 22113 raft_consensus.cc:740] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:25.373649 22053 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.375386 22113 consensus_queue.cc:260] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.376274 22117 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.376654 22113 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.377442 22130 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.372063 22121 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.379827 22186 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:25.380584 22069 consensus_meta.cc:287] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.854s	user 0.007s	sys 0.003s
I20260709 13:08:25.381141 15789 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
I20260709 13:08:25.350788 22167 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.373699 22174 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:25.392076 22174 consensus_queue.cc:1243] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:25.393925 22167 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.373632 15641 rpcz_store.cc:276] 0709 13:08:23.965168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.206300 (+241132us) service_pool.cc:224] Handling call
0709 13:08:24.206676 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.602133 (+395457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.602169 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.602738 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.893313 (+290575us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:24.893390 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.893511 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.371332 (+477821us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:25.373012 (+  1680us) raft_consensus.cc:1685] finished
0709 13:08:25.373032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.373216 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395025,"raft.queue_time_us":395480,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"spinlock_wait_cycles":9229056,"thread_start_us":290065,"threads_started":1,"wal-append.queue_time_us":502202}
I20260709 13:08:25.401335 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:25.403309 22121 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:25.403777 22121 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.404138 22121 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.405901 22077 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.406585 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.406507 22077 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.408679 22116 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:25.409212 22077 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.410933 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.416290 22186 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.415620 22121 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.417407 22186 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.420331 22121 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.421658 22186 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:25.431661 22175 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:08:25.446126 15713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2371) took 1039 ms. Trace:
I20260709 13:08:25.446576 15713 rpcz_store.cc:276] 0709 13:08:24.407038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.407839 (+   801us) service_pool.cc:224] Handling call
0709 13:08:24.435296 (+ 27457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.435509 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:24.867766 (+432257us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.445546 (+577780us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b180016cc00. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad24fae4bc 00007fad222fc48b 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22318c02 00007fad24fa020b 00007fad24fa5d23 00007fad24fa623a
0709 13:08:25.445776 (+   230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.445826 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:25.445868 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.445934 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.446068 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6513,"prepare.queue_time_us":636914,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":57,"spinlock_wait_cycles":15781760,"thread_start_us":625744,"threads_started":2}
I20260709 13:08:25.449903 22186 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.450449 21997 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.451076 21997 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.453526 21997 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.462746 22116 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:25.463277 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.466886 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:23.544500 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.475136 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:25.475353 22009 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:25.523906 22009 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:25.524506 22167 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:25.524950 22167 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.485491 22102 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.503160 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:25.523895 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 48858us
I20260709 13:08:25.526572 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.526841 21690 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.527765 21690 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.525310 22167 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:25.528754 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.525780 22102 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.505255 15718 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:25.507840 22097 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:25.508922 21726 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:25.524953 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.536804 22102 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.525292 22009 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.537317 21997 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:25.540557 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.541272 15714 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
W20260709 13:08:25.541601 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 135128us
I20260709 13:08:25.543916 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.549132 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:25.542415 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:25.551882 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.550015 15714 raft_consensus.cc:2376] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13. Re-sending same reply.
I20260709 13:08:25.558195 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.564672 15610 leader_election.cc:400] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:08:25.565248 15610 leader_election.cc:403] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.572754 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.574846 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.579607 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.581691 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.582705 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.584573 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.557291 22112 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.562109 21726 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:25.609990 15610 leader_election.cc:400] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:25.575201 22102 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.634984 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.639663 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2847) took 1789 ms. Trace:
W20260709 13:08:25.646536 15762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.015s
I20260709 13:08:25.646622 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.647607 22176 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:25.647835 22132 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:25.650743 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:25.651762 15762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.001s	sys 0.015s
W20260709 13:08:25.652145 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 513103us
I20260709 13:08:25.607278 22009 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.586046 22134 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 10. Current term is 11.
I20260709 13:08:25.652282 15789 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.611186 21726 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.686235 21726 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.688220 22158 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.691246 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42122 (request call id 2841) took 1844 ms. Trace:
I20260709 13:08:25.691664 15644 rpcz_store.cc:276] 0709 13:08:23.847294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.390449 (+543155us) service_pool.cc:224] Handling call
0709 13:08:24.390770 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.631837 (+241067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.631877 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.632473 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.906853 (+274380us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:08:24.960122 (+ 53269us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.146297 (+186175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.146565 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.691050 (+544485us) raft_consensus.cc:1685] finished
0709 13:08:25.691069 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.691189 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234638,"prepare.queue_time_us":110019,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":470829,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":44113,"thread_start_us":407805,"threads_started":2,"wal-append.queue_time_us":966492}
I20260709 13:08:25.629778 21937 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:08:25.654155 15762 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:25.656185 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.703485 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.656291 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.605417 22186 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:25.706647 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.710007 15791 raft_consensus.cc:2410] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:08:25.709874 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.711572 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.713071 22116 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:25.715005 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.714370 22167 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.715752 15793 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:25.716017 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.717890 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.722024 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:25.722771 15793 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:25.614259 22029 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.606196 21690 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.654242 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:25.726155 15688 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.997s (SENT) [suppressed 46 similar messages]
W20260709 13:08:25.742190 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 88017us
I20260709 13:08:25.660053 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.661085 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.744143 15722 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:25.662328 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.746800 15795 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:25.669158 16325 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:25.656304 22126 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.673954 22163 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.678526 21687 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:25.719038 22167 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.705085 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.706130 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:25.705418 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51346.4us
I20260709 13:08:25.752866 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:25.722249 22001 consensus_meta.cc:287] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 13:08:25.723531 15760 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:25.640147 15647 rpcz_store.cc:276] 0709 13:08:23.850262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.160863 (+310601us) service_pool.cc:224] Handling call
0709 13:08:24.161309 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.907298 (+745989us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:24.981469 (+ 74171us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.180505 (+199036us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.196253 (+ 15748us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.196912 (+   659us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:25.197428 (+   516us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.351191 (+153763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.462961 (+111770us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:08:25.638242 (+175281us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400267fd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:25.638906 (+   664us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.639193 (+   287us) raft_consensus.cc:1685] finished
0709 13:08:25.639263 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.639598 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334057,"prepare.queue_time_us":154603,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":529532,"raft.run_cpu_time_us":9722,"raft.run_wall_time_us":824323,"spinlock_wait_cycles":512249728,"thread_start_us":502931,"threads_started":3,"wal-append.queue_time_us":172593}
I20260709 13:08:25.719070 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:25.741366 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.653812 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.681869 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.758831 15714 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.777645 16331 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:25.785107 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 61642us
W20260709 13:08:25.799126 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 52598us
I20260709 13:08:25.748982 22135 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.751012 22138 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.752508 22163 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:25.803984 22193 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:25.804702 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 51938.6us
I20260709 13:08:25.803277 15793 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 19.
I20260709 13:08:25.808279 22135 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.841919 22190 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.843818 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:25.844523 15647 raft_consensus.cc:2376] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15. Re-sending same reply.
I20260709 13:08:25.845522 15642 pending_rounds.cc:85] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 12
I20260709 13:08:25.845849 15642 pending_rounds.cc:107] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:08:25.846099 15642 raft_consensus.cc:2889] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:25.775700 22001 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.846879 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.847309 15643 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:25.847563 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.765094 22126 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.814109 22163 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.850695 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:25.811878 22193 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.855363 16297 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:25.858291 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.842581 22190 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.842710 22179 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.840253 21726 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.838774 22121 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.859709 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.887735 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.872254 15720 raft_consensus.cc:1240] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:08:25.895064 15638 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:25.890045 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.888031 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.897136 15647 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:25.897634 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.890168 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.890635 15639 raft_consensus.cc:2410] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 18 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:08:25.896006 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.899868 15640 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:25.898084 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.898440 15646 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:25.900799 15647 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:25.893245 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:25.899318 15643 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:25.905155 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.860929 22130 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:25.918880 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:25.920539 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:25.861997 22083 consensus_meta.cc:287] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 13:08:25.814319 22138 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.925881 15639 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:25.913137 15791 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:25.887885 22001 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.890460 22183 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.868248 22098 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.873955 21726 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.942694 22183 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.931525 21937 consensus_queue.cc:1059] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:08:25.889623 22135 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.867830 22190 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.866582 22179 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.936426 22126 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:25.860631 22068 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:08:25.938396 22138 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:25.913532 22097 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:08:25.894186 22193 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.892112 22117 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:25.886124 22121 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:25.877939 22041 raft_consensus.cc:2804] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:25.963754 15714 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:25.876886 22115 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:25.972293 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:25.972859 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:25.983354 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62906.3us
I20260709 13:08:25.984392 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:25.985050 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:25.986726 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:25.964421 22009 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.987848 21937 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:25.994642 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:25.931201 22083 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:25.992478 22187 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:25.985291 22029 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:25.990536 22180 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:25.982378 22117 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.999315 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.002825 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.012077 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:26.012518 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:26.013329 16332 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:25.990855 22167 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:25.998323 22029 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:26.027154 16333 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:26.017145 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:25.996564 22041 raft_consensus.cc:697] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:26.010234 21690 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.012130 22190 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.012249 22178 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.044461 22158 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.045082 22138 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:26.045939 22138 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.046993 22121 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:25.994498 22009 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.051273 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:26.039326 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 313184us
I20260709 13:08:26.009852 22187 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.010434 22117 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.037649 22166 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.041080 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:26.076447 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.053372 15688 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.016064 22135 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:26.083880 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:26.036769 21937 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:25.991892 22183 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.064116 22138 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:26.036188 22167 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.088555 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.067267 22033 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:26.081111 22097 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:26.086974 22126 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.104550 22158 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.104175 22121 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.104151 21849 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.114149 21997 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.104269 22036 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:26.081727 22029 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.110958 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:26.088476 22166 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.118008 22033 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.144593 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.126991 21997 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.149446 15545 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 16 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:26.152736 22167 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.153820 22115 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.154495 22115 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.156978 22115 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:26.159402 22033 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:26.161386 22166 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.118433 22041 consensus_queue.cc:237] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.146787 22158 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:26.172453 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 54222.8us
I20260709 13:08:26.127826 22179 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.125831 22121 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.175446 22121 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.149593 22029 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.164284 22163 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.182440 16326 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:26.183643 22163 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.164661 22009 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:26.127131 21849 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.167294 22193 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.118721 22097 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.186525 21849 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.187083 22097 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.169872 21997 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:26.170672 22194 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:08:26.172083 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:26.200807 21997 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.202829 22097 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:26.203814 22193 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.144747 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:26.205621 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:26.206501 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61838.5us
I20260709 13:08:26.207553 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:26.207867 22009 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.209017 22158 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:26.187899 22117 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.217114 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.214335 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:26.227805 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.228750 15788 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:26.225162 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:26.236207 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:26.238816 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.239707 15795 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
W20260709 13:08:26.253914 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.256278 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.224795 22097 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:26.294835 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 439931us
W20260709 13:08:26.323992 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 98875.4us
I20260709 13:08:26.345588 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:26.264273 22135 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:26.266953 22097 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.234436 22187 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:26.361917 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.344916 21726 raft_consensus.cc:2764] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:08:26.363715 22033 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:26.362636 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.361045 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.384096 15638 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:26.381731 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:26.372022 22097 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.385092 15646 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.369673 22135 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.394253 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:26.390064 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.395713 15638 raft_consensus.cc:2393] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 20: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:26.394207 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.389698 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:26.402684 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.403684 15638 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:26.404582 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.410823 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.413139 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.415339 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.416356 15638 raft_consensus.cc:2410] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:08:26.383417 22033 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.421355 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.424337 15643 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:26.425067 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:26.425940 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:26.425665 15645 raft_consensus.cc:3060] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.427227 15643 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:26.431533 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 116551us
I20260709 13:08:26.434478 15788 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:26.448589 22083 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.454568 22117 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.455555 22190 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:26.456019 22190 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:26.401607 22135 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.464895 21997 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.466799 21953 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.467429 21953 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.470388 21953 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.470013 15545 catalog_manager.cc:5697] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 16, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 16 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:26.346944 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:26.481936 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 135077us
I20260709 13:08:26.486491 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:26.488236 15638 raft_consensus.cc:2410] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:26.504395 15646 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:26.430738 22033 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:26.512262 21937 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:26.513041 21937 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.496948 21997 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.493788 22084 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:26.497220 22204 log.cc:927] Time spent T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:26.511641 15610 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.556427 15645 raft_consensus.cc:2468] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:26.496780 22159 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:26.515314 21937 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.583657 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.585247 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.586294 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:26.586547 15718 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:26.586947 15714 raft_consensus.cc:3060] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.584590 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:26.593958 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 82426.8us
I20260709 13:08:26.595008 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.596438 15789 raft_consensus.cc:1275] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:26.597859 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.596899 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.602762 15787 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:26.603358 15788 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:26.603279 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.603614 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.604696 15760 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:26.598085 15789 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:26.610774 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.611433 15789 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:26.612448 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.613581 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.516191 22186 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:26.616931 15643 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:26.627769 15788 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:26.579464 22084 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.587673 21997 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.625489 15714 raft_consensus.cc:2468] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 19.
I20260709 13:08:26.636904 22186 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:26.647830 22220 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:26.653663 22116 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.653985 22229 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:26.654435 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:26.654584 22229 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.655063 22229 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.655349 22155 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:26.598994 22131 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.555217 22036 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:08:26.659157 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.634760 22206 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:26.636605 22084 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.592084 22025 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:08:26.628465 22029 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:26.664996 15762 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.672276 22029 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.672818 22029 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.680538 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.686754 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:26.689716 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.665557 22206 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.695041 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.692548 22115 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.699496 22115 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.699927 22115 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.708472 22115 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.710831 22115 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:26.696134 22121 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:26.716199 22121 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.718703 22036 consensus_queue.cc:1048] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:26.720824 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:26.728463 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.689038 22117 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.664592 22131 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:26.737882 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 333947us
I20260709 13:08:26.697379 22206 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.756096 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:26.789597 15714 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.758373 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.760314 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:26.764811 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 44080us
I20260709 13:08:26.791040 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:26.791692 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 194920us
I20260709 13:08:26.795297 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.801863 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:26.802071 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.802608 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:26.803499 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.807169 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.808837 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.811065 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:26.812894 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.813129 15762 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:26.819070 15714 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:26.820254 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:26.822392 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.823382 15790 raft_consensus.cc:2368] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19.
I20260709 13:08:26.787492 21937 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:26.826498 21937 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:26.828680 21937 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:26.804034 22130 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:26.835253 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:26.812606 22001 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.812431 22115 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:26.836375 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:26.821854 22069 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:26.834945 22214 log.cc:927] Time spent T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.247s	user 0.003s	sys 0.001s
I20260709 13:08:26.834900 22117 raft_consensus.cc:2804] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:26.825316 22097 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:26.840049 21997 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:26.839644 22115 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:26.876886 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 391515us
I20260709 13:08:26.881202 15714 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:08:26.881330 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 192875us
I20260709 13:08:26.858237 22121 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:26.852208 22069 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:27.001818 15715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2393) took 1294 ms. Trace:
I20260709 13:08:26.861181 22001 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:26.888983 15719 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:26.889039 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:26.864336 22117 raft_consensus.cc:697] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:26.879127 22115 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.879308 22053 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:27.001286 22231 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:08:27.002380 15715 rpcz_store.cc:276] 0709 13:08:25.707266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.707390 (+   124us) service_pool.cc:224] Handling call
0709 13:08:25.707749 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.914181 (+206432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.914227 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.914818 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.131200 (+216382us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:26.131238 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.241328 (+110090us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001e6c54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:26.241402 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.798137 (+556735us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:27.001520 (+203383us) raft_consensus.cc:1685] finished
0709 13:08:27.001547 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.001731 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":883,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6374,"spinlock_wait_cycles":487641856,"thread_start_us":185180,"threads_started":1,"wal-append.queue_time_us":498764}
I20260709 13:08:27.032974 21849 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:27.052467 22226 log.cc:927] Time spent T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:08:27.040889 22041 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:27.041522 22001 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:27.102660 22033 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.002s
I20260709 13:08:27.133200 22228 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:27.173849 22228 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:27.107048 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 314136us
I20260709 13:08:27.045186 22163 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
W20260709 13:08:27.138478 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 350284us
W20260709 13:08:27.186069 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 298422us
W20260709 13:08:27.189168 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 368989us
I20260709 13:08:27.114434 22245 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:27.230297 22245 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.233053 22245 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.234534 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.235435 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:27.238437 22245 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:27.182257 22200 log.cc:927] Time spent T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.052s	user 0.005s	sys 0.001s
I20260709 13:08:27.245836 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.303637 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:27.311427 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 72636.6us
I20260709 13:08:27.285229 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.241345 22131 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:27.315364 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.183071 22033 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.323897 15790 raft_consensus.cc:2410] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:27.186911 22069 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:27.304827 22224 log.cc:927] Time spent T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.463s	user 0.001s	sys 0.000s
W20260709 13:08:27.333541 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 444575us
I20260709 13:08:27.131628 22041 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.276680 22245 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:27.341677 15789 raft_consensus.cc:1275] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:08:27.335317 22222 log.cc:927] Time spent T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 13:08:27.346807 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:27.349009 16297 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:27.332917 22247 raft_consensus.cc:476] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:27.356046 15794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 3123) took 1695 ms. Trace:
I20260709 13:08:27.288192 22246 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:08:27.362855 15685 leader_election.cc:400] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19.
I20260709 13:08:27.369428 15685 leader_election.cc:403] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.356459 15794 rpcz_store.cc:276] 0709 13:08:25.660527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.660680 (+   153us) service_pool.cc:224] Handling call
0709 13:08:25.672784 (+ 12104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.673136 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.673166 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.673677 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.927610 (+253933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:26.253058 (+325448us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b18003289c0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad222fbe07 00007fad2b156ab9 00007fad2231869b 00007fad2231693f 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:08:26.635383 (+382325us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.653491 (+ 18108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.656762 (+  3271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.862758 (+205996us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:27.355841 (+493083us) raft_consensus.cc:1685] finished
0709 13:08:27.355863 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.355989 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21930,"prepare.queue_time_us":53829,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1796,"raft.queue_time_us":18244,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":188,"spinlock_wait_cycles":55632896,"thread_start_us":635542,"threads_started":2,"wal-append.queue_time_us":436093}
I20260709 13:08:27.351073 22097 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.256507 22117 consensus_queue.cc:237] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.359326 22247 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.361084 21953 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:27.374657 22135 consensus_meta.cc:287] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.000s
I20260709 13:08:27.332394 22001 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:27.410058 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61108.4us
I20260709 13:08:27.355335 22254 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:27.401643 22257 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.418263 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 813) took 1207 ms. Trace:
I20260709 13:08:27.422199 15639 rpcz_store.cc:276] 0709 13:08:26.210594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.210740 (+   146us) service_pool.cc:224] Handling call
0709 13:08:26.211116 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.211554 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.211596 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:26.212225 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 13:08:26.683976 (+471751us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:26.684017 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.684087 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.417952 (+733865us) raft_consensus.cc:1685] finished
0709 13:08:27.417981 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.418180 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1392,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":471352,"threads_started":1,"wal-append.queue_time_us":600385}
I20260709 13:08:27.424041 22153 consensus_queue.cc:1048] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:27.424592 22159 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.425096 22159 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:27.426862 22242 log.cc:927] Time spent T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:27.427623 22115 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.427933 15638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2731) took 1037 ms. Trace:
W20260709 13:08:27.428597 22238 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:08:27.429459 22252 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:08:27.407109 22097 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:27.428612 15638 rpcz_store.cc:276] 0709 13:08:26.390080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.499165 (+109085us) service_pool.cc:224] Handling call
0709 13:08:26.499585 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.548793 (+ 49208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.548823 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.592299 (+ 43476us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.102357 (+510058us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:27.102437 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.102588 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.427712 (+325124us) raft_consensus.cc:1685] finished
0709 13:08:27.427733 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.427875 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52118,"raft.queue_time_us":48697,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":35913,"thread_start_us":443897,"threads_started":1,"wal-append.queue_time_us":724724}
W20260709 13:08:27.446633 22239 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:08:27.448582 22033 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.414482 22255 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19.
I20260709 13:08:27.451997 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2733) took 1050 ms. Trace:
I20260709 13:08:27.452567 15646 rpcz_store.cc:276] 0709 13:08:26.402277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.505397 (+103120us) service_pool.cc:224] Handling call
0709 13:08:26.506143 (+   746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.547850 (+ 41707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.547879 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.580257 (+ 32378us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.890004 (+309747us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:26.890060 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.890218 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.451706 (+561488us) raft_consensus.cc:1685] finished
0709 13:08:27.451736 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.451920 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5311,"raft.queue_time_us":6191,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":110,"thread_start_us":255096,"threads_started":1,"wal-append.queue_time_us":573989}
W20260709 13:08:27.456489 22229 consensus_meta.cc:287] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.000s
I20260709 13:08:27.458930 22041 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:27.460156 22084 consensus_meta.cc:287] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
W20260709 13:08:27.460335 22029 consensus_meta.cc:287] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.004s
I20260709 13:08:27.460580 22084 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.461146 22029 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.461817 15720 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:27.464334 22029 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:27.465600 22232 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:08:27.468343 15644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2717) took 1108 ms. Trace:
W20260709 13:08:27.468679 22244 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:08:27.468720 15644 rpcz_store.cc:276] 0709 13:08:26.359832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.360109 (+   277us) service_pool.cc:224] Handling call
0709 13:08:26.373938 (+ 13829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.387668 (+ 13730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.387718 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:26.401376 (+ 13658us) log.cc:844] Serialized 52 byte log entry
0709 13:08:26.739951 (+338575us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:26.791688 (+ 51737us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.027618 (+235930us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.027879 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.027962 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.468094 (+440132us) raft_consensus.cc:1685] finished
0709 13:08:27.468117 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.468277 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123009,"prepare.queue_time_us":55028,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":69686,"raft.run_cpu_time_us":545,"raft.run_wall_time_us":69478,"spinlock_wait_cycles":740224,"thread_start_us":394766,"threads_started":2,"wal-append.queue_time_us":612872}
I20260709 13:08:27.410001 22135 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.445461 22097 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.481670 15796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 3133) took 1576 ms. Trace:
I20260709 13:08:27.457168 22229 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:27.509791 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 263297us
I20260709 13:08:27.493022 15796 rpcz_store.cc:276] 0709 13:08:25.905102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.905658 (+   556us) service_pool.cc:224] Handling call
0709 13:08:25.906015 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.906302 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.906332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.912526 (+  6194us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.120213 (+207687us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:26.128871 (+  8658us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.129136 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.129237 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.462916 (+333679us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18000afa20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:27.478482 (+1015566us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b18000afa20. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:27.481332 (+  2850us) raft_consensus.cc:1685] finished
0709 13:08:27.481367 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.481580 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92227,"prepare.queue_time_us":8367,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1779,"raft.queue_time_us":6334,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":7378,"spinlock_wait_cycles":61034240,"thread_start_us":195086,"threads_started":1,"wal-append.queue_time_us":630848}
I20260709 13:08:27.484620 22135 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.507318 22115 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:27.513258 22256 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:27.514835 22084 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.513312 22068 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:27.517938 22041 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.495577 22097 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.523334 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.525053 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:27.525682 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:27.529105 15545 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.547192 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:27.542295 22249 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:27.541965 22248 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.440212 22257 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.548579 22235 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.543502 22009 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.559410 22256 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.572671 22249 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.542793 22029 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:27.582937 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 220217us
I20260709 13:08:27.559681 21997 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:27.600340 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53209.4us
I20260709 13:08:27.603665 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:27.605201 15760 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:27.558912 22155 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.611153 15760 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:27.562840 22068 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:27.607678 22206 consensus_meta.cc:287] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.001s
I20260709 13:08:27.622279 22205 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.627777 22068 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:27.565083 22041 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.628376 22159 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.630494 22041 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:27.599278 22235 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.607188 22115 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:27.634492 22229 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.621074 22255 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
I20260709 13:08:27.540083 22245 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.640188 15796 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:27.643106 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:27.643637 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 132157us
I20260709 13:08:27.609457 22116 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:27.653064 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.652779 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.614105 22131 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.660876 15789 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:27.657295 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:27.656037 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 44981.3us
I20260709 13:08:27.657924 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:27.659319 15640 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:08:27.660879 15643 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:08:27.664032 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:27.665304 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.658625 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:27.666363 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:27.667127 15645 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:27.599551 22009 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.672217 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.672418 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.664605 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.673075 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.673399 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.673838 15715 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:27.633587 22235 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.680498 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:27.610561 22029 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.610769 21997 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.676592 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:27.678140 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:27.703714 15644 raft_consensus.cc:2410] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:27.675486 15638 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:27.691092 22254 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:27.692903 15760 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:27.693425 22249 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.580868 22248 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.711583 15639 raft_consensus.cc:2376] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19. Re-sending same reply.
I20260709 13:08:27.662866 22261 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:27.655445 22260 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:27.700816 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.613308 22155 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.726588 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.704699 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.708081 15788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2869) took 1070 ms. Trace:
I20260709 13:08:27.663419 22053 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.697288 21849 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.661391 22257 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.671881 22138 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:27.719274 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:27.644177 22206 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.728534 15646 raft_consensus.cc:2410] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:27.716176 22246 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.723421 22247 consensus_queue.cc:1059] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:08:27.728896 15788 rpcz_store.cc:276] 0709 13:08:26.637557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.645565 (+  8008us) service_pool.cc:224] Handling call
0709 13:08:26.645953 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.647427 (+  1474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.647466 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.490985 (+843519us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:08:27.491416 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.620096 (+128680us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:27.620137 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.620202 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.699137 (+ 78935us) raft_consensus.cc:1685] finished
0709 13:08:27.699158 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.708014 (+  8856us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020,"raft.queue_time_us":1542,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":27095424,"thread_start_us":128307,"threads_started":1,"wal-append.queue_time_us":171016}
I20260709 13:08:27.733197 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:27.723650 22166 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:27.733556 22248 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.775158 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.736752 22186 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.706661 22245 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:27.752019 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.792223 15794 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:27.755538 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.751272 15610 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:27.758334 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:27.726490 21690 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:27.779659 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:27.750084 22249 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.794064 15640 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:27.794121 15644 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:27.798849 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:27.798931 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:27.800083 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:27.760744 21849 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.758798 22163 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:27.801276 21690 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.768635 22246 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:27.806252 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 55131.6us
I20260709 13:08:27.806545 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.712667 22254 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.770502 22236 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:27.795389 22098 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:27.793972 22159 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.837566 15794 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:27.760411 22053 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.769320 22138 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.815110 22246 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.836253 22098 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:27.742588 22260 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.857659 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.779045 22166 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.860924 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:27.822269 22274 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.805699 22249 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.873716 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:27.869952 15718 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
W20260709 13:08:27.853892 22264 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:08:27.882084 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:27.859616 22265 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 13:08:27.863440 22202 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.747s	user 0.016s	sys 0.002s
I20260709 13:08:27.883221 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.814918 22163 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.851276 22009 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.893569 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.894671 15788 raft_consensus.cc:2393] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 19: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:08:27.895479 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 76986.7us
I20260709 13:08:27.898942 22098 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.901335 22053 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.902172 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.902984 22029 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.903304 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:27.903887 15721 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:27.904398 22259 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:27.904786 22259 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:27.909880 15638 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:27.876590 22187 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.885327 22270 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:27.918457 21849 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:27.919538 22163 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:27.919796 22254 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.881186 22247 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:27.906513 22084 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.882030 22255 consensus_queue.cc:1059] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:27.923380 22084 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:27.923784 22084 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:27.922564 22247 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:27.887291 22186 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.897902 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.838833 22236 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.905594 22259 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:27.936730 22259 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.928328 22187 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.938158 15792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 3128) took 2232 ms. Trace:
I20260709 13:08:27.939206 22084 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.940632 22084 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:27.943245 22273 log.cc:927] Time spent T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:08:27.944980 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.946461 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.949231 22236 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:27.947696 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.938588 15792 rpcz_store.cc:276] 0709 13:08:25.705909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.706126 (+   217us) service_pool.cc:224] Handling call
0709 13:08:25.706470 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.717615 (+ 11145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.717653 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.718229 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.932142 (+213913us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:25.993180 (+ 61038us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.993465 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.993800 (+   335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.705622 (+1711822us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:27.937823 (+232201us) raft_consensus.cc:1685] finished
0709 13:08:27.937928 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.938072 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59582,"prepare.queue_time_us":65979,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":13711,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":6071,"spinlock_wait_cycles":105232640,"thread_start_us":213504,"threads_started":1,"wal-append.queue_time_us":393391}
I20260709 13:08:27.953707 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.954344 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:27.954818 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.955749 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.955977 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.956640 15792 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:27.959549 15792 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:27.988389 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.930199 21690 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:27.989353 22277 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:27.989464 15788 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:27.929872 22247 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:27.991214 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:27.991861 15791 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:27.993084 22247 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.003978 15644 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:28.018620 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.019568 16331 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:28.022349 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 161497us
I20260709 13:08:28.024343 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.024935 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.035715 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.036520 15644 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:28.030478 22166 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.033285 22053 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.047415 15644 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 20.
I20260709 13:08:28.050601 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.051920 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.052623 15644 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.054925 22258 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.055519 22258 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:28.057219 22267 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
I20260709 13:08:28.065166 15644 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:28.066385 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.067137 15644 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 13.
I20260709 13:08:28.067585 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.068509 15646 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.067974 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.069190 15644 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:28.070070 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.070742 15644 raft_consensus.cc:2368] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 20. Current term is 21.
I20260709 13:08:28.071491 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.072638 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.073809 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.078866 22138 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:28.080334 22249 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:28.082886 22240 log.cc:927] Time spent T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.742s	user 0.002s	sys 0.001s
I20260709 13:08:28.086222 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2405) took 1309 ms. Trace:
I20260709 13:08:28.086851 15720 rpcz_store.cc:276] 0709 13:08:26.777025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.777160 (+   135us) service_pool.cc:224] Handling call
0709 13:08:26.777476 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.462368 (+684892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.085903 (+623535us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400438d54. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:28.086145 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573339392}
I20260709 13:08:28.094700 22155 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:28.095454 22260 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.095866 22190 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.096904 22190 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.048408 22246 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.051910 22053 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.111879 15646 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
W20260709 13:08:28.115443 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 91996.9us
I20260709 13:08:28.116251 15688 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.119318 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:28.121702 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.122699 16331 raft_consensus.cc:2393] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:28.121032 15714 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:28.127734 22053 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.130491 22258 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.133967 22290 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.134428 22290 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.134806 22290 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.135514 22246 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.138415 15792 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:28.124022 22126 consensus_queue.cc:1059] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:28.148064 22187 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.145639 22247 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.152192 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:28.152745 15539 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 279) took 49265 ms (client timeout 15000 ms). Trace:
I20260709 13:08:28.108305 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.167104 16331 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:28.170552 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2870) took 1522 ms. Trace:
I20260709 13:08:28.170958 15787 rpcz_store.cc:276] 0709 13:08:26.648290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.648408 (+   118us) service_pool.cc:224] Handling call
0709 13:08:26.648720 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.649097 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.649127 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.999408 (+1350281us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:08:28.000085 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 13:08:28.041546 (+ 41461us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:28.146910 (+105364us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.147240 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.147339 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.147395 (+    56us) raft_consensus.cc:1685] finished
0709 13:08:28.170349 (+ 22954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.170495 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120649,"raft.queue_time_us":449,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":9249,"spinlock_wait_cycles":40229888,"thread_start_us":40247,"threads_started":1,"wal-append.queue_time_us":107275}
I20260709 13:08:28.173580 15545 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 14 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.175043 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:08:28.177008 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 53809.5us
I20260709 13:08:28.179580 22262 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.180177 22262 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.180887 22036 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:28.181443 21726 raft_consensus.cc:3055] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:28.181859 21726 raft_consensus.cc:740] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:28.182353 22262 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.170383 22163 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:28.190881 15688 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.186486 15545 catalog_manager.cc:5697] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 15, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.179126 22126 consensus_queue.cc:1243] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:28.196969 22288 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.198173 22247 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:28.198611 22247 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:28.199406 22247 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.182710 21726 consensus_queue.cc:260] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.201220 22084 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:28.201619 21726 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:28.153151 15539 rpcz_store.cc:269] 0709 13:07:38.887344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.889981 (+  2637us) service_pool.cc:224] Handling call
0709 13:08:28.152642 (+49262661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:21.753886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:21.754670 (+   784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:21.754721 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:08:21.754740 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:21.755809 (+  1069us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:21.755928 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:21.755958 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:21.756836 (+   878us) tablet.cc:701] Row locks acquired
0709 13:08:21.756884 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:08:21.757050 (+   166us) write_op.cc:270] Start()
0709 13:08:21.757237 (+   187us) write_op.cc:276] Timestamp: P: 1783602501756979 usec, L: 0
0709 13:08:21.757271 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:21.825594 (+ 68323us) log.cc:844] Serialized 3568 byte log entry
0709 13:08:22.606476 (+780882us) op_driver.cc:464] REPLICATION: finished
0709 13:08:22.836613 (+230137us) write_op.cc:301] APPLY: starting
0709 13:08:22.836731 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:22.844766 (+  8035us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:22.844893 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:22.867155 (+ 22262us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:22.867548 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:08:22.867619 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:22.868020 (+   401us) log.cc:844] Serialized 89 byte log entry
0709 13:08:22.869024 (+  1004us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:22.869168 (+   144us) write_op.cc:454] Released schema lock
0709 13:08:22.869235 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:22.869760 (+   525us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:22.869796 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":84241,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":171369,"apply.run_cpu_time_us":14179,"apply.run_wall_time_us":45846,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":172114,"prepare.run_cpu_time_us":53130,"prepare.run_wall_time_us":369621,"raft.queue_time_us":275516,"raft.run_cpu_time_us":31677,"raft.run_wall_time_us":286714,"replication_time_us":786229,"spinlock_wait_cycles":3456,"thread_start_us":464998,"threads_started":4,"wal-append.queue_time_us":289878,"wal-append.run_cpu_time_us":48888,"wal-append.run_wall_time_us":1818816}]]}
I20260709 13:08:28.209964 22025 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.210554 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.211304 22033 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:28.211705 22033 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:28.194738 15545 catalog_manager.cc:5697] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.212541 22033 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.216791 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.213567 22033 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.217585 22288 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.215762 15545 catalog_manager.cc:5697] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.222970 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.194696 22163 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.233057 15641 raft_consensus.cc:1240] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:28.233211 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.232265 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.225113 22036 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.235390 15545 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.238415 15688 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:28.240322 22266 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.606s	user 0.000s	sys 0.002s
I20260709 13:08:28.240636 22245 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:28.231825 22288 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.242708 22179 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.242331 22163 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.243876 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:28.245154 22205 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:28.255111 15545 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:28.257112 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.260522 15789 raft_consensus.cc:606] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:28.260952 15789 raft_consensus.cc:614] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:28.257495 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.259006 22179 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:28.262938 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.264886 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.252946 22036 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.267180 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.267797 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.269618 15688 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:08:28.300108 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.267518 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.327878 22190 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.331374 22190 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:28.335546 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66045.2us
I20260709 13:08:28.335836 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.336581 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.339272 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:28.346509 15719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47706 (request call id 2402) took 1587 ms (client timeout 1891 ms). Trace:
W20260709 13:08:28.347024 15719 rpcz_store.cc:269] 0709 13:08:26.759590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.764221 (+  4631us) service_pool.cc:224] Handling call
0709 13:08:28.346305 (+1582084us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b5400179dd4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:28.346450 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198311296}
I20260709 13:08:28.348084 22098 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.348310 15641 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:28.346149 22233 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.348925 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:28.353355 15793 raft_consensus.cc:606] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:28.336539 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.259773 22245 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:28.355520 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42130 (request call id 2729) took 1966 ms. Trace:
I20260709 13:08:28.262743 22205 raft_consensus.cc:3060] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.356150 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56124 (request call id 3140) took 1923 ms. Trace:
I20260709 13:08:28.357375 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.357966 15647 rpcz_store.cc:276] 0709 13:08:26.388776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.489810 (+101034us) service_pool.cc:224] Handling call
0709 13:08:26.490262 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.490825 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.490860 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:26.510570 (+ 19710us) log.cc:844] Serialized 52 byte log entry
0709 13:08:26.875481 (+364911us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:26.886966 (+ 11485us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.490655 (+603689us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18000c5020. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad292da58f 00007fad22319571 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd
0709 13:08:28.081971 (+591316us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:28.106164 (+ 24193us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:08:28.354823 (+248659us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b18000c5020. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad22293c0a 00007fad2b9d3219 00007fad2231ba40 00007fad223164e4 00007fad22316455 00007fad28dfe3c7 00007fad254109a7 00007fad254200bf 00007fad25420038
0709 13:08:28.355049 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.355286 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.355341 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.355367 (+    26us) raft_consensus.cc:1685] finished
0709 13:08:28.355374 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.355476 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124478,"prepare.queue_time_us":125824,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":115741,"raft.run_cpu_time_us":10215,"raft.run_wall_time_us":1643995,"spinlock_wait_cycles":176133376,"thread_start_us":237955,"threads_started":1,"wal-append.queue_time_us":726812}
I20260709 13:08:28.361342 15647 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:28.357090 15545 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 19, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 19 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.358609 15795 rpcz_store.cc:276] 0709 13:08:26.433235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.433908 (+   673us) service_pool.cc:224] Handling call
0709 13:08:26.466391 (+ 32483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.591437 (+125046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.591483 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.482396 (+890913us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b2c00117438. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad23cffa11 00007fad23d0f372 00007fad25441a01 00007fad2540643a 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2
0709 13:08:27.482967 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.552969 (+ 70002us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:27.553023 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.553090 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.239726 (+686636us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:28.355908 (+116182us) raft_consensus.cc:1685] finished
0709 13:08:28.355926 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.356100 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132686,"raft.queue_time_us":127102,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3340,"spinlock_wait_cycles":45793408,"thread_start_us":69528,"threads_started":1,"wal-append.queue_time_us":151168}
I20260709 13:08:28.354840 22155 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.266040 22183 consensus_queue.cc:1059] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:08:28.266040 22126 consensus_queue.cc:1059] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.093s
I20260709 13:08:28.356757 22163 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.369545 15545 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 15, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.357699 22272 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.353780 22290 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.372941 22179 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.363739 22053 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.375684 15545 catalog_manager.cc:5697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.377699 15545 catalog_manager.cc:5697] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.379022 15545 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 17, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 17 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.380432 15545 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.381307 15545 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.382548 15545 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 16, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 16 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.383576 15545 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.371937 22190 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:28.385092 15545 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 12, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.376168 22272 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.406104 22245 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.412384 15545 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.369716 22155 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.427330 22290 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:28.429785 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:28.430868 16329 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.432467 15545 catalog_manager.cc:5697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 4 to 12, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.435012 15545 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 15, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:28.438956 22237 log.cc:927] Time spent T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 1.103s	user 0.000s	sys 0.003s
I20260709 13:08:28.445334 15545 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.456122 15643 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.464079 15545 catalog_manager.cc:5697] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.473565 15545 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:28.481086 16329 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:28.484699 15685 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:28.473474 22098 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.501539 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.501890 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.502202 15645 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
W20260709 13:08:28.501564 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.498662 22263 raft_consensus.cc:3055] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:28.504112 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.499907 22126 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:28.501024 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.504948 15645 raft_consensus.cc:2410] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:28.498385 15545 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.506574 15641 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:28.510125 15545 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 12, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 12 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.504347 22098 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.507608 22259 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:28.512817 22259 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.513587 22098 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.515151 22259 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.482648 22272 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.518957 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.519554 15641 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:28.504478 22025 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.504379 22263 raft_consensus.cc:740] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:28.521680 15545 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 8 to 9, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 9 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.524690 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.518479 22126 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:28.521332 22256 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.528488 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:28.526641 15545 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.532783 22205 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.543726 22205 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.526479 22025 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.547084 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.547739 15641 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:28.528059 22183 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:28.546073 22303 log.cc:927] Time spent T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:08:28.548043 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:28.549477 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.552636 15545 catalog_manager.cc:5697] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:28.582180 22262 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:28.582753 22262 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.583170 22262 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.553654 22126 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.586511 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.587188 15718 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 13.
I20260709 13:08:28.588755 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.589092 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.589368 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.589699 15718 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:28.555892 22206 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.589092 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.590575 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.591127 15715 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:28.556881 22205 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.593058 22205 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:28.594105 22205 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.595172 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.595748 15639 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:28.595810 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.596444 15640 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 14.
I20260709 13:08:28.596658 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.597002 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.559183 22247 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.597640 22206 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:28.598143 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.598423 22206 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.573278 22155 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.600523 22206 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:28.561731 21997 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.562597 22263 consensus_queue.cc:260] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.568600 22260 raft_consensus.cc:3055] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:28.602169 22260 raft_consensus.cc:740] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:28.603163 22260 consensus_queue.cc:260] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.604530 22260 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.589969 15713 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:28.592260 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.558310 22025 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.597283 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.596601 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:28.613065 21690 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.615701 22163 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.615885 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:28.616516 22163 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.621275 22163 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.622087 21690 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.624449 22263 raft_consensus.cc:3060] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:28.625478 21690 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.628589 15688 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.629449 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.630683 22254 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.631125 22254 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.631439 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.632040 22290 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:28.632314 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.632438 22290 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.632854 22290 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.633056 22033 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:28.633463 22033 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.633862 22033 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:28.635500 22255 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:28.635910 22255 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.636286 22255 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:28.605631 22300 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.379s	user 0.000s	sys 0.003s
I20260709 13:08:28.644246 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.645455 15716 raft_consensus.cc:2393] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:28.646083 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:28.646790 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.649017 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.653359 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.655570 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.656383 15721 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 14: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:28.656154 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.657132 22033 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.657796 15717 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:28.659060 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:28.659363 22033 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.659678 15790 raft_consensus.cc:606] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:28.660027 15790 raft_consensus.cc:614] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:28.662286 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.665197 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:28.666051 15641 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:28.668078 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:28.670920 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 121531us
I20260709 13:08:28.672050 15762 leader_election.cc:400] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 20. Current term is 21.
I20260709 13:08:28.672427 15762 leader_election.cc:403] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.685971 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.686968 15794 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:28.690531 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.691901 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.676009 15611 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:28.699277 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.700748 16331 raft_consensus.cc:2393] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 20: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:28.701612 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.702603 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.631482 22254 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.703919 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:28.705096 15611 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.712368 15611 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.713224 16300 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:28.714298 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:28.715399 22259 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:28.716814 22251 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.717046 22187 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.700917 22272 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.717787 22167 raft_consensus.cc:2804] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:28.717937 21937 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.718492 22167 raft_consensus.cc:697] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:28.719396 22167 consensus_queue.cc:237] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.698611 22246 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:28.720803 22246 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.721166 22246 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.721318 15715 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:28.722028 15719 raft_consensus.cc:1240] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:28.700680 22179 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.722062 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:28.714960 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.724373 15718 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:28.725498 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.725955 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.726655 15717 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:28.726891 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:28.727705 15790 raft_consensus.cc:606] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:28.722366 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.714920 16331 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 14.
I20260709 13:08:28.731839 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:28.733073 15641 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:28.735529 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:28.736346 15716 raft_consensus.cc:2393] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:28.736202 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.737869 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:28.738554 15611 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.709525 22271 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.725539 21997 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:28.743882 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 46211.9us
W20260709 13:08:28.744791 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.744863 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:28.740509 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:28.759063 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.742775 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:28.745296 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:28.750078 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.707876 22130 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 20. Current term is 21.
I20260709 13:08:28.779814 22256 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:28.782101 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.739434 22153 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.739598 22190 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:28.743270 22187 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.735831 22135 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.756263 22117 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:08:28.801288 22117 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:28.801681 22117 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:28.802577 22117 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.804541 22117 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:28.794782 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.808956 22236 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.809597 22236 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.810204 22288 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.813910 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.784194 22179 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:28.836364 15717 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.797711 22206 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:28.798748 22258 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.810931 22288 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.797242 22153 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:28.813194 22135 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.799178 22187 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:28.782936 22255 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.830166 22190 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:28.833355 22053 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:28.838356 22179 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.842844 22284 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:28.866966 22187 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.862164 22153 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.938546 22053 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:28.952833 22290 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.954511 22288 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.954838 22236 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:28.957990 22190 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:28.890859 22135 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.928804 22284 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:28.981438 22316 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.173s	user 0.000s	sys 0.006s
I20260709 13:08:28.997511 15718 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:28.986016 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 267190us
I20260709 13:08:28.930105 22179 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.890144 22258 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:29.005123 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 191283us
I20260709 13:08:29.006320 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:28.995880 22284 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.008333 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:29.008744 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:28.857514 22206 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:29.002395 22053 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.014137 22163 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.014390 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.016156 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:29.020375 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 277672us
I20260709 13:08:29.010977 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.011499 22167 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:29.032955 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.046380 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:29.034124 15762 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.048089 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:29.048954 15792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a882c727204be4b66080704cceb833"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:29.058491 15792 raft_consensus.cc:606] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:29.059459 22323 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 13:08:29.060582 22155 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:29.023911 22206 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:29.061117 22155 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.061537 22155 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:29.050150 22166 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.055001 22290 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.044235 22205 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.056243 22255 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.019022 22256 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:29.063344 22256 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:29.063577 22251 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:29.063894 22256 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.064205 22251 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.066725 22251 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.054152 21937 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:29.068269 21937 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.068697 21937 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:29.070706 22313 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.269s	user 0.000s	sys 0.003s
I20260709 13:08:29.070537 22262 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.072136 22259 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:29.072741 22262 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.072876 22259 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:29.076907 22314 log.cc:927] Time spent T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.269s	user 0.001s	sys 0.002s
I20260709 13:08:29.078027 22322 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:29.079200 22322 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:29.079550 22322 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:29.080404 22322 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.081322 15714 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 20.
I20260709 13:08:29.088405 15790 raft_consensus.cc:1240] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:29.089351 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.089980 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.090364 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.090734 15789 raft_consensus.cc:2368] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17.
I20260709 13:08:29.091081 15794 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:29.086750 15721 raft_consensus.cc:2468] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
W20260709 13:08:29.095388 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 47455.9us
I20260709 13:08:29.097407 15760 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:29.097712 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.099579 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.028084 22260 consensus_queue.cc:1059] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:08:29.094555 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:29.095750 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.104323 15717 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:29.033347 22163 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:29.081648 22322 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.112323 15795 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:29.118254 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.094903 22263 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:29.101778 22259 raft_consensus.cc:2804] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:29.122978 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.111955 22260 consensus_queue.cc:1243] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:29.134931 15717 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:29.133244 22187 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.138734 22135 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.171674 22187 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.172176 15795 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:29.171696 22135 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.173723 22183 raft_consensus.cc:3055] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:29.174183 22183 raft_consensus.cc:740] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:29.174513 15760 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:29.175011 22183 consensus_queue.cc:260] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.175488 22260 raft_consensus.cc:2804] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:29.176187 22260 raft_consensus.cc:697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:29.176287 22183 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.176523 22001 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:29.177088 22001 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.140640 15641 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:29.141271 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.106254 22254 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.179714 22001 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.181296 22254 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.142550 22153 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.142799 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.183585 15788 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:29.143527 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:29.143579 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.144757 15647 raft_consensus.cc:1275] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:29.145419 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:29.148520 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 391320us
I20260709 13:08:29.195668 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:29.193711 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.142058 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:29.194196 15790 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:29.145349 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:29.149838 22263 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.152992 15642 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:08:29.154222 22317 log.cc:927] Time spent T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 13:08:29.081555 22258 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.155757 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:29.158387 15721 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:29.163021 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:29.153973 22155 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.163236 15792 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:29.164755 21937 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.168021 15685 leader_election.cc:400] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17.
I20260709 13:08:29.208001 15685 leader_election.cc:403] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.136135 22259 raft_consensus.cc:697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:29.181010 22256 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.112756 22272 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:29.142045 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.185850 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:29.199160 15643 raft_consensus.cc:2393] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:29.199823 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:29.201300 15646 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:29.203042 16332 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:29.246455 15717 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:29.206532 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:29.248008 15760 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:29.119606 22163 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.120483 22246 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.213219 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.186791 22083 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:29.208849 22187 raft_consensus.cc:2764] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:08:29.195945 21997 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:29.249858 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50146.9us
I20260709 13:08:29.207131 22135 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:29.255995 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:29.268822 15790 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:29.235464 22254 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17.
I20260709 13:08:29.202277 22284 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.177373 22260 consensus_queue.cc:237] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.244736 22288 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:29.254369 22248 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.234351 22117 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
W20260709 13:08:29.296691 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 285765us
W20260709 13:08:29.204411 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 48741.1us
I20260709 13:08:29.278687 22205 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:29.306419 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.317179 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.254551 22272 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.288765 21997 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.312747 22205 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:29.305177 22288 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.317947 22251 consensus_queue.cc:1048] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:29.355366 22205 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.353794 22053 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:29.409298 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 153132us
I20260709 13:08:29.413421 22155 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.414419 21937 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.415288 22326 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:29.416173 22256 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.415999 22326 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.416741 22247 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:29.418104 21997 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.418406 22153 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.420428 22130 raft_consensus.cc:993] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:29.421002 22130 raft_consensus.cc:1081] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:29.394765 22328 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.426836 22263 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.428215 22247 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:29.428649 22247 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:29.429473 22247 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.430701 22247 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:29.321130 22259 consensus_queue.cc:237] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.436527 22179 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.437695 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.439925 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.440635 15714 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.448472 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.449162 15721 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.449024 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:29.450143 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.459604 15714 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:29.463554 15714 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:08:29.471891 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.474474 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:29.475456 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:29.478566 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:29.496657 15721 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:29.499887 15791 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:29.501636 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:29.503008 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.504914 15714 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:29.504984 22324 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:29.505805 22324 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:29.499620 22155 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:29.535873 16332 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:29.552467 15714 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:29.554375 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:29.564817 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 247726us
I20260709 13:08:29.568323 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:29.566496 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 276535us
I20260709 13:08:29.566402 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.569959 15714 raft_consensus.cc:2368] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:29.571739 15760 leader_election.cc:400] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:29.572253 15760 leader_election.cc:403] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.540611 22247 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.506827 22324 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:29.578930 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.514287 22098 consensus_queue.cc:1059] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 13:08:29.580488 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 314791us
I20260709 13:08:29.567085 22248 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:29.557880 22155 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:29.567175 22246 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.590830 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:29.585887 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.576395 22153 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:29.599692 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:29.604241 16329 raft_consensus.cc:1240] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:29.604369 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:29.563941 22236 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:08:29.586830 22001 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:29.611621 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:29.612202 15646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42130
I20260709 13:08:29.612795 15646 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:29.613171 15646 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.602809 22187 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:29.614264 22246 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.614322 15688 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:29.566300 22331 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 13:08:29.619400 15793 raft_consensus.cc:2410] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:29.630141 16329 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:29.597860 22248 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:29.624689 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 150685us
I20260709 13:08:29.614496 22271 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.605370 22130 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.606513 21937 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.592146 22121 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:29.585459 22247 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.597254 22230 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:08:29.627264 22206 consensus_meta.cc:287] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:08:29.689891 22206 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.691977 22206 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.693958 22247 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:29.698170 22345 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:08:29.699628 22248 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:29.700369 22335 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:08:29.669018 15646 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.609210 22025 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:29.668529 22179 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.683894 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:29.685431 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:29.622622 22290 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:29.687467 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:29.617900 22187 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.616957 22254 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:08:29.716490 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:29.718001 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.724725 16327 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:29.738199 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.670112 21937 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.731485 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:29.617918 22246 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.707098 22121 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:29.742496 15789 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:29.719673 22025 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:29.754163 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.726414 22288 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.732823 22290 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:29.749607 21937 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.748888 22041 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:29.761722 22025 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.720880 22155 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.809196 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:29.757562 22117 consensus_queue.cc:1059] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:08:29.804409 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 60190.1us
I20260709 13:08:29.815603 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:29.831743 15714 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:29.825423 22260 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.846211 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.847695 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.860863 15789 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.855886 22187 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.857101 22246 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:29.858094 22347 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:29.861792 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.871505 15796 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.802652 22041 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.868167 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:29.876214 15714 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:29.839155 22290 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:29.877859 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 62477.3us
I20260709 13:08:29.885123 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:29.881002 22121 raft_consensus.cc:3055] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:29.887089 22121 raft_consensus.cc:740] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:29.887708 22362 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:29.888314 22362 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.888161 22121 consensus_queue.cc:260] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.890785 22362 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.891556 22351 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:29.892175 22351 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.894039 22359 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:29.894721 22359 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.897136 22359 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.899775 22272 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.844007 22179 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:29.900638 22179 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.902036 21726 raft_consensus.cc:493] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:29.902575 21726 raft_consensus.cc:515] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.903195 22179 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.905934 15791 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:29.865144 22350 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:29.872716 22183 consensus_meta.cc:287] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.696s	user 0.016s	sys 0.000s
I20260709 13:08:29.907552 22121 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.916219 15646 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.914479 21726 leader_election.cc:290] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.919209 22097 raft_consensus.cc:3055] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:29.882589 15759 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:29.960155 15787 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:29.919696 22097 raft_consensus.cc:740] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:29.880563 22001 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:29.970482 22041 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:29.911605 22350 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:29.971755 22350 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.973026 22350 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:29.976989 22205 consensus_meta.cc:287] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.000s
I20260709 13:08:29.912240 22352 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.978052 22352 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:29.980522 22352 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:29.866521 22260 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:29.981884 22097 consensus_queue.cc:260] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:29.982874 22344 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:08:29.985323 22260 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:29.989351 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:29.990293 15713 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
W20260709 13:08:29.990767 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.992291 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:29.996613 22053 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:29.997049 22053 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:29.997489 22053 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.009382 15789 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:30.025926 15792 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:30.026108 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:29.977520 22205 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.030885 15638 raft_consensus.cc:1240] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:30.032641 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.033706 15641 raft_consensus.cc:1240] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:30.033849 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.034263 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.034330 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:30.037685 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:30.046376 15645 raft_consensus.cc:2393] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:30.046506 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:30.016289 22117 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.046752 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:30.046905 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.048928 15639 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:30.060454 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.051074 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.061961 15640 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:30.050797 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:30.096642 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45927.9us
I20260709 13:08:30.029021 22254 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.049326 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 166826us
I20260709 13:08:30.040517 22352 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:30.110401 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.115579 15640 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:30.040413 22364 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:30.099566 22245 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.104102 22288 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:30.102715 22351 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.129994 15640 raft_consensus.cc:1217] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-18.10]   Dedup: 14.8->[16.9-18.10]
I20260709 13:08:30.139210 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.218288 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.219213 15639 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:30.220857 15639 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:30.145161 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:30.149366 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931130cafbad4fe6ad371c4a32da2678" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:30.221863 15789 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:30.224149 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:30.225773 15640 pending_rounds.cc:85] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 8
I20260709 13:08:30.226758 15640 pending_rounds.cc:107] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:30.227458 15640 raft_consensus.cc:2889] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.126153 22354 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.108368 22254 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.231618 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.118342 22352 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.232996 22130 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.241631 22247 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.248624 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.249457 16331 raft_consensus.cc:2468] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:30.205431 22288 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.252868 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:30.253381 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 129570us
I20260709 13:08:30.131397 22260 consensus_queue.cc:1059] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:08:30.233661 22098 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:30.204154 22025 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.205682 22245 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.307542 22326 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.308759 22053 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.273102 22367 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.244059 22354 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.280063 22288 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.298602 22183 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:30.253913 22130 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.328903 16333 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.269922 22247 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.303367 22256 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.335851 16327 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:30.311239 22364 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.300626 22098 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.329705 22284 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:30.349261 22369 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:08:30.338344 22256 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:30.344074 22205 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.336496 22183 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.354261 22256 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.331087 22367 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.343500 22364 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:30.365635 22370 log.cc:927] Time spent T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:08:30.367501 22340 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.679s	user 0.004s	sys 0.004s
I20260709 13:08:30.367766 22364 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:30.368350 22371 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.135s	user 0.002s	sys 0.001s
I20260709 13:08:30.358007 22352 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.372946 22354 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.373683 22367 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.405388 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:30.430562 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 310926us
W20260709 13:08:30.432981 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.436489 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.319198 15796 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:30.443291 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:30.442389 15714 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:30.444768 15717 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:30.450237 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.452322 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.453344 15721 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:30.459316 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.462810 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.469515 15714 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:30.472289 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.472644 22025 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.473371 15717 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:30.474566 22025 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.475754 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.475476 22025 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.479099 22025 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.483924 22053 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.488123 22098 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.495954 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:30.502280 22130 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.520056 22187 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:30.521777 22247 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.503892 22155 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.523366 22245 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.523109 22155 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.524439 15717 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:30.525319 22248 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.526388 22248 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:30.526976 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.526942 22248 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:30.512377 22163 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: Time spent flushing consensus metadata: real 1.229s	user 0.014s	sys 0.004s
I20260709 13:08:30.526428 22155 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.515872 22179 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:30.541810 15717 raft_consensus.cc:2410] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:30.547360 22183 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.535058 22163 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.549950 16329 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.550516 22254 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.551378 22163 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.559775 22155 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:30.565366 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.590960 15718 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:30.602882 22001 raft_consensus.cc:993] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:30.603698 22001 raft_consensus.cc:1081] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:30.604784 22155 consensus_queue.cc:1059] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:30.605940 22155 raft_consensus.cc:3055] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:30.606403 22155 raft_consensus.cc:740] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:30.607918 22155 consensus_queue.cc:260] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.610617 15760 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:30.613174 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:30.614533 22392 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:30.609720 22155 raft_consensus.cc:3060] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.616623 22392 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.622315 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:30.636001 22121 consensus_meta.cc:287] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.012s
I20260709 13:08:30.640981 15718 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
W20260709 13:08:30.645865 22350 consensus_meta.cc:287] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.671s	user 0.014s	sys 0.008s
I20260709 13:08:30.646780 15645 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
W20260709 13:08:30.678987 21937 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.878s	user 0.019s	sys 0.014s
I20260709 13:08:30.679750 21937 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.682336 15641 raft_consensus.cc:2368] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15.
W20260709 13:08:30.686708 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 73731us
I20260709 13:08:30.690104 22121 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.690651 22121 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.691068 22121 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.691123 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:30.692303 22117 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:30.692960 22117 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:30.692953 22179 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.694077 22179 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:30.724568 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 49755.3us
I20260709 13:08:30.733338 22378 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:30.734186 22378 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.736550 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:30.737718 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 500340us
I20260709 13:08:30.729987 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.740044 16331 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:30.741904 22327 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:30.742766 22327 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:30.744432 22327 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.748914 22246 raft_consensus.cc:993] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:30.749675 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:30.750885 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.748608 16333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1285) took 1064 ms. Trace:
I20260709 13:08:30.750479 22256 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.764499 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.694495 22117 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.749634 22246 raft_consensus.cc:1081] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:30.778316 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.779184 16332 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:30.782025 22288 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.783164 22256 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.783591 15713 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:30.774214 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.790050 22394 raft_consensus.cc:3055] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:30.790187 21937 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.790580 22394 raft_consensus.cc:740] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:30.791162 22121 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.792022 22394 consensus_queue.cc:260] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:30.795002 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.795745 22288 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.797911 22394 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.803138 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:30.803530 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.804289 16334 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:30.810034 22378 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.730192 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
W20260709 13:08:30.810951 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 80972us
I20260709 13:08:30.811213 22255 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:30.811749 22255 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.812168 22255 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.818126 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.819018 16327 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:30.819492 22357 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.819746 16329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56442 (request call id 1282) took 1147 ms. Trace:
I20260709 13:08:30.786883 22392 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.835254 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:30.836784 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.837464 15721 raft_consensus.cc:1275] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:30.836858 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:30.839066 15644 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:30.768574 22248 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.828526 22121 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.753480 16333 rpcz_store.cc:276] 0709 13:08:29.684213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.685830 (+  1617us) service_pool.cc:224] Handling call
0709 13:08:29.686130 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.337075 (+650945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.747778 (+410703us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54004d85d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:30.748395 (+   617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477554560}
I20260709 13:08:30.820142 16329 rpcz_store.cc:276] 0709 13:08:29.672375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.673231 (+   856us) service_pool.cc:224] Handling call
0709 13:08:29.673656 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.550574 (+876918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.819430 (+268856us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b540066e4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:30.819690 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013891840}
I20260709 13:08:30.849212 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.844754 15685 leader_election.cc:304] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:30.848840 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:30.847108 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:30.853049 15787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56120 (request call id 2907) took 1681 ms. Trace:
I20260709 13:08:30.853675 15714 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.854012 15642 raft_consensus.cc:2468] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:30.853539 15787 rpcz_store.cc:276] 0709 13:08:29.139143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.179288 (+ 40145us) service_pool.cc:224] Handling call
0709 13:08:29.179548 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.960706 (+781158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.801352 (+840646us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54001faed4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:30.801729 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793976192}
I20260709 13:08:30.840497 22392 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.853104 22260 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.820225 22357 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.857959 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:30.860931 22260 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.874264 15721 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:30.875012 22097 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.875465 22260 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.879779 22135 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:30.865888 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.866567 22339 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:30.882546 22339 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.866866 22366 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:30.884490 22366 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.867770 22001 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.871272 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:30.871769 21937 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.871443 22341 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:08:30.865103 22179 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.906440 16327 raft_consensus.cc:1240] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:30.856678 22098 raft_consensus.cc:2749] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:30.839980 15645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42130
W20260709 13:08:30.910301 15761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.026s	sys 0.011s
I20260709 13:08:30.922101 22001 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.937274 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:30.938491 15787 raft_consensus.cc:2410] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:30.939800 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:30.941650 22246 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:30.941910 22187 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:30.942445 22246 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.923854 22183 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:30.942782 22187 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.943593 22183 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.944787 22246 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.946403 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:30.948374 15688 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.935s (SENT) [suppressed 2 similar messages]
I20260709 13:08:30.949069 15796 raft_consensus.cc:1240] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:30.949880 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 120201us
W20260709 13:08:30.950392 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54647.3us
I20260709 13:08:30.951161 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:30.952025 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:30.953053 15685 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:30.953897 22378 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:30.954376 21726 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.954873 21726 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.955299 21726 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.954424 22378 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:30.958611 22378 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.961956 22183 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.963445 22248 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.903733 22392 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.924573 15645 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.969717 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:30.970778 22357 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.969722 15645 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.972268 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:30.972873 15791 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:30.974768 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:30.968652 22255 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:30.949538 21937 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:30.978782 22366 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.980086 21937 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:30.984220 22339 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.984660 15793 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
W20260709 13:08:30.985589 22398 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:30.987823 22255 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:30.994031 22001 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:30.996400 22357 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:31.000685 22255 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:31.001598 22255 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.003922 22255 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.004443 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.005827 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.006369 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.007074 15789 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:31.009135 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:31.010440 15791 raft_consensus.cc:2393] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:31.011571 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.012696 15787 raft_consensus.cc:2410] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:08:31.014431 22368 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:31.015049 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:31.015555 22368 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.018786 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:31.019496 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.019404 15718 raft_consensus.cc:1240] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:31.022356 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.023130 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.023903 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.024943 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:31.027765 22378 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.029347 22392 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.032749 22378 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.009410 22187 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.034027 22001 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.035532 22365 raft_consensus.cc:3055] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:31.030030 21726 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.037811 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:31.033622 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46824.1us
I20260709 13:08:31.043093 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.055351 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.055533 15714 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:31.060418 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.058516 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.033589 22368 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.077847 15789 raft_consensus.cc:2410] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:31.071640 15645 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.042323 22365 raft_consensus.cc:740] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:31.100365 15645 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.100374 15611 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:31.119179 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:31.122869 15793 raft_consensus.cc:2393] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:31.075968 22155 consensus_queue.cc:1059] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 13:08:31.119447 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 171252us
I20260709 13:08:31.085429 22001 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.138742 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:31.137693 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.138518 15790 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:31.140797 22327 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:31.141044 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:31.150231 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:31.151028 16329 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:31.157349 21726 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.157542 22271 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:31.158612 22271 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:31.167021 15760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.178380 15789 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.159873 22271 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.215896 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:31.225302 15793 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:31.232582 22001 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:31.237823 22365 consensus_queue.cc:260] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.239483 22365 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:31.244486 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.246807 15789 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:31.176604 22327 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.254228 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.258661 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.264812 15789 raft_consensus.cc:1240] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:31.281425 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:31.290099 22409 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.142s	user 0.004s	sys 0.000s
I20260709 13:08:31.296802 15715 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:31.302228 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:31.304309 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.305518 22155 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:31.306167 22155 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:31.307286 22155 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.313256 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:31.317420 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 51023.8us
I20260709 13:08:31.320668 15639 raft_consensus.cc:1275] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:08:31.332036 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:31.312371 22097 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.338732 15645 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 16: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:31.337587 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:31.356424 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.350361 22368 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.363662 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.363898 22368 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.370462 16329 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:31.373226 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.375648 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:31.361400 22357 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.341859 22097 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.380811 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:31.384784 15639 raft_consensus.cc:2393] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:31.388680 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:31.397590 22327 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.378386 22357 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:31.396466 15759 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:31.385272 22368 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:31.402748 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76409.8us
I20260709 13:08:31.403554 22262 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:31.400686 22357 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.416548 22393 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.428738 22394 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.399395 22001 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 13:08:31.430312 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 77933.7us
I20260709 13:08:31.429548 22393 consensus_queue.cc:1048] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:31.429272 22394 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:31.443490 22407 log.cc:927] Time spent T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
W20260709 13:08:31.446218 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 90718.9us
I20260709 13:08:31.448235 15685 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:31.449903 22394 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:31.450568 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:31.451012 22001 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:31.451476 22001 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:31.451710 22236 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:31.452082 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:31.452548 22001 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.453267 22378 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.454732 15762 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:31.455343 22378 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:31.456162 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:31.456543 22121 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:31.457209 22262 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.460142 22187 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.461105 22263 raft_consensus.cc:2804] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:31.460750 22187 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:31.516880 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 45902.3us
I20260709 13:08:31.467128 15762 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:31.461715 22263 raft_consensus.cc:697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:31.478288 15610 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:31.464102 15688 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:31.466095 22339 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260709 13:08:31.533525 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.536460 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.525929 22001 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:31.537703 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 73709.1us
W20260709 13:08:31.538827 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.531993 22394 raft_consensus.cc:2804] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:31.554060 22354 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.534220 22393 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.540946 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 73938.4us
I20260709 13:08:31.531672 22392 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:31.566113 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.565955 22393 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.566417 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.567601 16329 raft_consensus.cc:3060] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.568420 22368 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.569128 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.569046 22368 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:31.573402 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 189886us
I20260709 13:08:31.573830 22368 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.563745 22392 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:31.577492 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:31.552569 22350 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.579069 22392 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.590232 15688 leader_election.cc:400] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15.
I20260709 13:08:31.590672 15688 leader_election.cc:403] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:31.576313 22394 raft_consensus.cc:697] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:31.590461 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.580873 22097 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.597617 22097 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:31.598268 22097 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.600559 22097 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.601397 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.584825 22341 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.603308 22394 consensus_queue.cc:237] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.591578 22350 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.605082 22393 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:31.605820 22368 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.584937 22263 consensus_queue.cc:237] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.586050 22155 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.590003 22354 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:31.618037 15716 raft_consensus.cc:2410] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:31.625618 16329 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:31.630259 22357 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.631181 22341 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.596745 22288 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:08:31.595211 22187 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.632405 22255 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 14. Current term is 15.
I20260709 13:08:31.634163 21937 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.653713 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:31.657194 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 80129.1us
I20260709 13:08:31.657471 21726 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.658362 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:31.659030 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:31.660279 21726 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:31.660861 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 95110us
I20260709 13:08:31.660902 21726 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.661646 21726 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:31.661854 22368 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.662535 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:31.673602 22391 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:31.674145 22354 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.687216 22365 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:31.689190 22357 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.693079 21726 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.694343 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a882c727204be4b66080704cceb833"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:08:31.702029 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.695437 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:31.702776 15788 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:31.696254 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.696456 22339 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.704443 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.704835 22339 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.697532 15721 raft_consensus.cc:1275] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:31.698823 22187 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.699076 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.702342 15715 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.699545 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.734390 15715 raft_consensus.cc:3060] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.706894 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:31.712178 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 156384us
I20260709 13:08:31.636668 22271 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.735663 15713 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:31.746858 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.750530 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.751252 16329 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
I20260709 13:08:31.751724 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:31.755343 15718 raft_consensus.cc:2368] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:31.734097 22187 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:31.742719 22097 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.776244 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:31.656453 22155 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.773311 22187 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.769906 22183 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:31.775398 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:31.777897 22236 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:31.770526 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:31.758839 22392 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.781337 22098 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.781244 22097 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.795456 15713 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:31.796785 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:31.798470 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:31.804626 16329 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.795794 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.796725 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.808295 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:31.807287 15721 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:31.805609 15715 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.813968 15714 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:31.815599 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:31.758737 22271 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.820293 15792 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:31.825503 22424 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.795414 22155 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.793555 22097 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.826256 22424 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.828953 22424 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.784683 21690 consensus_queue.cc:1059] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:08:31.831305 21690 raft_consensus.cc:3055] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:31.831720 21690 raft_consensus.cc:740] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:31.791644 22098 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.865310 15715 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.832813 21690 consensus_queue.cc:260] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.793155 22392 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.789537 22183 consensus_queue.cc:1243] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer 228b1ac5589e48af9bbf6caecd6aeaea log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:31.882690 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:31.816852 22255 raft_consensus.cc:2764] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:31.888677 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.885571 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.889442 15642 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:31.836061 22288 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.892252 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:31.893700 15640 raft_consensus.cc:2393] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:31.867844 22098 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.898993 15722 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:31.899909 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.900616 15639 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:31.903246 22368 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:31.904490 22288 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:31.906119 22394 consensus_queue.cc:1048] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:31.906064 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:31.907102 22288 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.907255 15642 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:31.909286 16332 pending_rounds.cc:85] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting all ops after (but not including) 11
I20260709 13:08:31.909716 16332 pending_rounds.cc:107] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:31.910063 16332 raft_consensus.cc:2889] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.790731 22236 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:31.914270 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:31.923056 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:31.924612 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.929559 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:31.933209 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:31.933631 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 271231us
I20260709 13:08:31.936704 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:31.942478 16329 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:31.937757 22362 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.931151 22183 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:31.930506 22393 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:31.982613 22350 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:31.938777 21690 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.948350 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:31.920013 22187 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:32.024921 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 53069.6us
I20260709 13:08:32.026001 15789 raft_consensus.cc:2468] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 14.
W20260709 13:08:32.026114 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 96579.6us
W20260709 13:08:32.030838 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.027866 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.034452 15642 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:32.050364 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 103376us
I20260709 13:08:32.054670 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.056579 22187 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.057152 15610 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.030905 22183 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.058017 22183 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.061867 22393 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.063022 22001 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.064358 15646 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:32.057322 22187 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.071708 22362 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.078469 22362 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:32.091023 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.040361 22394 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:32.113665 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.111817 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.094475 22368 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.106554 22394 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.135725 15642 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:08:32.135673 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 44778.9us
I20260709 13:08:32.138514 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.110419 22350 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:32.140909 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 104383us
W20260709 13:08:32.142601 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 91275.5us
I20260709 13:08:32.141515 15640 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:32.146131 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:32.111083 22183 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.160152 22365 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:32.160877 22400 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.013s
I20260709 13:08:32.161181 22271 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:32.162436 22362 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.141328 22394 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.159593 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:32.212893 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.178200 22236 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.184366 21726 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:32.186348 22429 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:08:32.210062 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 184532us
I20260709 13:08:32.186977 22098 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.189513 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.193001 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:32.194278 22354 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.199182 22341 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:32.200358 22339 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.205338 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.248529 15642 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
W20260709 13:08:32.208498 22432 log.cc:927] Time spent T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.171s	user 0.002s	sys 0.001s
I20260709 13:08:32.158921 22357 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:32.230598 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.249142 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.200188 22183 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:32.200693 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 49649.1us
I20260709 13:08:32.265877 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.266762 15760 leader_election.cc:400] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:32.267901 15760 leader_election.cc:403] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:32.274313 15715 raft_consensus.cc:2368] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:32.278652 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:32.279551 15713 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.282235 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.285161 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.293416 22443 consensus_queue.cc:1059] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:32.294669 22443 raft_consensus.cc:3055] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:32.295096 22443 raft_consensus.cc:740] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:32.255347 22357 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.305414 15719 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:32.273054 22262 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.329874 15722 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:32.332387 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.332494 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:32.337548 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.339617 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.300604 22339 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.300249 22357 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.342931 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.348505 15685 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:32.350157 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:32.354463 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:32.356417 15762 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:32.362571 15790 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:32.368880 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.342235 22365 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.375523 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:32.377650 15645 raft_consensus.cc:3060] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:08:32.382009 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.354053 22288 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.388934 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.390980 15788 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:32.397939 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.400015 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.401906 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.362111 22392 raft_consensus.cc:2804] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.407842 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.410069 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:32.383222 15610 connection.cc:256] RPC call timeout handler was delayed by -1.181159619999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:08:32.384405 22362 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:32.404064 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:32.418978 15790 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:32.420548 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.419309 15790 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:32.394543 22424 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:32.431711 15611 leader_election.cc:400] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
I20260709 13:08:32.432224 15611 leader_election.cc:403] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:32.414762 22366 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.419937 22155 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:32.446724 22098 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.422451 22187 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:32.447860 22187 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.356634 22443 consensus_queue.cc:260] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.450630 22443 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.451095 22187 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.455525 22097 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:32.456187 22097 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.424923 22437 consensus_queue.cc:1048] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.080s
I20260709 13:08:32.459532 22424 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.387763 22365 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.464608 22365 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:32.465406 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:32.433540 22337 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.469233 15610 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:32.470842 22354 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.471594 22354 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:32.475322 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:32.475770 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 49925.3us
I20260709 13:08:32.421492 22392 raft_consensus.cc:697] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:32.474470 15790 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.494763 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.495677 15716 raft_consensus.cc:2410] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:08:32.495734 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.496070 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.496867 15719 raft_consensus.cc:1240] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:32.497150 16328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.497463 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.497996 16328 raft_consensus.cc:2393] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 14: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:32.498092 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.498814 16326 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:32.498863 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:32.499681 16331 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 15: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:32.498903 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.484552 22424 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:32.510278 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.511915 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:32.512693 16329 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.515373 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.522533 22392 consensus_queue.cc:237] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.488027 22341 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.527197 22001 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:32.527766 22001 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:32.528558 22449 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 13:08:32.530167 15790 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.535135 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.535876 15792 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:32.541298 22097 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.543794 22339 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:32.548316 16329 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:32.552243 15790 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:32.552537 15645 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:32.559183 15713 raft_consensus.cc:2468] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:32.549829 22365 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:32.561414 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 186852us
I20260709 13:08:32.564985 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:32.566476 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 97312.2us
I20260709 13:08:32.567502 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:32.565582 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.573426 22001 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.591488 22393 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.596618 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.606200 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.607017 15719 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:32.601322 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.609630 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:32.611986 15790 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 15.
I20260709 13:08:32.609200 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:32.613318 16327 raft_consensus.cc:3060] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.616652 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:32.607476 22393 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:32.622205 15760 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:32.626287 15762 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:32.622731 22262 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:08:32.629492 22357 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.631369 22457 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:32.631898 22357 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:32.632385 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.632205 22262 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:32.620411 22256 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:32.625628 22393 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:32.639298 22393 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:32.634697 22256 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.619033 22394 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.649756 16327 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:32.643301 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.651561 15685 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:32.657259 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:32.642974 22256 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.662382 15789 raft_consensus.cc:2368] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18.
I20260709 13:08:32.664947 22452 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:32.665119 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:32.665432 22452 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:32.665762 15716 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.666911 15715 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:32.644237 22366 raft_consensus.cc:2804] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:32.671123 22001 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:32.660816 22098 raft_consensus.cc:2804] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.669914 22452 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:32.691392 22366 raft_consensus.cc:697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:32.706367 22366 consensus_queue.cc:237] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.712116 15716 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:32.713450 22394 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.719728 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:32.729449 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:32.732192 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 169673us
I20260709 13:08:32.723918 22341 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15.
W20260709 13:08:32.758343 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 101360us
I20260709 13:08:32.724916 22098 raft_consensus.cc:697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:32.759305 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 191893us
I20260709 13:08:32.754125 22362 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:32.766203 22362 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:32.767401 22362 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.761168 22187 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.758756 22155 consensus_queue.cc:1059] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:32.804898 15640 raft_consensus.cc:1275] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:32.812628 22452 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.814155 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.815233 15645 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:32.816694 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:32.818454 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:32.818895 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45766.9us
I20260709 13:08:32.819767 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:32.820674 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.817636 15639 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.821566 15641 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 21.
I20260709 13:08:32.832803 21937 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:32.832834 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.855289 22459 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:32.856060 22459 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.858414 22459 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.859794 22098 consensus_queue.cc:237] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:32.895467 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.910570 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:32.911369 15792 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:32.911671 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:32.901705 22393 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.905035 22452 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.907769 22271 raft_consensus.cc:3055] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:32.909957 22262 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.923367 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 90627.5us
I20260709 13:08:32.960042 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:32.947118 15791 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:32.947755 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:32.949685 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.951609 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:32.966022 15638 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:32.969324 22393 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.971181 22452 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:32.973977 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:32.973326 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:32.978403 22466 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.921655 22339 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:32.980221 22339 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.982353 22339 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:32.982751 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:32.982867 22339 consensus_queue.cc:1048] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:32.983714 22459 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:32.984098 22459 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:32.984432 22459 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:32.923498 22368 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:32.985980 22368 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.988097 22368 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:32.943620 22155 consensus_queue.cc:1059] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:08:32.990130 22155 consensus_queue.cc:1243] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [LEADER]: Peer 8ca6a5ab086d47e5a79ef37ddead9f28 log is divergent from this leader: its last log entry 18.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:08:32.990635 22155 raft_consensus.cc:3055] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:32.990948 22155 raft_consensus.cc:740] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:32.991767 22155 consensus_queue.cc:260] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:32.992326 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:32.992918 15641 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:32.993006 22155 raft_consensus.cc:3060] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.927572 22354 raft_consensus.cc:2764] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:32.994441 15640 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:32.973538 22452 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:32.995191 22452 raft_consensus.cc:3060] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.000013 22097 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.000702 22434 consensus_queue.cc:1059] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:33.002025 22097 raft_consensus.cc:3055] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:33.002274 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.002947 15643 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:32.957559 22262 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.002429 22097 raft_consensus.cc:740] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:33.006855 22262 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.007438 22097 consensus_queue.cc:260] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.008809 22097 raft_consensus.cc:3060] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:33.011015 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.016834 15641 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:33.018323 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.024571 22393 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:33.024665 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.025043 22393 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:33.025503 22357 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.025507 22393 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:33.025885 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.026113 22357 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:33.026630 22357 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.027858 22262 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:33.028460 22354 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.028617 22262 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:33.028687 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 68738.2us
I20260709 13:08:33.029611 22262 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.968065 22256 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.032392 22256 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.022017 15638 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 21.
W20260709 13:08:33.033242 16300 leader_election.cc:336] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.595s (SENT)
I20260709 13:08:33.033499 22393 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.034946 15762 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.035559 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.021402 22459 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.036232 15643 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.017477 22452 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:32.947784 22271 raft_consensus.cc:740] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:33.039278 22271 consensus_queue.cc:260] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.039906 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.040481 15640 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:33.040546 22271 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.036275 22393 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.042644 22393 raft_consensus.cc:2804] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:33.050534 22393 raft_consensus.cc:697] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 21 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:33.051898 15640 raft_consensus.cc:2468] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:33.052973 15638 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.051889 22393 consensus_queue.cc:237] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.055789 22452 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.055927 15638 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:33.059165 15643 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:33.056912 15638 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.033818 16300 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:33.029922 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:33.074806 15762 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.075887 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.079073 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.082293 15640 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:32.938040 15789 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:32.919634 15639 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:33.109203 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:33.112573 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:33.116133 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.117367 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:33.119304 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:33.120568 15640 raft_consensus.cc:2468] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 22.
I20260709 13:08:33.121404 15638 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.122432 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:33.123013 15713 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.123361 15715 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:33.125344 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:33.125527 22391 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.125349 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:33.126533 22391 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:33.126915 22391 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:33.127768 22391 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.128944 22391 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:33.121989 15762 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.130034 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:33.130791 16327 raft_consensus.cc:1275] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:08:33.124507 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
W20260709 13:08:33.136665 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 106806us
I20260709 13:08:33.137660 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.121621 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:33.143018 22362 raft_consensus.cc:2804] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:33.143591 22362 raft_consensus.cc:697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 22 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:33.144466 22362 consensus_queue.cc:237] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.145157 22097 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:33.134929 22466 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:33.146294 22466 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.148470 15722 raft_consensus.cc:2468] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 21.
I20260709 13:08:33.152422 15610 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.153821 22424 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:33.154498 22424 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.157094 22365 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:33.157928 22365 consensus_queue.cc:1243] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:33.159622 15610 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.070726 22459 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.099638 22256 raft_consensus.cc:2804] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:33.099059 22368 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.130028 22457 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.168380 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:33.148545 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 115322us
W20260709 13:08:33.200191 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.200907 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.116204 22339 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.212299 15638 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:33.132278 22327 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.219388 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.205044 15713 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:33.195623 15641 raft_consensus.cc:2468] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:33.148685 22439 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:33.228840 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.255729 15610 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.185194 22424 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.264273 15610 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.266290 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.268277 22327 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.209818 22271 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:33.259133 22425 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.223515 22368 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:33.214929 22256 raft_consensus.cc:697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:33.261502 22339 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:33.387300 16300 leader_election.cc:336] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.594s (SENT)
I20260709 13:08:33.287390 21937 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.269192 22341 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.272372 22187 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.213996 22365 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 13:08:33.215489 22457 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.339869 22097 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:33.408797 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.424885 22425 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:33.425384 22477 log.cc:927] Time spent T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:33.425096 22097 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:33.427156 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.428175 22482 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.427821 22339 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.428800 22482 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.429610 22368 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:33.444195 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.384451 22392 consensus_queue.cc:1048] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
W20260709 13:08:33.487982 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 114619us
W20260709 13:08:33.489025 16300 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.708s (SENT)
I20260709 13:08:33.489445 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:33.506173 22327 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:33.510380 22474 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:33.519479 22466 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:33.522532 22476 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:33.504072 22256 consensus_queue.cc:237] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.525874 22457 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.534073 22488 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.567569 15640 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:33.567644 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:33.573163 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 84179.1us
I20260709 13:08:33.584107 15762 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.589140 15794 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 22 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:33.594674 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.606784 15792 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:33.606726 22155 consensus_meta.cc:287] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.012s
I20260709 13:08:33.661445 16327 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:33.578138 22436 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.667804 16300 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.785s (SENT)
I20260709 13:08:33.686007 22436 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.687328 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:33.688323 22444 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.689078 22436 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.669565 22327 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.691118 22327 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:33.681941 22357 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.007s
I20260709 13:08:33.732146 22357 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.734784 22357 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.573081 22424 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:33.758711 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 492477us
I20260709 13:08:33.761412 15610 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:33.764484 15610 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.765841 15610 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.703491 22327 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:33.736330 22459 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:33.795117 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 213130us
I20260709 13:08:33.787971 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:33.610456 22466 raft_consensus.cc:2804] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.808923 22487 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:33.815267 22490 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:33.815964 22490 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.611480 22362 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.185s
I20260709 13:08:33.818862 22366 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:33.819846 22466 raft_consensus.cc:697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:33.820894 22466 consensus_queue.cc:237] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.786854 22155 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:33.794428 22354 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.825712 22354 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:33.826691 22354 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.829047 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:33.830116 15789 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
W20260709 13:08:33.831910 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 118794us
I20260709 13:08:33.803766 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:33.832588 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.836938 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 245084us
I20260709 13:08:33.791008 22424 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:33.859284 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 454023us
W20260709 13:08:33.915867 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.903242 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.918583 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 114949us
I20260709 13:08:33.829443 22459 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.919881 15791 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:33.919857 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 67000.6us
I20260709 13:08:33.937808 22098 consensus_queue.cc:1059] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:33.938714 22098 consensus_queue.cc:1243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:33.920075 16297 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:33.831238 22368 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:33.924820 15610 leader_election.cc:400] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18.
I20260709 13:08:33.941488 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.941932 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.942114 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.942934 15642 raft_consensus.cc:2393] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:33.942128 15643 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:33.943751 22434 raft_consensus.cc:3055] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:33.944213 22434 raft_consensus.cc:740] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:33.945909 15641 raft_consensus.cc:1240] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:33.946259 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.945927 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.947501 15642 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:33.947558 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.948302 15643 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:33.949280 22368 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:33.951623 22494 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.952575 22368 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.951385 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.961427 15643 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:33.953976 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.962359 15644 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:33.962637 22494 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:33.955051 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.956643 22442 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.963851 22442 raft_consensus.cc:493] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.964234 22442 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.964838 15647 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:33.965366 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.942150 22482 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:33.957218 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.957839 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.970664 15638 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:33.945140 22434 consensus_queue.cc:260] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:33.951154 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.974798 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.963351 22494 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:33.980726 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.995219 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.996233 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.997400 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.986485 15647 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:33.999739 15640 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.000638 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.001892 22357 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:33.986567 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.003234 15641 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:34.004135 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.004863 15641 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:34.005635 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.998749 22362 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:34.006510 15688 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.935s (SENT)
I20260709 13:08:33.987583 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.002071 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.007030 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.007444 15639 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:34.008178 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.008360 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.008788 15647 raft_consensus.cc:2468] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:33.987267 22441 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.009650 22391 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:34.010030 22441 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:34.010908 22490 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:34.011559 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "493304a609d247829052517242c00e96"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:34.012272 15791 raft_consensus.cc:606] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:34.012619 15791 raft_consensus.cc:614] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:34.012854 22441 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:33.956643 22459 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:34.017025 15791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:33.988827 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:33.991703 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:33.992213 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 68511.8us
I20260709 13:08:33.984807 15646 raft_consensus.cc:1240] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 21. Current term is 22. Ops: [19.10-21.11]
I20260709 13:08:34.022964 15791 raft_consensus.cc:606] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:34.023487 15791 raft_consensus.cc:614] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:34.025235 15640 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:34.025869 15641 raft_consensus.cc:2368] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:34.013173 22424 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:34.023226 15638 raft_consensus.cc:2468] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:34.026726 15643 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.030813 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.031277 15647 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:08:34.031517 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.053242 15715 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 19.
I20260709 13:08:34.033130 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:34.033423 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:33.991915 22494 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:34.036405 15639 raft_consensus.cc:2468] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:34.038033 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.056972 15642 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.036979 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:33.978982 22442 raft_consensus.cc:515] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:34.043231 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.054399 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.035547 15645 raft_consensus.cc:2468] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:34.054093 15791 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 15.
I20260709 13:08:34.065371 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:34.066591 22443 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.067111 22443 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.067523 22443 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.090092 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.098480 15646 raft_consensus.cc:2393] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:08:34.100263 15688 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.508s (SENT)
I20260709 13:08:34.101012 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:34.102187 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.164s (SENT)
I20260709 13:08:34.102635 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.105305 15719 raft_consensus.cc:1275] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:34.106253 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:34.107303 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 171094us
I20260709 13:08:34.119434 15643 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:34.123733 15714 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:34.123790 15639 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.121037 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.039479 22366 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:08:34.121827 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.129267 15720 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:34.133324 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.133814 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:34.134305 15641 raft_consensus.cc:2376] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19. Re-sending same reply.
I20260709 13:08:34.133301 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.136855 15794 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:34.137303 15789 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.137995 15721 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:08:34.139528 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 90334.5us
I20260709 13:08:34.142369 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:34.143006 15789 raft_consensus.cc:606] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:34.143342 15789 raft_consensus.cc:614] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:34.106423 22362 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:34.144871 15646 raft_consensus.cc:1240] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:34.150461 15642 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:34.105396 22394 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.104898 22391 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:34.154042 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.154520 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.155854 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:08:34.157127 15688 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.597s (SENT)
I20260709 13:08:34.163655 15638 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.163451 16327 raft_consensus.cc:1275] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.159191 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.166210 15642 raft_consensus.cc:1275] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:34.160969 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:34.172565 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58407.1us
I20260709 13:08:34.176254 15792 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:34.180294 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.181468 15642 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:34.176767 16298 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:34.152982 22438 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.138836 22458 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:34.176316 22097 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:34.179023 22339 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.217231 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:34.214857 22507 log.cc:927] Time spent T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 13:08:34.213538 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.223114 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:34.228736 22501 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:08:34.232945 15792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:34.163610 22394 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:34.233601 15792 raft_consensus.cc:606] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:34.241122 15545 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 277) took 15446 ms (client timeout 15000 ms). Trace:
W20260709 13:08:34.243902 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 60428us
W20260709 13:08:34.242780 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 140610us
I20260709 13:08:34.247876 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.151383 22497 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:08:34.220293 22437 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:34.221218 22365 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.211835 22362 consensus_queue.cc:1048] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:08:34.221223 22483 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:34.259611 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.271944 15644 raft_consensus.cc:2376] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17. Re-sending same reply.
I20260709 13:08:34.272286 22394 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:34.272889 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.257948 22366 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:34.266114 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.275719 22365 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:34.278419 22365 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:34.254880 22437 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.279493 22437 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:34.280037 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.281327 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.309046 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.322387 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.284566 22434 raft_consensus.cc:3060] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:34.242944 15545 rpcz_store.cc:269] 0709 13:08:18.794689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.794886 (+   197us) service_pool.cc:224] Handling call
0709 13:08:34.240779 (+15445893us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:29.043464 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:29.122813 (+ 79349us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:29.126227 (+  3414us) write_op.cc:435] Acquired schema lock
0709 13:08:29.132518 (+  6291us) tablet.cc:662] Decoding operations
0709 13:08:29.645714 (+513196us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:29.661353 (+ 15639us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:29.669551 (+  8198us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:08:29.996755 (+327204us) tablet.cc:701] Row locks acquired
0709 13:08:29.996784 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:08:29.996949 (+   165us) write_op.cc:270] Start()
0709 13:08:29.997079 (+   130us) write_op.cc:276] Timestamp: P: 1783602509996894 usec, L: 0
0709 13:08:29.997108 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:29.999043 (+  1935us) log.cc:844] Serialized 11601 byte log entry
0709 13:08:30.621646 (+622603us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25401e28 00007fad28e3c581 00007fad28e3bd58 00007fad28e409f1 00007fad28e409a9 00007fad28e40939 00007fad28e40901 00007fad28e3fb2d 000000000038f354 000000000038f199
0709 13:08:30.758372 (+136726us) op_driver.cc:464] REPLICATION: finished
0709 13:08:30.958018 (+199646us) write_op.cc:301] APPLY: starting
0709 13:08:30.958177 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:31.284412 (+326235us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:31.284464 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:31.607383 (+322919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:31.607857 (+   474us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:08:31.607919 (+    62us) write_op.cc:312] APPLY: finished
0709 13:08:31.608614 (+   695us) log.cc:844] Serialized 260 byte log entry
0709 13:08:31.608845 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:31.609308 (+   463us) write_op.cc:454] Released schema lock
0709 13:08:31.609418 (+   110us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:31.615485 (+  6067us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:31.615535 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3196200,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":161445,"apply.run_cpu_time_us":49796,"apply.run_wall_time_us":657495,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129407,"num_ops":30,"prepare.queue_time_us":261314,"prepare.run_cpu_time_us":45228,"prepare.run_wall_time_us":1594029,"raft.queue_time_us":384148,"raft.run_cpu_time_us":25956,"raft.run_wall_time_us":88920,"replication_time_us":761022,"spinlock_wait_cycles":2744576,"thread_start_us":698816,"threads_started":4,"wal-append.queue_time_us":115012,"wal-append.run_cpu_time_us":38377,"wal-append.run_wall_time_us":2500205}]]}
I20260709 13:08:34.221845 22097 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:34.253338 22463 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.270102 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.273669 15644 raft_consensus.cc:2368] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:34.249517 22262 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:34.290005 22443 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:34.268699 22442 leader_election.cc:290] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:34.295773 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.343078 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.249158 22339 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:08:34.274874 15643 raft_consensus.cc:2376] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19. Re-sending same reply.
I20260709 13:08:34.345468 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.346596 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.347117 15643 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.304080 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.273658 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.349314 15647 raft_consensus.cc:2368] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 18. Current term is 19.
I20260709 13:08:34.343504 15646 raft_consensus.cc:2376] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15. Re-sending same reply.
I20260709 13:08:34.342442 15762 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.350153 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.350901 15640 raft_consensus.cc:2393] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 17: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:34.307741 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.262305 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.351917 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:34.352429 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.352896 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.353343 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.310674 15645 raft_consensus.cc:2393] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:34.313508 16333 raft_consensus.cc:1240] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.314148 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:34.314644 22437 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:34.355872 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.319252 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:34.319598 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.323201 15688 leader_election.cc:336] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 1.690s (SENT)
I20260709 13:08:34.357432 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.357617 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.326354 22497 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:34.327880 22098 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:34.329676 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:34.335835 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 79124us
I20260709 13:08:34.247222 22458 consensus_queue.cc:1243] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:34.364401 16327 raft_consensus.cc:1240] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.358851 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:34.362704 15646 raft_consensus.cc:1240] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:34.367654 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.369801 16333 raft_consensus.cc:2368] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17.
I20260709 13:08:34.373133 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:34.378010 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:34.381503 15793 raft_consensus.cc:1240] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.384652 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:34.381564 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:34.389300 15643 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:34.389295 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:34.392375 22443 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:34.398018 15796 raft_consensus.cc:2393] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 16: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:34.398257 15794 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:08:34.399101 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 70152.6us
I20260709 13:08:34.404103 16329 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:34.406431 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:34.408324 15790 raft_consensus.cc:1217] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[13.8-18.10]   Dedup: 13.8->[16.9-18.10]
I20260709 13:08:34.408983 15790 pending_rounds.cc:85] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Aborting all ops after (but not including) 8
I20260709 13:08:34.409272 15790 pending_rounds.cc:107] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:34.410255 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:34.409528 15790 raft_consensus.cc:2889] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.415148 15643 raft_consensus.cc:1275] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:08:34.417662 15610 connection.cc:256] RPC call timeout handler was delayed by -1.7512208259998943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:08:34.369156 22506 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.385128 22262 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:34.426241 22482 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:34.404589 22366 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:34.443272 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f64c9d13524994bf43ee72f72781ee" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:34.431109 15639 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:34.407776 22458 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.441254 15788 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:34.441654 15647 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:34.444036 15789 raft_consensus.cc:3060] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.433689 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:34.443207 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:34.459111 22458 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:34.489180 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 46091.4us
I20260709 13:08:34.492933 22458 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.458710 22357 consensus_queue.cc:1048] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:34.493431 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:34.488296 15687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.494706 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Timed out: RequestConsensusVote RPC to 127.14.45.1:46181 timed out after 2.230s (SENT)
I20260709 13:08:34.495214 16300 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.497157 15789 raft_consensus.cc:2468] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:34.500690 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:34.428858 22483 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:08:34.549490 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 163228us
I20260709 13:08:34.498070 22425 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:34.569871 15610 leader_election.cc:400] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17.
I20260709 13:08:34.570395 15610 leader_election.cc:403] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.571211 15610 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:34.564754 22494 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.572683 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:34.576457 15789 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.546087 22488 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.551800 22354 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.573312 15792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:34.592837 15688 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.598997 15792 raft_consensus.cc:606] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:34.635030 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 146462us
I20260709 13:08:34.551795 22366 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:34.548902 22452 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:08:34.652940 15789 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:34.598930 22097 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:34.604612 22425 raft_consensus.cc:2749] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485) with higher term. Message: Invalid argument: T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for earlier term 16. Current term is 17.
I20260709 13:08:34.606268 15688 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.649607 22481 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.695101 22486 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.702389 22437 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:34.715982 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 315194us
W20260709 13:08:34.725226 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 152470us
I20260709 13:08:34.727813 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:34.717645 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 111432us
I20260709 13:08:34.701463 22494 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:08:34.720323 22424 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.739329 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.725054 22481 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:34.751659 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:34.747965 22366 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:34.746802 22536 consensus_queue.cc:1059] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:34.744751 22437 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.740078 22486 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.750350 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:34.781494 16333 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:34.741891 22424 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:34.786146 22424 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:34.757305 22524 log.cc:927] Time spent T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:08:34.757822 22523 log.cc:927] Time spent T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:08:34.788010 16300 leader_election.cc:304] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:34.786936 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:34.790369 22488 raft_consensus.cc:2804] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:34.797029 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:34.800127 16327 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.787408 22437 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:34.790396 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49124.9us
I20260709 13:08:34.804546 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:34.790987 22488 raft_consensus.cc:697] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:34.807401 22497 consensus_queue.cc:1048] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.816592 22494 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:34.808393 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 63456.1us
I20260709 13:08:34.808800 15610 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:34.824733 15688 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:34.810642 22520 log.cc:927] Time spent T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.316s	user 0.003s	sys 0.001s
W20260709 13:08:34.811115 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.812536 15718 raft_consensus.cc:1275] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:08:34.805572 22458 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:34.828575 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:34.835151 22263 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.837718 15713 raft_consensus.cc:3055] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:34.847393 15713 raft_consensus.cc:740] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:34.843209 15720 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.843894 22263 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:34.867336 22458 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:34.867578 22548 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:34.867820 22263 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:34.870186 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45537.7us
I20260709 13:08:34.870193 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:34.872151 15688 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:34.868515 22548 consensus_queue.cc:1243] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:34.848483 15713 consensus_queue.cc:260] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:34.886592 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:34.886286 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 57801.6us
W20260709 13:08:34.884222 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 49969.7us
I20260709 13:08:34.838586 22486 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.896171 15713 raft_consensus.cc:3060] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.921640 22549 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.882895 22437 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.888262 22458 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.974112 15713 raft_consensus.cc:1275] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:34.838838 22434 consensus_queue.cc:1048] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
W20260709 13:08:34.977434 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 107341us
W20260709 13:08:34.977936 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 88682.9us
I20260709 13:08:34.849059 22494 consensus_queue.cc:1059] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:08:34.926962 22545 log.cc:927] Time spent T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:08:34.892871 22536 raft_consensus.cc:2804] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:34.869077 22424 consensus_queue.cc:1059] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 13:08:34.987159 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:34.992789 22328 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.993518 22328 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:34.994719 22328 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.011092 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:34.976275 22263 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:35.018466 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 131952us
I20260709 13:08:35.017573 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:35.019397 15688 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:35.016790 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:35.020119 15643 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:34.959916 22540 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.978830 22437 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.015790 22486 raft_consensus.cc:3055] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:35.039752 15688 leader_election.cc:400] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:35.040252 15688 leader_election.cc:403] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:08:35.031674 22392 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:08:35.038471 22486 raft_consensus.cc:740] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:35.037309 22536 raft_consensus.cc:697] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:34.980997 22488 consensus_queue.cc:237] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.041553 22549 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:35.033152 22368 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:35.037711 22494 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:08:35.059142 15643 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 20.
I20260709 13:08:35.064512 15688 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:35.064817 22437 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.062891 22434 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181) with higher term. Message: Invalid argument: T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18.
I20260709 13:08:35.071848 15688 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:35.072455 22097 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:35.080142 22536 consensus_queue.cc:237] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.082813 15537 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.084187 22434 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:35.092406 22486 consensus_queue.cc:260] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:35.161330 22525 log.cc:927] Time spent T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.735s	user 0.005s	sys 0.003s
I20260709 13:08:35.165831 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:35.174712 15792 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
I20260709 13:08:35.164466 22424 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:35.168347 15537 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 11 to 14, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 14 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.177897 22424 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
W20260709 13:08:35.264099 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 90496.6us
I20260709 13:08:35.266731 15537 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 11 to 16, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 16 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:35.180330 22357 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.274986 22529 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.276278 22553 raft_consensus.cc:3055] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:08:35.278012 22519 log.cc:927] Time spent T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.726s	user 0.007s	sys 0.006s
I20260709 13:08:35.280676 15760 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:35.286188 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:35.183563 22368 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.299212 15713 raft_consensus.cc:1275] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:35.319686 15640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 850) took 1020 ms. Trace:
I20260709 13:08:35.322701 22368 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:35.324916 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 44441.6us
I20260709 13:08:35.320179 15640 rpcz_store.cc:276] 0709 13:08:34.299485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.358802 (+ 59317us) service_pool.cc:224] Handling call
0709 13:08:34.359076 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.387391 (+ 28315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.387419 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.392599 (+  5180us) log.cc:844] Serialized 26 byte log entry
0709 13:08:34.426930 (+ 34331us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:34.428085 (+  1155us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.458809 (+ 30724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.458878 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.147110 (+688232us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b1800093fa0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2b1e1de1 00007fad2b1ee5b1 00007fad223193f3 00007fad2231b7c1 00007fad2231b779 00007fad2231b709 00007fad2231b6d1 00007fad2231a9cd 000000000038f354 000000000038f199 00007fad222fc83a
0709 13:08:35.160523 (+ 13413us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b4400022b4c. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad2223fc85 00007fad222406a2 00007fad24fb21db 00007fad24fadaaf 00007fad24fa186e 00007fad24fa0bb6 00007fad24fa07d8 00007fad24faa221 00007fad24faa1d9 00007fad24faa169
0709 13:08:35.262684 (+102161us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b48000030d8. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2a32faa1 00007fad2a326b37 00007fad2a3269ca 00007fad2a41e26f 00007fad2a41df37 00007fad2a43255c 00007fad2a432508 00007fad2a432488 00007fad2a432443 00007fad2a4316ec 00007fad2935ba96
0709 13:08:35.319446 (+ 56762us) raft_consensus.cc:1685] finished
0709 13:08:35.319485 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.319624 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53205,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":550,"raft.queue_time_us":94876,"raft.run_cpu_time_us":20337,"raft.run_wall_time_us":870513,"spinlock_wait_cycles":323652096,"thread_start_us":33993,"threads_started":1,"wal-append.queue_time_us":33602}
I20260709 13:08:35.304105 15721 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:35.327874 22436 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:35.335754 22436 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.336135 22436 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.336699 22368 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.301467 22535 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.298264 22357 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.339870 22357 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:35.343950 22436 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.343531 15537 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 14 to 17, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 17 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.344823 22424 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:35.296195 22547 log.cc:927] Time spent T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:35.301635 22529 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.358810 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:35.354593 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:35.360284 15721 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:35.364506 22424 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.330780 22459 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.317982 22452 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:35.370590 22529 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.337530 22535 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.361862 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:35.298978 22553 raft_consensus.cc:740] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:35.390026 22537 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:35.409602 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 83787.1us
W20260709 13:08:35.454906 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 126475us
W20260709 13:08:35.472234 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.518456 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.568120 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 46940us
I20260709 13:08:35.410857 22537 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.431154 22436 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.432593 22535 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:35.599354 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:35.609145 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.620534 15790 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:35.567611 22354 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:35.600841 22537 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.569972 22459 consensus_queue.cc:1048] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:08:35.612040 22548 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:35.680365 22482 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.642283 22542 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:35.701638 22256 raft_consensus.cc:993] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:35.612814 22553 consensus_queue.cc:260] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.635579 22354 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.702538 22506 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:35.746747 22568 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:35.738348 22256 raft_consensus.cc:1081] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
W20260709 13:08:35.753546 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.792984 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.720386 22542 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.784447 22365 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.706394 22482 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.759735 22553 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:35.758952 22155 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:35.841318 22155 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.701645 22548 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.793010 22368 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:35.790669 22559 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.754901 22506 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.867478 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:35.863770 22540 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.871855 22510 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.876279 22424 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.001s
I20260709 13:08:35.899399 22482 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.858794 22365 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.874112 22559 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.869879 22368 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.902354 22526 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.907135 22424 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:35.905319 22482 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.905800 22510 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:35.704644 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 88447us
I20260709 13:08:35.955346 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:35.951141 22256 raft_consensus.cc:493] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:35.964259 22576 raft_consensus.cc:493] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.938723 22424 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.965152 22576 raft_consensus.cc:515] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.954087 22566 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:35.967883 22566 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.969435 22487 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.961483 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:35.964526 22542 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:35.970762 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 103411us
I20260709 13:08:35.938777 22459 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:35.905552 22540 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.964443 22256 raft_consensus.cc:515] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.938987 22482 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.977073 22487 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:35.991425 22487 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.993654 22487 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.994328 22487 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:35.972839 22354 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.999418 22256 leader_election.cc:290] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:35.989375 22510 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.003489 22368 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:35.977612 22529 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.004897 22529 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.999409 22482 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.006650 22540 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:35.990692 22559 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.008211 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47700 (request call id 3785) took 1278 ms. Trace:
I20260709 13:08:36.008833 15720 rpcz_store.cc:276] 0709 13:08:34.730082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.730225 (+   143us) service_pool.cc:224] Handling call
0709 13:08:34.730544 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.871565 (+141021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.007904 (+1136339us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540026d4d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:36.008121 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258637568}
I20260709 13:08:36.010376 22537 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:35.987003 22459 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.010233 22482 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:36.014098 22459 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:36.014225 22482 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:35.929062 22526 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:36.020664 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.021471 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.022416 22526 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.023696 22548 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.026417 22542 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.017530 22482 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.027119 22542 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.030403 22506 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.031210 22566 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:36.008198 22529 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.034014 22365 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.035485 22365 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:36.036388 22368 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:36.036860 22368 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:36.038174 22368 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.039736 22368 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.042449 22424 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.048072 22392 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:36.048905 22392 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.051736 15688 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:36.058574 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:36.059208 15794 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.064523 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:36.070480 15793 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:36.078487 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:36.103499 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:36.104544 15788 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.105440 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5155e26439a345ae8f836c6cc4f0ab34" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:36.108033 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 128753us
I20260709 13:08:36.074079 22541 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:36.067560 22444 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.071280 22529 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:36.072557 22526 raft_consensus.cc:493] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:36.115116 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.115415 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.093387 22357 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:36.121104 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.107038 22566 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.107281 22498 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:36.130450 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:36.133291 15640 pending_rounds.cc:85] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 8
I20260709 13:08:36.136945 15640 pending_rounds.cc:107] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:08:36.137379 15640 raft_consensus.cc:2889] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.112550 22542 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.130153 22529 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.142452 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.148710 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.154371 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.158278 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.159258 15645 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:36.161244 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.162909 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.163769 15638 raft_consensus.cc:2468] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:36.175827 15718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47706 (request call id 2507) took 2053 ms. Trace:
I20260709 13:08:36.143834 22529 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.130360 22526 raft_consensus.cc:515] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.180860 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.181113 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.188958 15645 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:36.176250 15718 rpcz_store.cc:276] 0709 13:08:34.122189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.122306 (+   117us) service_pool.cc:224] Handling call
0709 13:08:34.141336 (+ 19030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.839316 (+697980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.175593 (+1336277us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400096854. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:36.175767 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542820736}
I20260709 13:08:36.130936 22357 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.186415 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.136229 22566 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.126621 22444 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.192804 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.201555 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.202003 22537 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:36.202713 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.216358 22357 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.223819 22548 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.224524 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.224411 22548 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:36.227346 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 90065.3us
I20260709 13:08:36.139104 22498 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.222263 22357 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.235076 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.258527 16329 raft_consensus.cc:3060] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.266182 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.270116 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.270951 15645 raft_consensus.cc:2468] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
W20260709 13:08:36.283910 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 98473.7us
I20260709 13:08:36.292845 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.313386 22444 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:36.315354 15685 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.321714 15788 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:36.323371 15762 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
W20260709 13:08:36.329706 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 70970.5us
I20260709 13:08:36.337589 15794 raft_consensus.cc:2468] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 19.
I20260709 13:08:36.339805 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.288479 22548 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.258311 22357 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:36.344566 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 55327.8us
I20260709 13:08:36.345942 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.342365 22366 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.342617 22537 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.358440 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
W20260709 13:08:36.360598 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.362145 22526 leader_election.cc:290] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:36.363124 22584 log.cc:927] Time spent T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:08:36.365063 22566 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:36.367056 22573 log.cc:927] Time spent T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:08:36.354979 22548 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.368564 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:36.378878 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 62353.2us
I20260709 13:08:36.380334 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.384429 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.368340 22576 leader_election.cc:290] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.391569 22579 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.394464 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.376827 22537 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:36.396832 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59433.6us
I20260709 13:08:36.360406 22436 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:08:36.422210 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.425129 16297 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:36.463398 15685 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:36.466419 22594 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:08:36.468657 22586 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:08:36.470965 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.472580 15639 raft_consensus.cc:1240] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:36.476644 22537 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.478092 22543 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.478686 22543 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.480829 22543 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:36.484936 22444 raft_consensus.cc:2804] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:36.416190 22579 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.488705 22579 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.563401 15720 raft_consensus.cc:3060] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:36.458858 22553 consensus_meta.cc:287] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.000s
W20260709 13:08:36.567060 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 103758us
I20260709 13:08:36.485548 22444 raft_consensus.cc:697] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
W20260709 13:08:36.582497 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 234421us
I20260709 13:08:36.578913 22548 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.594540 22357 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:36.619380 22368 consensus_meta.cc:287] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.005s
I20260709 13:08:36.590359 22393 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.622841 15647 raft_consensus.cc:2410] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:36.633842 22548 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:36.634056 22262 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.641937 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:36.662384 22483 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.663307 22483 consensus_queue.cc:1048] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:36.668051 15794 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:36.669309 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:36.677774 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 81221.8us
I20260709 13:08:36.677809 15793 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:36.640178 22394 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.639492 22393 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.657809 22463 consensus_queue.cc:1048] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:08:36.646840 22262 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.697510 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.698668 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.665483 22366 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:36.723773 22393 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:36.724988 22548 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.727989 22262 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:36.728498 16300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.728752 15793 raft_consensus.cc:1240] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:08:36.747164 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.750765 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.754441 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.755898 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:36.758183 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.759717 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.760921 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.764343 22490 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.764990 22490 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.768455 22490 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.771278 22328 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.771900 22328 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.686028 22394 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.776917 22394 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:36.748070 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.788914 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.793800 15720 raft_consensus.cc:2468] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 20.
I20260709 13:08:36.802948 16333 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:36.807085 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:36.808983 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 127822us
I20260709 13:08:36.810503 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.786271 22486 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.746125 22605 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.688567 22444 consensus_queue.cc:237] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.821794 16300 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:36.824818 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 241627us
I20260709 13:08:36.827365 15688 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:36.841869 15612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.847853 22612 raft_consensus.cc:2804] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:36.848511 22612 raft_consensus.cc:697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:36.849390 22612 consensus_queue.cc:237] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:36.858259 22589 log.cc:927] Time spent T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.512s	user 0.004s	sys 0.000s
I20260709 13:08:36.833385 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.871814 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.869254 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.845374 22536 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.832998 15688 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.883992 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.833671 22611 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.886246 22611 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.889330 22611 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.891711 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.893023 22596 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.893761 22596 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.896759 22596 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.832151 22613 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:36.902226 15788 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:36.833693 22598 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.908022 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 75185.9us
I20260709 13:08:36.871766 22458 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.909597 22620 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.907248 22626 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.934300 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:36.934752 15688 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:36.897477 22596 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:36.936802 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.829550 22605 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:36.939937 15610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.937294 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.907441 22618 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.932596 22506 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.962514 22618 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.963409 22506 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.941921 22548 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:36.966607 22548 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.957463 22596 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.956427 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:36.940618 22486 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:36.968675 22596 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.969362 22548 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:36.968950 22486 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.972075 22486 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:36.897948 22536 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.978256 22536 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:36.952396 15688 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.980930 15688 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:36.918365 22598 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.983727 22486 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.984431 22486 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:36.953827 22613 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:36.989821 22613 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:36.946895 22560 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:36.990585 22613 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:36.991096 22613 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:36.990909 22560 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:36.965600 22618 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.004282 15644 raft_consensus.cc:1275] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:37.007370 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.009598 15645 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:08:37.010097 15645 pending_rounds.cc:85] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 11
I20260709 13:08:37.010367 15645 pending_rounds.cc:107] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:37.010630 15645 raft_consensus.cc:2889] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:37.010869 22583 log.cc:927] Time spent T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.682s	user 0.000s	sys 0.001s
I20260709 13:08:37.017633 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.018093 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.018982 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:36.953089 22605 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.022902 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.027678 15688 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.026465 22487 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.932325 22452 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:37.036747 22452 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.037628 22548 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.039798 22452 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.040302 22581 consensus_queue.cc:1059] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:37.040889 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:36.985401 22598 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.042783 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.050179 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.053845 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.054139 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.057005 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:37.062331 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 170686us
I20260709 13:08:37.039309 22613 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.027343 22486 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.043762 22097 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.026876 22629 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.067659 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.092231 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.092792 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.093775 22611 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:37.094300 22611 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.096997 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.098214 15719 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:37.098163 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.098866 15641 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:37.099275 22613 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.069847 16329 raft_consensus.cc:1240] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 LEADER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:08:37.049361 22581 raft_consensus.cc:3055] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:37.100937 22581 raft_consensus.cc:740] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:37.102314 22498 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.102329 22511 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.076990 15713 raft_consensus.cc:1240] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:37.102985 22511 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.078719 15721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:08:37.104228 15721 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.104612 15721 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.105137 22511 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.108322 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.080854 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17999909d8e0416d88f73b762dbb4bd6" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.054425 22487 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.082296 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.082741 22506 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.054309 22579 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.065007 22588 consensus_queue.cc:1048] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:08:37.058261 22622 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:08:37.085876 22619 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:37.120380 22619 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.086380 22482 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:37.122005 22482 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.122473 22328 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.125696 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:37.126142 15613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.127492 22486 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.128021 22578 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.127944 22486 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.128621 22578 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.130363 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.131693 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.071017 22598 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:37.132709 22362 consensus_queue.cc:1059] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:37.132939 22598 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.134290 22567 raft_consensus.cc:3055] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:37.134500 22574 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.134675 22567 raft_consensus.cc:740] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:37.086858 22560 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.135579 22567 consensus_queue.cc:260] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.093406 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.136806 22567 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.137261 15639 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:37.072321 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.115054 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.096370 22611 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.116935 22511 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.138623 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.138491 22511 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.139565 15646 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:08:37.140398 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.140651 22511 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.101961 22581 consensus_queue.cc:260] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.131879 22368 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.142356 22581 raft_consensus.cc:3060] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.142932 15643 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 11.
I20260709 13:08:37.143748 22578 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.144728 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.146045 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.147301 15639 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:37.148307 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.141456 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.069569 22548 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.149717 15646 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:37.188771 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.179180 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.190548 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.191197 15714 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:37.195273 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.196118 15792 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:37.190610 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.199476 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:37.187837 22553 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.202407 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.203856 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:37.206297 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.206944 15715 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:37.210201 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.210732 15639 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:37.210795 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.214221 15790 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:37.216153 15762 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.227065 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.227731 15792 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 20.
W20260709 13:08:37.229367 16298 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.45.2:40695 timed out after 1.897s (SENT) [suppressed 28 similar messages]
I20260709 13:08:37.228601 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.229818 15610 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:37.232609 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.233259 15715 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 13.
I20260709 13:08:37.220268 22511 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.223102 22362 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.223664 22486 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:37.252398 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.249190 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.250401 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.250735 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd1114f45e54146933cfc74bc32722f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.251381 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.234975 22578 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:37.258406 15713 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
W20260709 13:08:37.258980 15759 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.261813 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.262820 15713 raft_consensus.cc:2410] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:37.264364 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.267079 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.267529 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.268254 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.260751 22578 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.240219 22511 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.273669 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.279670 15713 raft_consensus.cc:2410] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:08:37.274533 15722 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:37.282572 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.291829 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ce40a7af94aa0a543c078bc1fe630" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.293063 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.282397 22328 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:37.278509 22578 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.307401 15716 raft_consensus.cc:2393] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 21: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:37.284121 22511 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.312227 22485 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.312704 22485 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.313067 22485 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.313781 22392 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.305130 22585 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:37.314800 22585 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.317359 22585 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:37.317651 22155 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.326638 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.310642 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.304349 22327 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.330492 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39124 (request call id 1048) took 1249 ms. Trace:
I20260709 13:08:37.331346 15720 rpcz_store.cc:276] 0709 13:08:36.077999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.078166 (+   167us) service_pool.cc:224] Handling call
0709 13:08:37.326989 (+1248823us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400439254. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:37.327130 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946030848}
W20260709 13:08:37.333889 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 104540us
I20260709 13:08:37.280932 15721 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.336338 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.336778 15715 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.338125 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:37.339255 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.340058 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.340276 15720 raft_consensus.cc:2393] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 20: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:37.370357 15721 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.336586 22482 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.389027 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.410817 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:37.422505 22636 log.cc:927] Time spent T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:08:37.434420 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.429692 15610 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:37.343117 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:37.450349 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:37.491128 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61580.3us
I20260709 13:08:37.460537 22619 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.461329 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.494131 15714 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:37.462054 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.463990 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:37.468811 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 241558us
I20260709 13:08:37.468060 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.495040 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.451000 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:37.497728 15645 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:37.502336 15645 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:08:37.504576 15645 pending_rounds.cc:85] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 12
I20260709 13:08:37.504994 15645 pending_rounds.cc:107] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:08:37.505431 15645 raft_consensus.cc:2889] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.495007 15722 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:37.495398 15719 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
W20260709 13:08:37.548497 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 80506.5us
I20260709 13:08:37.552363 15611 leader_election.cc:304] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.551216 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:37.496716 22155 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:37.556007 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.557782 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2555c9ee274d4274a4cf64af7f5c3609" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.562139 15760 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.564328 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.566459 15760 leader_election.cc:304] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:37.568359 22566 consensus_queue.cc:1059] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:37.569350 22566 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.570079 22566 raft_consensus.cc:2749] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.570689 22566 raft_consensus.cc:3055] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:37.571058 22566 raft_consensus.cc:740] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:37.571862 22566 consensus_queue.cc:260] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.573210 22362 consensus_queue.cc:1059] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.558244 22487 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:37.587280 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:37.592074 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.584869 22487 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:37.598045 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.545404 22585 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:37.602125 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.599784 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.578147 22560 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.546880 22394 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:37.551808 22612 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:08:37.604424 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.608744 22578 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.612751 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:37.617332 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:37.620126 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.600744 22487 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.622538 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.561290 22155 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.576069 22640 log.cc:927] Time spent T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:08:37.633653 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.585253 22579 raft_consensus.cc:2749] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.661129 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6940e9e6caf46bd88b8db528efa12e8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:37.634290 15760 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
W20260709 13:08:37.651295 15761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.665071 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:37.624434 22566 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.682147 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:37.694737 15638 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.635072 22362 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.702961 22362 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:37.703406 22362 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.682370 22457 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.698727 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.702415 22339 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:37.635914 22599 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:37.656476 22155 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.652160 22619 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:37.724684 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.720515 15638 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:37.717331 15760 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:37.725246 22579 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.750123 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:37.729625 22649 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:08:37.778301 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 226009us
I20260709 13:08:37.779196 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.780567 15611 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:37.776598 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 59353us
I20260709 13:08:37.734683 22339 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:37.788064 15611 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:37.773602 22543 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.790078 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.792366 15611 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:37.793730 15611 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.797071 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:37.797899 15795 raft_consensus.cc:3055] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.798338 15795 raft_consensus.cc:740] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:37.791956 22553 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.802564 15760 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:37.750196 22599 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.784222 22560 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.806418 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.807078 15795 consensus_queue.cc:260] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.789184 22339 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.803937 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:37.771442 22619 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.818177 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:37.792394 22368 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.816222 15688 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:37.822575 22262 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:37.826931 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.822753 15685 leader_election.cc:304] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.804056 22553 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.783833 22579 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.833683 15641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.812745 22567 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.782394 22649 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.823820 22606 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.853266 22606 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:37.818115 22639 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.852077 22487 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.830791 22482 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:37.836024 22644 log.cc:927] Time spent T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:08:37.828985 22578 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:37.830830 22650 raft_consensus.cc:3060] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:37.886090 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62808.7us
W20260709 13:08:37.887209 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64561us
W20260709 13:08:37.888062 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 61234.8us
I20260709 13:08:37.848292 22506 raft_consensus.cc:2749] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.845508 22567 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:37.891233 15685 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.853711 22606 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.898540 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.876015 22394 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:37.910168 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 116640us
I20260709 13:08:37.836126 22262 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:37.890506 22482 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.926578 22485 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.003s
I20260709 13:08:37.927146 22485 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:37.930142 15792 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:37.909296 22392 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.932835 22599 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:37.904933 22567 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.905355 22639 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:37.939306 22639 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:37.945848 22579 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:37.947504 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 120887us
I20260709 13:08:37.947806 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:37.913878 15611 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.905223 15685 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:37.950225 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 51809.8us
W20260709 13:08:37.950591 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 45459.5us
I20260709 13:08:37.951045 15760 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.951297 15685 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.952355 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.956401 15688 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
W20260709 13:08:37.948464 22511 consensus_meta.cc:287] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.006s
I20260709 13:08:37.947504 22482 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:37.967790 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 54051.2us
I20260709 13:08:37.968614 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:37.955533 22490 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.957752 22506 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:37.965051 22526 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.992030 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:37.992933 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:37.993558 15720 raft_consensus.cc:2376] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 20. Re-sending same reply.
I20260709 13:08:37.996289 15685 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:37.980713 22653 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.982021 22579 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.970430 22511 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.006568 22619 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:37.995617 22526 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.017554 15611 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:38.018193 15685 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:38.018384 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 64070.4us
W20260709 13:08:38.019841 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 108477us
I20260709 13:08:38.023268 15647 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:38.027400 15647 pending_rounds.cc:85] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Aborting all ops after (but not including) 8
I20260709 13:08:38.027673 15647 pending_rounds.cc:107] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:38.027923 15647 raft_consensus.cc:2889] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.001410 22362 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.029996 15639 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:38.023618 22262 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:38.030823 22362 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:38.031318 22487 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.025065 22511 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:38.033169 15611 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:38.026021 22339 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.035575 22339 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:38.031862 15788 raft_consensus.cc:2393] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 16: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:38.009994 22506 raft_consensus.cc:2804] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.041944 22506 raft_consensus.cc:697] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
W20260709 13:08:38.043143 22652 log.cc:927] Time spent T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:08:38.043066 22506 consensus_queue.cc:237] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.047928 22598 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.048916 22649 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:38.054890 22155 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.055452 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.057236 22155 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.021160 22619 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.058786 22368 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:38.062162 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.066658 22567 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.068962 22567 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:38.074769 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:38.086560 22485 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:38.089730 22653 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:38.091143 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 58069us
I20260709 13:08:38.118362 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:38.119644 15611 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:38.097076 22649 raft_consensus.cc:493] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:38.101981 15791 raft_consensus.cc:2468] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
W20260709 13:08:38.107802 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 89671.8us
I20260709 13:08:38.124526 15685 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.127524 15685 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.132754 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.133713 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.134083 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.134398 15722 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:38.134696 15720 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.132933 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.145440 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.101392 22606 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.151002 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.153652 15793 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.156172 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.159389 22606 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.143491 22649 raft_consensus.cc:515] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } attrs { replace: true } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.150041 22487 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.171036 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.175866 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.175886 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.179992 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.128988 22600 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:38.169519 22649 leader_election.cc:290] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:38.190555 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:38.183920 15722 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 21.
I20260709 13:08:38.194306 15720 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:38.152899 22155 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:38.151813 22368 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:38.198709 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 71298.6us
I20260709 13:08:38.213244 15685 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.199817 15611 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:38.200161 15793 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:38.202085 15639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35384 (request call id 876) took 1057 ms. Trace:
I20260709 13:08:38.214975 15611 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:38.202174 22155 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.199589 22548 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.192396 22654 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.192461 22650 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:38.214660 15639 rpcz_store.cc:276] 0709 13:08:37.144450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.217496 (+ 73046us) service_pool.cc:224] Handling call
0709 13:08:37.217807 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.030455 (+812648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.201798 (+171343us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54000a9954. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25406e01 00007fad2540583e 00007fad2a3ca419 00007fad23941bd4 00007fad23941b62 00007fad23941a91 00007fad23941a0c 00007fad23940cc2 00007fad2374148c 00007fad237408c6
0709 13:08:38.202017 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867204992}
I20260709 13:08:38.231238 22654 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.233901 22649 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:38.234861 22649 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 21 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:38.236212 22649 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.238441 15722 raft_consensus.cc:1275] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:38.239688 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.246452 16300 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:38.198275 22487 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.254992 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.256598 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.257424 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:38.185806 22482 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.259807 15788 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:38.261560 15643 raft_consensus.cc:2393] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:38.260936 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.266593 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:38.267292 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:38.267730 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:38.222525 22600 raft_consensus.cc:2749] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:38.223150 22155 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.273409 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.276628 15790 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:38.273725 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.277034 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.277871 15789 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:38.278285 15719 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:38.248824 22653 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:38.282941 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.282620 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:38.285976 15716 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:08:38.285482 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:38.361858 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 78543.5us
I20260709 13:08:38.275806 22498 raft_consensus.cc:3055] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:38.263885 22487 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.288200 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.261768 22486 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
W20260709 13:08:38.374581 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 92024.4us
I20260709 13:08:38.399215 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:38.395587 22600 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:38.395468 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 120150us
I20260709 13:08:38.275712 22659 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.373239 22498 raft_consensus.cc:740] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
W20260709 13:08:38.411368 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 123233us
I20260709 13:08:38.309114 22653 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:38.409060 22606 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:38.460927 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 199035us
I20260709 13:08:38.383942 22560 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:38.464340 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 215571us
I20260709 13:08:38.418665 22511 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:38.467094 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 220774us
I20260709 13:08:38.411419 22599 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:38.469020 15790 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 21.
I20260709 13:08:38.482496 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.430490 22669 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.484277 22482 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.480295 22511 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.486454 22498 consensus_queue.cc:260] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.495616 22590 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:38.508716 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45237.5us
W20260709 13:08:38.484349 22670 log.cc:927] Time spent T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:08:38.500838 22394 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
W20260709 13:08:38.472270 15537 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 153) took 25750 ms (client timeout 15000 ms). Trace:
I20260709 13:08:38.478614 22654 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.418610 22486 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:38.517751 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 155053us
I20260709 13:08:38.514518 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.513111 15790 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.555136 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.556201 22486 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.556448 15762 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.557435 22452 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:38.536931 15719 raft_consensus.cc:1240] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:38.558071 22452 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.539453 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:38.480324 22599 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.548868 22498 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:38.513887 22511 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:38.550740 22657 consensus_queue.cc:1175] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" responder_term: 16 status { last_received { term: 15 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:38.552791 15793 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.524667 22653 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.559559 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.586084 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.586395 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.561939 15792 raft_consensus.cc:1240] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:38.561872 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 93791.3us
W20260709 13:08:38.578199 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 63781.2us
I20260709 13:08:38.591986 15790 raft_consensus.cc:1275] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:38.605171 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.570183 22599 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.618464 16298 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.604636 22595 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.561676 22394 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.615540 22566 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:08:38.682790 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 77686.8us
I20260709 13:08:38.644582 22676 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.694409 22482 raft_consensus.cc:493] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.695219 22482 raft_consensus.cc:515] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.701609 22482 leader_election.cc:290] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:38.670097 22362 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.702788 15644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.704276 15638 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:08:38.685025 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 59146.1us
W20260709 13:08:38.724478 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 232266us
W20260709 13:08:38.724464 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 106084us
I20260709 13:08:38.728329 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.687215 22567 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.690989 22444 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:38.738615 15643 raft_consensus.cc:1240] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.676002 22595 consensus_queue.cc:1059] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:08:38.772903 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.727517 22673 consensus_queue.cc:1048] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:08:38.736653 22482 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:08:38.766232 22667 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.782087 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:38.764254 22683 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.785601 15789 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:38.790138 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 66646.3us
I20260709 13:08:38.791671 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.793615 22688 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.794447 22612 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.794203 22688 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.796444 22688 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.806967 22680 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:38.807528 22511 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.808902 15639 raft_consensus.cc:1240] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:38.810920 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.791687 22687 consensus_queue.cc:1048] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
W20260709 13:08:38.559687 15537 rpcz_store.cc:269] 0709 13:08:12.713240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.718064 (+  4824us) service_pool.cc:224] Handling call
0709 13:08:12.979084 (+261020us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5400310010. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e20b2 00007fad2b25ba89 00007fad2b1f3da6 00007fad2b1c5088 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc
0709 13:08:38.453501 (+25474417us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.642027 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.749362 (+107335us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.749418 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:35.749440 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:35.750144 (+   704us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.750266 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.750293 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:35.750760 (+   467us) tablet.cc:701] Row locks acquired
0709 13:08:35.750808 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:08:35.750967 (+   159us) write_op.cc:270] Start()
0709 13:08:35.751111 (+   144us) write_op.cc:276] Timestamp: P: 1783602515750904 usec, L: 0
0709 13:08:35.751132 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:35.751813 (+   681us) log.cc:844] Serialized 1662 byte log entry
0709 13:08:36.723677 (+971864us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.856670 (+132993us) write_op.cc:301] APPLY: starting
0709 13:08:36.856754 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.859392 (+  2638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.859489 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.877915 (+ 18426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.897267 (+ 19352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:36.897352 (+    85us) write_op.cc:312] APPLY: finished
0709 13:08:36.929404 (+ 32052us) log.cc:844] Serialized 49 byte log entry
0709 13:08:36.929626 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.929766 (+   140us) write_op.cc:454] Released schema lock
0709 13:08:36.929825 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.930281 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.930319 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167905,"reported_tablets":28,"spinlock_wait_cycles":6944384,"child_traces":[["op",{"apply.queue_time_us":132655,"apply.run_cpu_time_us":7116,"apply.run_wall_time_us":73560,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"num_ops":4,"prepare.queue_time_us":198175,"prepare.run_cpu_time_us":19209,"prepare.run_wall_time_us":377474,"raft.queue_time_us":298621,"raft.run_cpu_time_us":14351,"raft.run_wall_time_us":127558,"replication_time_us":936151,"thread_start_us":548186,"threads_started":4,"wal-append.queue_time_us":388619,"wal-append.run_cpu_time_us":15275,"wal-append.run_wall_time_us":1786336}]]}
I20260709 13:08:38.819885 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.827433 15789 raft_consensus.cc:2393] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 14: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:38.785027 22339 raft_consensus.cc:493] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.836210 15791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 3004) took 1214 ms. Trace:
I20260709 13:08:38.835801 22339 raft_consensus.cc:515] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.836627 15791 rpcz_store.cc:276] 0709 13:08:37.653864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.660809 (+  6945us) service_pool.cc:224] Handling call
0709 13:08:38.836029 (+1175220us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54003a34d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad2540a2fa 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c 00007fad239457c2 00007fad2374148c 00007fad237408c6 00007fad2374026f
0709 13:08:38.836128 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987169024}
I20260709 13:08:38.790673 22667 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.842995 22667 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.846951 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:38.849228 22487 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.849941 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf56bc1c60545828ec946a02bb6cf8b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:38.851994 22155 consensus_meta.cc:287] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.003s
I20260709 13:08:38.852584 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1a63ae20354b95b7bd0e7365b598f8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:38.852476 22155 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.855003 15642 raft_consensus.cc:1240] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:08:38.858228 22452 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:38.858693 22452 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:38.858898 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.859674 15714 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:38.859803 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:38.862318 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.862538 22675 raft_consensus.cc:3055] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:38.863224 22675 raft_consensus.cc:740] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:38.864259 22675 consensus_queue.cc:260] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:38.864866 15685 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.865671 22541 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:38.866438 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.866364 22541 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.867848 15685 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.868176 15795 raft_consensus.cc:3060] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.868938 22541 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.870100 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:38.871069 22578 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:38.872416 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.875455 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.877127 15640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.871558 22578 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.882239 22578 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.882599 22657 consensus_queue.cc:1059] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:38.883467 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.883478 22657 raft_consensus.cc:3055] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:38.885394 22657 raft_consensus.cc:740] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:38.886409 22657 consensus_queue.cc:260] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.791908 22683 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.887776 22657 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.889268 22683 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.889788 22526 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:38.818482 22669 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.859853 22452 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.893760 15640 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 19: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:38.894583 22541 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.894632 22392 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.838539 22339 leader_election.cc:290] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:38.875650 22675 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.900408 22578 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.901938 22619 consensus_queue.cc:1059] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:38.902761 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.903400 22155 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.903394 15787 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:38.904331 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:38.904914 15790 raft_consensus.cc:606] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:38.906641 22683 raft_consensus.cc:493] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.907191 22683 raft_consensus.cc:515] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.903396 22619 raft_consensus.cc:3055] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:38.908216 22619 raft_consensus.cc:740] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:38.909174 22683 leader_election.cc:290] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.911178 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.911868 15720 raft_consensus.cc:2393] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 18: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:38.914343 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.916841 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.918361 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:38.920464 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:38.920956 15610 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:38.921774 15640 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:38.921952 15795 raft_consensus.cc:2468] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:38.908912 22599 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:38.923617 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44064.2us
I20260709 13:08:38.924793 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:38.925696 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0932529945e9a284405282d65321" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:38.924400 15685 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:38.927883 15610 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:38.928923 15610 leader_election.cc:304] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:38.922719 15795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56120 (request call id 3011) took 1127 ms. Trace:
I20260709 13:08:38.922930 15789 raft_consensus.cc:1275] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:38.930317 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:38.930886 15716 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.932569 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc71c1b2c74ae3a9bd46fccb533628" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:38.930022 15795 rpcz_store.cc:276] 0709 13:08:37.794913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.796732 (+  1819us) service_pool.cc:224] Handling call
0709 13:08:38.538350 (+741618us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b18002aa560. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad25441646 00007fad2537b58e 00007fad253fcf9e 00007fad253fe7de 00007fad2540a27c 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c
0709 13:08:38.867775 (+329425us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b58009068d0. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad2536f571 00007fad253620aa 00007fad253e4447 00007fad253fcfe7 00007fad253fe7de 00007fad2540a27c 00007fad2a3cbb17 00007fad239466d4 00007fad23946662 00007fad23946591 00007fad2394650c
0709 13:08:38.922644 (+ 54869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879312000}
I20260709 13:08:38.909004 22619 consensus_queue.cc:260] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.937798 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.939193 22649 raft_consensus.cc:2749] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.935047 15759 leader_election.cc:304] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.945366 16329 raft_consensus.cc:1240] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:38.946353 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:38.954684 22619 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.955915 22620 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:38.956354 22620 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:38.956763 22620 raft_consensus.cc:3060] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.965921 22666 raft_consensus.cc:2749] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:38.934814 22155 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:38.940322 22511 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:38.934198 22553 raft_consensus.cc:2749] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.971192 15642 raft_consensus.cc:1240] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:38.974812 22392 raft_consensus.cc:2749] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.937263 22683 raft_consensus.cc:2804] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:38.976454 22683 raft_consensus.cc:697] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:38.978017 22452 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.977708 22683 consensus_queue.cc:237] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.939591 22639 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:38.987138 22639 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:38.987661 22639 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:38.988605 22639 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:38.993829 15720 raft_consensus.cc:1240] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.993997 15722 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:38.995407 15685 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:38.997334 15716 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
W20260709 13:08:38.997848 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 61466.8us
W20260709 13:08:38.999884 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 271582us
I20260709 13:08:38.992112 22667 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:38.998505 15611 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:39.002189 15795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b555226593f4046be916b50c89b97ed"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:39.016063 15795 raft_consensus.cc:606] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:39.017002 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:39.017627 15685 leader_election.cc:304] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.019680 15787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.020062 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.994997 22664 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:39.031584 22664 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.033202 22394 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.002740 22392 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:39.019310 22155 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:39.035892 22155 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:39.036736 22155 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.039273 15792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6317639150e3411184bf3cbb49ba1154" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:38.998955 22560 consensus_queue.cc:1059] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:08:39.041512 22649 raft_consensus.cc:3055] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:39.041949 22649 raft_consensus.cc:740] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:39.042722 22649 consensus_queue.cc:260] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.043763 22649 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.999178 22669 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:39.046144 22669 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.000715 22659 raft_consensus.cc:493] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:39.047817 22659 raft_consensus.cc:515] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.000854 22553 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:08:39.053181 22664 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.022941 22639 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.058087 22553 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.058643 22553 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.022920 16297 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.024228 15795 raft_consensus.cc:614] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:39.025053 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:39.017000 22511 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.064558 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:39.065848 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.003476 22578 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.079447 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:39.086205 15611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.089329 15715 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.090772 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:39.091837 15721 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:39.105053 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea
I20260709 13:08:39.113261 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:39.064333 22595 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.125500 15718 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:39.021226 22667 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.104225 22560 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:39.145649 22665 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:08:39.123559 22666 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:39.075176 22511 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.063024 22620 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.137333 22578 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:39.146359 22548 raft_consensus.cc:493] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:39.199808 22666 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:39.211369 15640 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.207088 22600 raft_consensus.cc:2749] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:39.229219 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 81114.1us
I20260709 13:08:39.203886 22560 consensus_queue.cc:1059] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:39.220484 22666 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.275488 22511 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.232110 22599 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.282287 22620 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.208415 22578 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:39.264262 22696 log.cc:927] Time spent T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:39.268589 22553 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.213912 22548 raft_consensus.cc:515] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.284226 15791 raft_consensus.cc:2410] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:39.263023 22667 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.304737 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:39.317003 22578 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.320483 22262 raft_consensus.cc:993] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:39.321064 22262 raft_consensus.cc:1081] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
W20260709 13:08:39.345943 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 115662us
I20260709 13:08:39.348282 15610 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.326864 22581 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:39.357899 22578 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.367450 22394 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:08:39.375715 15688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.373885 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.351670 22572 consensus_queue.cc:1059] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:39.381840 22578 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.384333 22578 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.387162 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47706
W20260709 13:08:39.387583 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 101540us
I20260709 13:08:39.387928 15715 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.388332 15715 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.391003 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:39.361562 22548 leader_election.cc:290] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.407898 22708 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.376051 22394 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:39.434585 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:39.435739 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:39.436394 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:39.389997 22553 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.412940 15796 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:39.415897 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:39.416996 15793 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:39.418744 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.419489 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.420176 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17db433a32844f26aa2fe7c2d4e4bf66" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:39.421965 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:39.441380 16332 raft_consensus.cc:2393] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 12: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:39.416013 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.408097 22666 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.425680 15716 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:39.431015 15719 raft_consensus.cc:1240] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.432792 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:39.436619 15642 raft_consensus.cc:2393] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 19: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:39.445279 22666 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.449402 22553 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.427323 15715 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.465513 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:39.476806 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:39.467991 15715 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.481902 22572 consensus_queue.cc:1243] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:39.474086 22560 raft_consensus.cc:3055] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:39.487775 22560 raft_consensus.cc:740] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:39.490003 22457 consensus_queue.cc:1059] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:39.490509 22155 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:39.491278 22457 raft_consensus.cc:3055] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:39.491655 22457 raft_consensus.cc:740] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:39.492434 15722 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:39.492871 22155 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:39.492549 22457 consensus_queue.cc:260] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.450870 22553 consensus_queue.cc:1059] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:39.478830 22669 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.495012 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.496814 22155 raft_consensus.cc:2749] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.497289 22714 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.497773 22659 leader_election.cc:290] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:39.498905 15610 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.505571 22368 raft_consensus.cc:3055] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:39.506032 22368 raft_consensus.cc:740] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:39.506167 22486 raft_consensus.cc:2749] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.506678 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:39.506935 22368 consensus_queue.cc:260] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.507884 15789 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Rejecting Update request from peer 228b1ac5589e48af9bbf6caecd6aeaea for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.508311 22368 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.512694 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.514433 22486 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.515921 15610 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:39.522714 15685 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.524063 15685 leader_election.cc:304] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.527310 15685 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:39.527807 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 64297.6us
I20260709 13:08:39.536720 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:39.537426 15793 raft_consensus.cc:606] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:39.537832 15793 raft_consensus.cc:614] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:39.540704 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.540998 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.543438 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.544540 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.532917 22680 raft_consensus.cc:2749] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:39.533094 22664 raft_consensus.cc:2749] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:39.554077 22155 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.575357 22394 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.572347 15760 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:39.578640 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:39.580651 22262 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.554458 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:39.539887 22669 raft_consensus.cc:2749] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.554924 15536 catalog_manager.cc:5697] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 16 to 17, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.591341 15536 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 10 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.555859 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f37d51951a494996e57f1247bd69ee" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.541213 22457 raft_consensus.cc:3060] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.541383 22674 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:08:39.560328 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:39.542634 22714 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.594789 15795 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:39.595155 15795 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:39.595993 15795 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.597108 15795 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.563329 22560 consensus_queue.cc:260] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.599807 22560 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.600507 22590 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:39.569623 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.570878 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084942b6c014c78b9a4ece4089fb430" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:39.604696 22590 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:39.574215 15639 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:39.565372 22717 consensus_queue.cc:1048] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:39.607060 22590 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:39.611438 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 65454.2us
I20260709 13:08:39.612599 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.610344 22590 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.614315 15685 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.612188 22669 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.614879 22717 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.619949 22659 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.609660 15795 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:39.624078 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:39.624682 15790 raft_consensus.cc:606] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:39.634784 15685 leader_election.cc:304] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:39.626744 15793 raft_consensus.cc:2468] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:39.640163 15791 raft_consensus.cc:2468] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 12.
I20260709 13:08:39.596853 15536 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 11 to 16, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 16 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.650327 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:39.660487 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:39.661356 15642 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.664248 15536 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 8 to 18, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 18 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.666188 15685 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:39.667613 22482 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:39.668278 22482 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:39.668712 22667 raft_consensus.cc:2804] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:39.669332 22667 raft_consensus.cc:697] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:39.670496 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:39.651628 22155 raft_consensus.cc:2749] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.657346 22541 raft_consensus.cc:2749] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.686196 22667 consensus_queue.cc:237] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.669634 22482 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.688393 22394 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.698237 15643 raft_consensus.cc:1240] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Rejecting Update request from peer c1927141dc2540dab644a00fd6843fc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.700538 16297 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:39.701788 22590 raft_consensus.cc:2804] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:39.682065 15685 leader_election.cc:304] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.702718 22590 raft_consensus.cc:697] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:39.721781 15793 raft_consensus.cc:606] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:39.722417 15793 raft_consensus.cc:614] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:39.725551 15642 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 15.
I20260709 13:08:39.727504 22541 raft_consensus.cc:2749] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.720942 22490 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.739660 22718 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.740047 22683 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:08:39.745440 22718 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.779414 22718 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.780027 22155 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.780624 22155 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.782254 15536 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 10 to 13, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 13 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.784240 15791 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:39.787263 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.758654 22590 consensus_queue.cc:237] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:39.787992 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:39.789158 22155 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.790184 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:39.798198 15639 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 19: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:39.794807 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:39.799657 15719 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:39.745620 22490 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.802126 22490 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:39.805044 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:39.807606 22714 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:39.808049 22714 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.808418 22714 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.812665 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:39.813874 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:39.814718 15719 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:39.815740 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:39.815920 15760 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:39.820226 15790 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:39.820575 22690 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:39.821038 22690 raft_consensus.cc:493] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.821383 22690 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:39.822916 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:39.823602 15645 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:39.826694 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:39.830945 15793 raft_consensus.cc:1275] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:39.831909 22553 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.836992 22368 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.837694 22368 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.839644 22659 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:39.840106 22659 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:39.840500 22659 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.784789 15536 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 12 to 15, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.846827 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:39.867481 22368 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:39.868084 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:39.869875 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24ffe6bbf294850b0b75309859cae27" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:39.870633 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 44069.3us
I20260709 13:08:39.874599 15790 raft_consensus.cc:2410] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:39.876756 15610 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:39.887467 22526 consensus_queue.cc:1048] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.892565 22368 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.849406 15536 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.973681 15536 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 10 to 13, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 13 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.978559 22690 raft_consensus.cc:515] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:39.979476 15536 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 9 to 15, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.982954 15536 catalog_manager.cc:5697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.988737 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:39.989432 15638 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:40.001397 15638 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 21.
I20260709 13:08:40.021596 15762 leader_election.cc:304] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.012254 22444 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.028095 22692 raft_consensus.cc:2804] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:40.033504 22444 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:40.047567 22692 raft_consensus.cc:697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 21 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:40.003590 15536 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 14 to 17, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.097255 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:40.088487 22692 consensus_queue.cc:237] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.104365 15638 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:40.105986 16300 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.109951 22599 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:40.110452 22599 raft_consensus.cc:493] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.111577 22599 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.133427 22690 leader_election.cc:290] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:40.134743 22444 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.137163 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:40.138031 15795 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:40.141420 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dda60c3af4cf59874ffb47ae0ec1f" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:40.142079 15718 raft_consensus.cc:3060] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:40.149906 15718 raft_consensus.cc:2468] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 21.
I20260709 13:08:40.105197 22714 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.152516 22599 raft_consensus.cc:515] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:40.154340 22714 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.156785 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:40.157454 15795 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.170508 15795 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
I20260709 13:08:40.171041 22599 leader_election.cc:290] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.173666 15794 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:40.174746 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:40.174894 16297 leader_election.cc:304] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:40.175630 15721 raft_consensus.cc:2393] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 17: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:40.175892 22599 raft_consensus.cc:2804] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:40.176704 22599 raft_consensus.cc:697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:40.177656 22599 consensus_queue.cc:237] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:40.183334 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5a8a31a7e747c69abd21e5dbc2c1d9" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:40.183892 15639 raft_consensus.cc:3060] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.187247 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:40.196913 15639 raft_consensus.cc:2468] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
I20260709 13:08:40.211625 22659 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.222332 15536 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 14 to 15, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.224953 15536 catalog_manager.cc:5697] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 2 to 17, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.227910 15536 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 11 to 14, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 14 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.245646 22526 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:40.259959 15796 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.270252 15794 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:40.250154 22368 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.272603 15610 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:40.274981 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:40.275143 22560 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:40.290021 22690 raft_consensus.cc:993] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:40.290583 22666 raft_consensus.cc:1081] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:40.282711 22714 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.291703 22714 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.274979 22541 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:40.288226 22560 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:40.298264 22560 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.299160 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:40.300218 15721 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:40.301544 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.302263 15790 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:40.302461 22486 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.302951 22486 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.303314 22486 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.303690 22590 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:40.316996 15638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42130
I20260709 13:08:40.317790 15638 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.318200 15638 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.318110 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:40.320091 22566 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.320578 22566 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.323273 22566 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:40.323807 15643 raft_consensus.cc:1275] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:40.319612 15794 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:40.325381 22714 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.326107 22599 consensus_queue.cc:1048] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:40.327064 22659 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.274329 22368 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.332899 15639 raft_consensus.cc:2393] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 19: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:40.333910 22368 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.335438 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:40.336077 15721 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:40.339653 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:40.340289 15715 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:40.340922 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:40.341521 15639 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:40.337393 15611 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.343802 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:40.344401 15794 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:40.348181 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.349296 22666 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:40.349699 22666 raft_consensus.cc:493] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.349846 22714 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:40.350591 22714 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.350927 22714 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:40.350064 22666 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.362190 15638 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:40.363945 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:40.371161 15795 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:40.374773 15645 raft_consensus.cc:1275] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:40.375345 15642 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.377466 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:40.378561 22659 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:40.379343 22659 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:40.380234 22659 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.391151 15638 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:40.398504 22714 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.401929 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:40.402563 15796 raft_consensus.cc:3055] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:40.402872 15796 raft_consensus.cc:740] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:40.403548 15796 consensus_queue.cc:260] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:40.405242 22690 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:40.405808 22690 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.408345 22690 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:40.409355 22486 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.412956 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:40.413813 15720 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.418498 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
W20260709 13:08:40.420038 15762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.421176 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:40.421763 16329 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.423381 15720 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:40.424528 15611 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.425274 22553 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:40.425771 22553 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:40.426594 22553 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.432484 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:40.434732 16329 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:40.445099 15796 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.433183 15719 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:40.455892 15638 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:40.479151 22714 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.471915 22541 consensus_queue.cc:1048] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:08:40.360970 22666 raft_consensus.cc:515] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.484506 22666 leader_election.cc:290] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:40.486256 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:40.486999 15638 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.463255 15610 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.494771 22560 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:40.495502 22560 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:40.502025 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:40.502717 15790 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:40.507962 22541 raft_consensus.cc:476] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:40.509594 22486 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:40.520437 15790 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 20.
I20260709 13:08:40.509425 22560 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:40.522636 15638 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:40.523243 22482 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:40.527318 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:40.529446 15793 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:40.523173 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 58856.5us
I20260709 13:08:40.534873 15762 leader_election.cc:304] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.537909 15796 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:40.536970 15610 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.550046 22486 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:40.558779 22498 raft_consensus.cc:2804] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:40.564316 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2577557ef849f9bd90a2b23564a72e" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:40.565086 15721 raft_consensus.cc:3060] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.566829 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:40.567793 15793 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:40.578981 15645 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:40.580792 22457 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:40.564661 22486 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:40.583964 22486 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.585443 15721 raft_consensus.cc:2468] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:40.574416 22498 raft_consensus.cc:697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:40.588824 22498 consensus_queue.cc:237] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.598917 22457 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.599558 22457 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.608088 15793 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:40.610293 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:40.611166 15642 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:40.602375 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:40.613618 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:40.620042 22444 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:08:40.601729 22457 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:40.617751 22566 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.619642 22690 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.668928 15721 raft_consensus.cc:1275] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:40.675984 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:40.676743 15721 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:08:40.648639 22566 raft_consensus.cc:493] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.650866 22690 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:40.682984 22566 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.686375 22690 raft_consensus.cc:3060] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.734649 22566 raft_consensus.cc:515] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.736949 22566 leader_election.cc:290] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:40.737429 22690 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:40.740098 22690 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:40.752715 22745 log.cc:927] Time spent T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:08:40.805843 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 91461.2us
I20260709 13:08:40.808344 15645 raft_consensus.cc:1275] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:40.840932 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:40.842590 15646 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.897187 22599 consensus_queue.cc:1048] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:40.869406 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:40.906852 15642 raft_consensus.cc:2393] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
I20260709 13:08:40.926429 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.935799 15646 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:41.015506 22757 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:41.030049 22757 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.032951 22757 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:41.040575 15762 leader_election.cc:304] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:41.042090 22692 raft_consensus.cc:2804] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:41.042793 22692 raft_consensus.cc:697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:41.044291 22692 consensus_queue.cc:237] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:41.048722 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 57083.8us
I20260709 13:08:41.058145 15642 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:41.101128 22486 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.101830 22486 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.105180 22486 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:41.114876 15796 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:41.123082 15793 raft_consensus.cc:1240] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:41.125511 22692 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.126389 22692 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.127786 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:41.129067 22692 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:41.135401 22757 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.136034 15642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:41.136754 15642 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:41.136966 22757 raft_consensus.cc:3055] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:41.137342 22757 raft_consensus.cc:740] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:41.138854 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:41.139564 22757 consensus_queue.cc:260] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.148867 22526 consensus_queue.cc:1059] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.149833 22526 consensus_queue.cc:1243] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Peer fec10611791a4ab384f86b212249410e log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:41.151432 22757 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.159029 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:41.159905 15639 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:41.144531 22692 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:41.161460 22692 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.161924 22692 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.195914 22690 consensus_queue.cc:1048] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:41.210634 15722 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:41.214126 15795 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:41.216226 22368 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:41.214190 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:41.217239 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:41.221879 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b555226593f4046be916b50c89b97ed" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:41.222623 15721 raft_consensus.cc:3060] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.222775 15790 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:41.224224 22560 raft_consensus.cc:493] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.224746 22560 raft_consensus.cc:515] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.226032 15720 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:41.229475 22560 leader_election.cc:290] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:41.238649 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:41.239514 15722 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:41.241533 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:41.242677 15719 raft_consensus.cc:2468] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:41.243693 15722 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:08:41.244138 15722 pending_rounds.cc:85] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 10
I20260709 13:08:41.244429 15722 pending_rounds.cc:107] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:08:41.244776 15722 raft_consensus.cc:2889] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.248307 15545 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 15, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 15 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } attrs { replace: true } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:41.258143 22680 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.258749 22680 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.259428 22486 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.260243 22708 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:41.256984 15545 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.271550 15721 raft_consensus.cc:2468] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:08:41.272528 22541 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:41.273420 22541 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:41.263957 22680 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:41.275712 22541 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:41.272603 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:41.278996 15795 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:41.280297 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:41.281373 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:41.281656 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:41.282899 16330 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:41.283169 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:41.283875 15718 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:41.284152 22526 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:41.284611 22526 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.285000 22526 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.291128 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:41.295668 15715 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:41.300913 15639 raft_consensus.cc:1275] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:41.302767 22541 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:41.303190 22541 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:41.303627 22541 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.296098 22560 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:41.306526 22560 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.306891 22560 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.307397 22756 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.294121 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:41.323863 22762 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:41.327530 15794 raft_consensus.cc:2393] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 18: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:41.361510 15545 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 17 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.363360 15545 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 16, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 16 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:41.368649 22692 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.369853 15796 raft_consensus.cc:2368] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20.
I20260709 13:08:41.372195 15685 leader_election.cc:400] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20.
I20260709 13:08:41.372498 15685 leader_election.cc:403] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.373484 22667 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.379446 15760 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:41.381907 22690 raft_consensus.cc:2804] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:41.382575 22690 raft_consensus.cc:697] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:41.383788 22690 consensus_queue.cc:237] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:41.387957 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 64680.3us
W20260709 13:08:41.404830 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 110573us
I20260709 13:08:41.365224 15545 catalog_manager.cc:5697] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 18 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.442111 22756 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.460882 22667 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20.
I20260709 13:08:41.462765 22560 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.463882 22761 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:41.465045 22560 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:41.466854 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:41.467837 22756 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:41.474824 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:41.475660 22756 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:41.453301 22526 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.478366 15722 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 20.
I20260709 13:08:41.480144 15715 raft_consensus.cc:1240] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Rejecting Update request from peer fec10611791a4ab384f86b212249410e for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:41.480543 15611 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:41.462940 22656 consensus_queue.cc:1048] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:08:41.482686 22560 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:41.499550 22560 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:41.500831 22560 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.504439 22692 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:41.454116 22762 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:08:41.513885 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 54972.6us
I20260709 13:08:41.515471 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:41.516666 15721 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 20: Already voted for candidate fec10611791a4ab384f86b212249410e in this term.
W20260709 13:08:41.519894 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 63686.1us
I20260709 13:08:41.532011 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:41.535323 15545 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 15, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 15 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:41.532889 16330 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:41.547698 15795 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:41.543496 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ae6fa375a4fc39d6970b0c40cfd72" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:41.537062 15545 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:41.550357 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:41.566041 15793 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fec10611791a4ab384f86b212249410e in current term 20: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:41.563542 15645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:41.577915 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:41.606680 15638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:41.614120 22768 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:41.614897 22768 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.615347 22768 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.623603 22541 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:41.625141 15718 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:41.643735 22526 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:41.623484 16329 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:41.653390 22541 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:41.658690 22368 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:41.668131 22486 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:08:41.704455 22560 consensus_queue.cc:1059] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.705881 22560 raft_consensus.cc:3055] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:41.706251 22560 raft_consensus.cc:740] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:41.707083 22560 consensus_queue.cc:260] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:41.708241 22560 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.714128 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:41.723623 15639 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:41.765879 22768 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:41.791251 16329 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:41.804086 15610 leader_election.cc:304] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:41.806223 22708 raft_consensus.cc:2749] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:41.808139 22777 log.cc:927] Time spent T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.122s	user 0.002s	sys 0.001s
I20260709 13:08:41.804184 15719 raft_consensus.cc:1275] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:41.821419 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:41.830102 15647 raft_consensus.cc:2410] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:08:41.830452 22498 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:41.837922 22768 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:41.838944 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:41.839534 16329 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.840890 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:41.846066 22692 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:41.873234 15545 catalog_manager.cc:5697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.874603 22756 consensus_queue.cc:1048] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:41.875506 15545 catalog_manager.cc:5697] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 17, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 17 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:41.908177 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50561.4us
I20260709 13:08:41.912817 15714 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:41.919546 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:41.921070 22784 log.cc:927] Time spent T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:08:41.923604 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:41.922580 15685 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:41.926855 15790 raft_consensus.cc:2368] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19.
W20260709 13:08:41.946578 22788 log.cc:927] Time spent T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:41.945458 22776 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:41.949086 22776 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:41.950156 22776 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:41.959074 16329 raft_consensus.cc:2468] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:41.982493 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b3bbf62c44a84bc360356d580684d" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:42.022290 15759 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:42.031971 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 55954.6us
I20260709 13:08:42.058274 15685 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:42.030659 22656 raft_consensus.cc:2804] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:42.068753 15545 catalog_manager.cc:5697] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 16 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.083819 15685 leader_election.cc:400] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Vote denied by peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499) with higher term. Message: Invalid argument: T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19.
I20260709 13:08:42.085223 22659 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:42.087419 15638 raft_consensus.cc:1275] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:42.088337 15715 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:42.091452 22769 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:42.091235 15545 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.093108 15545 catalog_manager.cc:5697] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 17, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 17 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:08:42.100170 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 182998us
I20260709 13:08:42.099375 22656 raft_consensus.cc:697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:42.115638 22656 consensus_queue.cc:237] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:42.125094 22768 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:42.131646 15545 catalog_manager.cc:5697] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 18 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.137318 15794 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:42.148940 22656 consensus_queue.cc:1048] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:42.155746 15545 catalog_manager.cc:5697] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 18 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.157533 15545 catalog_manager.cc:5697] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 14 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.158946 15545 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 18 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.160486 15545 catalog_manager.cc:5697] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 7 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 18 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:42.170290 15536 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 251) took 22999 ms (client timeout 15000 ms). Trace:
W20260709 13:08:42.182266 22796 log.cc:927] Time spent T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:08:42.229318 15545 catalog_manager.cc:5697] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:42.231935 15545 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 17 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:42.170933 15536 rpcz_store.cc:269] 0709 13:08:19.170881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.182254 (+ 11373us) service_pool.cc:224] Handling call
0709 13:08:42.169984 (+22987730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:40.513607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:40.514161 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:40.514206 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:40.514217 (+    11us) tablet.cc:662] Decoding operations
0709 13:08:40.515349 (+  1132us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:40.515409 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:40.515435 (+    26us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:40.517127 (+  1692us) tablet.cc:701] Row locks acquired
0709 13:08:40.517149 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:40.517298 (+   149us) write_op.cc:270] Start()
0709 13:08:40.517422 (+   124us) write_op.cc:276] Timestamp: P: 1783602520517248 usec, L: 0
0709 13:08:40.517446 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:40.534048 (+ 16602us) log.cc:844] Serialized 5482 byte log entry
0709 13:08:40.727532 (+193484us) op_driver.cc:464] REPLICATION: finished
0709 13:08:40.748411 (+ 20879us) write_op.cc:301] APPLY: starting
0709 13:08:40.748498 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:40.766927 (+ 18429us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:40.767066 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:40.923929 (+156863us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:40.965853 (+ 41924us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:08:40.965931 (+    78us) write_op.cc:312] APPLY: finished
0709 13:08:40.966595 (+   664us) log.cc:844] Serialized 129 byte log entry
0709 13:08:40.971122 (+  4527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.985608 (+ 14486us) write_op.cc:454] Released schema lock
0709 13:08:40.989590 (+  3982us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:41.016004 (+ 26414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.016695 (+   691us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58409,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":20613,"apply.run_cpu_time_us":23805,"apply.run_wall_time_us":241995,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62591,"num_ops":14,"prepare.queue_time_us":170339,"prepare.run_cpu_time_us":50157,"prepare.run_wall_time_us":132399,"raft.queue_time_us":7343,"raft.run_cpu_time_us":10975,"raft.run_wall_time_us":20883,"replication_time_us":209916,"spinlock_wait_cycles":56064,"thread_start_us":229834,"threads_started":4,"wal-append.queue_time_us":146260,"wal-append.run_cpu_time_us":8761,"wal-append.run_wall_time_us":1303551}]]}
I20260709 13:08:42.248533 15545 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 15, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 15 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:08:42.253159 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 106263us
I20260709 13:08:42.263617 15545 catalog_manager.cc:5697] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.265285 15545 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.266649 15545 catalog_manager.cc:5697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 13, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 13 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:08:42.273651 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 132311us
I20260709 13:08:42.279364 15545 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 18, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 18 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.294428 15545 catalog_manager.cc:5697] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 21, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 21 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.296069 22773 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:42.296448 15545 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 15, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.308171 15545 catalog_manager.cc:5697] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 15, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 15 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.340245 15545 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 10 to 14, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 14 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:42.367595 15545 catalog_manager.cc:5697] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 18 to 22, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 22 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:42.410789 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 47869.4us
I20260709 13:08:42.439868 15795 raft_consensus.cc:1240] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:42.445986 22793 consensus_queue.cc:1059] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:42.446851 22793 consensus_queue.cc:1243] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Peer c1927141dc2540dab644a00fd6843fc6 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:42.447242 22526 raft_consensus.cc:3055] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:42.447679 22526 raft_consensus.cc:740] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:42.448596 22526 consensus_queue.cc:260] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:42.450003 22526 raft_consensus.cc:3060] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.440864 15545 catalog_manager.cc:5697] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.472998 15545 catalog_manager.cc:5697] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.474851 15545 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 19, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 19 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:42.502053 15545 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.544423 15718 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:08:42.544943 15718 pending_rounds.cc:85] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting all ops after (but not including) 12
I20260709 13:08:42.545202 15718 pending_rounds.cc:107] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:08:42.545466 15718 raft_consensus.cc:2889] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.547679 22755 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:42.558058 16333 raft_consensus.cc:1275] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:42.558004 15545 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.560078 22756 consensus_queue.cc:1048] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:42.914995 22769 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.915509 22769 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:42.919353 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:42.919951 15716 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:42.927680 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:42.926596 22769 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:42.927290 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:42.937125 22773 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:42.937602 22773 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.938035 22773 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.021349 22773 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.036615 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:43.037238 15716 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.059852 15716 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 19.
I20260709 13:08:43.060226 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:43.066956 22773 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:43.078325 15611 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:43.082163 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:43.083124 22773 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:43.083802 22773 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:43.084863 22773 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.198076 15639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:08:43.198872 15639 raft_consensus.cc:606] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:43.204782 15796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:43.205392 15796 raft_consensus.cc:606] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:43.205729 15796 raft_consensus.cc:614] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.213620 15643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95371a1d960048e7af7796052350a058"
dest_uuid: "fec10611791a4ab384f86b212249410e"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:45878
I20260709 13:08:43.214263 15643 raft_consensus.cc:606] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:43.218118 15796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:43.218820 15796 raft_consensus.cc:606] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:43.219218 15796 raft_consensus.cc:614] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.227077 15796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38"
dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
mode: GRACEFUL
new_leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:08:43.229875 15796 raft_consensus.cc:606] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Received request to transfer leadership to TS 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:43.230310 15796 raft_consensus.cc:614] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.231846 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:43.254105 22690 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:43.254787 22690 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.257342 22690 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:43.259128 15643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fec10611791a4ab384f86b212249410e" is_pre_election: true
I20260709 13:08:43.258455 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:43.263594 15718 raft_consensus.cc:2368] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:43.271682 15760 leader_election.cc:400] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:43.272019 15760 leader_election.cc:403] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.272553 22690 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.278469 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:43.281405 15539 catalog_manager.cc:5697] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 14 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 17 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.291599 22690 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695) with higher term. Message: Invalid argument: T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 for earlier term 18. Current term is 19.
I20260709 13:08:43.304400 15539 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 7 to 13, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 13 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.308485 15539 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 15 to 16, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 16 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.312738 15539 catalog_manager.cc:5697] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 16 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 17 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.320396 15539 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 7 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 17 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.321662 15539 catalog_manager.cc:5697] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 17 to 18, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 18 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.323889 15539 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 11 to 17, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.326833 15539 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.330313 15545 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33358 (request call id 278) took 5234 ms. Trace:
I20260709 13:08:43.330781 15545 rpcz_store.cc:276] 0709 13:08:38.096185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.096345 (+   160us) service_pool.cc:224] Handling call
0709 13:08:38.203994 (+107649us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400310010. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e20b2 00007fad2b25ba89 00007fad2b1f3da6 00007fad2b1c5088 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc
0709 13:08:38.274980 (+ 70986us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b5400310010. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1e9c 00007fad222e20f6 00007fad2b25ba89 00007fad2b1f3da6 00007fad2b1c5088 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc
0709 13:08:43.330231 (+5055251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.619104 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.621216 (+  2112us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.621272 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:42.621296 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:42.624627 (+  3331us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.624760 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.624797 (+    37us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:08:42.628242 (+  3445us) tablet.cc:701] Row locks acquired
0709 13:08:42.628304 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:08:42.628495 (+   191us) write_op.cc:270] Start()
0709 13:08:42.628676 (+   181us) write_op.cc:276] Timestamp: P: 1783602522628423 usec, L: 0
0709 13:08:42.628711 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.629615 (+   904us) log.cc:844] Serialized 13154 byte log entry
0709 13:08:42.855355 (+225740us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.908408 (+ 53053us) write_op.cc:301] APPLY: starting
0709 13:08:42.908518 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.988234 (+ 79716us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.988360 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:43.197098 (+208738us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:43.201823 (+  4725us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 13:08:43.201868 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:43.202387 (+   519us) log.cc:844] Serialized 292 byte log entry
0709 13:08:43.204357 (+  1970us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.204598 (+   241us) write_op.cc:454] Released schema lock
0709 13:08:43.204672 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:43.216955 (+ 12283us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.216990 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":660040,"reported_tablets":50,"spinlock_wait_cycles":48403456,"child_traces":[["op",{"apply.queue_time_us":52752,"apply.run_cpu_time_us":44669,"apply.run_wall_time_us":300156,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146111,"num_ops":34,"prepare.queue_time_us":30045,"prepare.run_cpu_time_us":29544,"prepare.run_wall_time_us":71063,"raft.queue_time_us":123628,"raft.run_cpu_time_us":5508,"raft.run_wall_time_us":39723,"replication_time_us":226463,"spinlock_wait_cycles":3968,"thread_start_us":240297,"threads_started":4,"wal-append.queue_time_us":97102}]]}
I20260709 13:08:43.477626 22769 raft_consensus.cc:993] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:43.478293 22773 raft_consensus.cc:1081] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:43.480872 15716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:08:43.481606 15716 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.482002 15716 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.530505 15718 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:43.532981 22773 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:43.545463 15539 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 154) took 14971 ms (client timeout 15000 ms). Trace:
I20260709 13:08:43.551112 22761 raft_consensus.cc:993] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: : Instructing follower 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:43.569725 22761 raft_consensus.cc:1081] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Signalling peer 8ca6a5ab086d47e5a79ef37ddead9f28 to start an election
I20260709 13:08:43.552412 15545 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 19, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 19 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.571795 15714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95371a1d960048e7af7796052350a058"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
 from {username='slave'} at 127.0.0.1:47700
I20260709 13:08:43.572623 15714 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.573338 15714 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:43.572558 15539 rpcz_store.cc:269] 0709 13:08:28.573953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.574113 (+   160us) service_pool.cc:224] Handling call
0709 13:08:43.545363 (+14971250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.434144 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.434771 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.434817 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:08:43.434835 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:43.435722 (+   887us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.435795 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.435828 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:43.436474 (+   646us) tablet.cc:701] Row locks acquired
0709 13:08:43.436493 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:43.436652 (+   159us) write_op.cc:270] Start()
0709 13:08:43.436758 (+   106us) write_op.cc:276] Timestamp: P: 1783602523436585 usec, L: 0
0709 13:08:43.436779 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.437396 (+   617us) log.cc:844] Serialized 3170 byte log entry
0709 13:08:43.490644 (+ 53248us) op_driver.cc:464] REPLICATION: finished
0709 13:08:43.491217 (+   573us) write_op.cc:301] APPLY: starting
0709 13:08:43.491300 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:43.497880 (+  6580us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:43.497990 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:43.507840 (+  9850us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:43.508065 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:43.508116 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:43.510828 (+  2712us) log.cc:844] Serialized 81 byte log entry
0709 13:08:43.511639 (+   811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.511774 (+   135us) write_op.cc:454] Released schema lock
0709 13:08:43.511825 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:43.531330 (+ 19505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.531371 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50936,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":330,"apply.run_cpu_time_us":11048,"apply.run_wall_time_us":40032,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33408,"num_ops":8,"prepare.queue_time_us":81839,"prepare.run_cpu_time_us":3594,"prepare.run_wall_time_us":20350,"replication_time_us":53688,"thread_start_us":57884,"threads_started":1}]]}
I20260709 13:08:43.571408 15545 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 18, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 18 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.609517 15545 catalog_manager.cc:5697] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.610360 15716 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.613328 15545 catalog_manager.cc:5697] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 19, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 19 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.624634 15545 catalog_manager.cc:5697] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 19, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 19 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.626168 15545 catalog_manager.cc:5697] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 19, leader changed from 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 19 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.627781 15545 catalog_manager.cc:5697] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.630164 15716 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:43.628608 15714 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.631942 15714 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:43.633903 15639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:43.634487 15639 raft_consensus.cc:3055] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:43.634816 15639 raft_consensus.cc:740] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:43.635605 15639 consensus_queue.cc:260] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.636971 15639 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.632251 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "fec10611791a4ab384f86b212249410e"
I20260709 13:08:43.646075 15646 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:43.646451 15646 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:43.630396 15545 catalog_manager.cc:5697] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 16, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 16 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.647385 15646 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.653021 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95371a1d960048e7af7796052350a058" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:43.697783 15793 raft_consensus.cc:3060] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.647740 15545 catalog_manager.cc:5697] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.703507 15545 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 16, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 16 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.704959 15545 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 18 to 20, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 20 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.706305 15545 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.707127 15793 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:43.707595 15545 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 15, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 15 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.696282 15791 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:43.708636 15685 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:43.648829 15646 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.709457 22667 raft_consensus.cc:2804] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:43.710042 22667 raft_consensus.cc:697] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:43.711089 22667 consensus_queue.cc:237] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:43.652280 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:43.714454 15796 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.718461 22769 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:43.709023 15545 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.730587 15545 catalog_manager.cc:5697] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 13 to 15, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.732493 15796 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:43.669098 15639 raft_consensus.cc:2468] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:43.735289 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:43.732448 15545 catalog_manager.cc:5697] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 20 to 21, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 21 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.737165 15646 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:43.737648 22793 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:43.738274 22793 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:43.738138 15545 catalog_manager.cc:5697] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 12 to 17, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 17 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.739863 15545 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:43.739131 22793 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:43.672756 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 60391.5us
I20260709 13:08:43.741079 15545 catalog_manager.cc:5697] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 11 to 12, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 12 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:43.757489 15545 catalog_manager.cc:5697] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 18, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 18 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
W20260709 13:08:43.800918 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 45156.2us
I20260709 13:08:44.047998 15545 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 19, leader changed from c1927141dc2540dab644a00fd6843fc6 (127.14.45.3) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 19 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:08:44.148351 15542 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 249) took 74166 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.148861 15542 rpcz_store.cc:269] 0709 13:07:29.982201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.983521 (+  1320us) service_pool.cc:224] Handling call
0709 13:08:44.146696 (+74163175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29873,"reported_tablets":51}
I20260709 13:08:44.248591 15646 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:44.250439 22774 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:44.266458 15641 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:44.268267 22825 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:44.279764 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:44.316869 15543 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 278) took 92161 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.317477 15543 rpcz_store.cc:269] 0709 13:07:12.155133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.155337 (+   204us) service_pool.cc:224] Handling call
0709 13:08:44.316631 (+92161294us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":51}
I20260709 13:08:44.325611 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet b106b4017dc84b21a7c6f58814593886 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:53344
I20260709 13:08:44.384742 15791 raft_consensus.cc:1275] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:44.404877 22848 consensus_queue.cc:1048] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:44.427528 15791 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:08:44.454483 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 90753.3us
I20260709 13:08:44.444855 22825 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:08:44.786577 15540 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 250) took 50795 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.787030 15540 rpcz_store.cc:269] 0709 13:07:53.991274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.991684 (+   410us) service_pool.cc:224] Handling call
0709 13:08:44.786366 (+50794682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":589056,"reported_tablets":51}
I20260709 13:08:44.786602 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet b106b4017dc84b21a7c6f58814593886 (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
I20260709 13:08:44.802592 15544 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 18 to 19, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 19 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:44.811542 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 298159us
I20260709 13:08:45.017066 15543 catalog_manager.cc:5697] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 18 to 19, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 19 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
I20260709 13:08:45.077368 15543 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 19 to 20, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 20 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } }
W20260709 13:08:45.134192 15544 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 281) took 23256 ms (client timeout 15000 ms). Trace:
W20260709 13:08:45.134573 15544 rpcz_store.cc:269] 0709 13:08:21.878435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.878646 (+   211us) service_pool.cc:224] Handling call
0709 13:08:22.248251 (+369605us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001063d4. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad25370090 00007fad2540ef3a 00007fad2b1c51cc 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc 00007fad29783392 00007fad2374148c 00007fad237408c6
0709 13:08:45.134120 (+22885869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:44.890650 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:44.891479 (+   829us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:44.891514 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:44.891532 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:44.891852 (+   320us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:44.891922 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:44.891955 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:44.892129 (+   174us) tablet.cc:701] Row locks acquired
0709 13:08:44.892146 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:44.892273 (+   127us) write_op.cc:270] Start()
0709 13:08:44.892381 (+   108us) write_op.cc:276] Timestamp: P: 1783602524892230 usec, L: 0
0709 13:08:44.892402 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:44.893067 (+   665us) log.cc:844] Serialized 530 byte log entry
0709 13:08:44.954090 (+ 61023us) op_driver.cc:464] REPLICATION: finished
0709 13:08:44.990970 (+ 36880us) write_op.cc:301] APPLY: starting
0709 13:08:44.991055 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:44.992272 (+  1217us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:44.992386 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:44.993117 (+   731us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:44.993316 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:44.993369 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:44.993590 (+   221us) log.cc:844] Serialized 25 byte log entry
0709 13:08:44.994468 (+   878us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.994558 (+    90us) write_op.cc:454] Released schema lock
0709 13:08:44.994621 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.026002 (+ 31381us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.026044 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23095,"reported_tablets":51,"spinlock_wait_cycles":421635456,"child_traces":[["op",{"apply.queue_time_us":36641,"apply.run_cpu_time_us":3378,"apply.run_wall_time_us":35018,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8303,"num_ops":1,"prepare.queue_time_us":30974,"prepare.run_cpu_time_us":2495,"prepare.run_wall_time_us":2770,"replication_time_us":61471,"spinlock_wait_cycles":89984,"thread_start_us":60901,"threads_started":2}]]}
W20260709 13:08:45.140952 15541 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 152) took 47714 ms (client timeout 15000 ms). Trace:
W20260709 13:08:45.148146 15541 rpcz_store.cc:269] 0709 13:07:57.426074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.426254 (+   180us) service_pool.cc:224] Handling call
0709 13:08:45.140750 (+47714496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29609,"reported_tablets":28}
I20260709 13:08:45.146862 15537 catalog_manager.cc:5697] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 16 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 17 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:45.169265 15537 catalog_manager.cc:5697] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 19 to 20, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 20 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:45.198714 15537 catalog_manager.cc:5697] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:45.201000 15537 catalog_manager.cc:5697] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 17 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 18 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:45.374655 15537 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33330 (request call id 252) took 6848 ms. Trace:
I20260709 13:08:45.380517 15537 rpcz_store.cc:276] 0709 13:08:38.526217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.880640 (+354423us) service_pool.cc:224] Handling call
0709 13:08:39.321968 (+441328us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400310010. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e20b2 00007fad2b25ba89 00007fad2b1f3da6 00007fad2b1c5088 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc
0709 13:08:45.374590 (+6052622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.246238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.246816 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.246862 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:08:45.246883 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:45.247513 (+   630us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.247578 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.247611 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:45.248030 (+   419us) tablet.cc:701] Row locks acquired
0709 13:08:45.248050 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:45.248210 (+   160us) write_op.cc:270] Start()
0709 13:08:45.248327 (+   117us) write_op.cc:276] Timestamp: P: 1783602525248164 usec, L: 0
0709 13:08:45.248349 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.249016 (+   667us) log.cc:844] Serialized 1662 byte log entry
0709 13:08:45.253368 (+  4352us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.253835 (+   467us) write_op.cc:301] APPLY: starting
0709 13:08:45.253968 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.256211 (+  2243us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.256314 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.259750 (+  3436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.259908 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:45.259951 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:45.260172 (+   221us) log.cc:844] Serialized 49 byte log entry
0709 13:08:45.261237 (+  1065us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.261329 (+    92us) write_op.cc:454] Released schema lock
0709 13:08:45.261375 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.261666 (+   291us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.261692 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4867,"reported_tablets":51,"spinlock_wait_cycles":28358912,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":5878,"apply.run_wall_time_us":7806,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16704,"num_ops":4,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":3082,"prepare.run_wall_time_us":6934,"replication_time_us":4900}]]}
W20260709 13:08:45.515213 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 43726.9us
I20260709 13:08:45.538532 15536 catalog_manager.cc:5697] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 17 to 20, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 20 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:08:45.720947 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:45.728813 15538 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 280) took 42671 ms (client timeout 15000 ms). Trace:
W20260709 13:08:45.732470 15538 rpcz_store.cc:269] 0709 13:08:03.065911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.067012 (+  1101us) service_pool.cc:224] Handling call
0709 13:08:45.728684 (+42661672us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42040,"reported_tablets":51}
I20260709 13:08:45.788313 15536 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33344 (request call id 282) took 5512 ms. Trace:
I20260709 13:08:45.822891 15536 rpcz_store.cc:276] 0709 13:08:40.278926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.261934 (+1983008us) service_pool.cc:224] Handling call
0709 13:08:45.788212 (+3526278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.554295 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.554809 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.554846 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:08:45.554874 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:45.555217 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.555275 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.555310 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:45.555498 (+   188us) tablet.cc:701] Row locks acquired
0709 13:08:45.555517 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:45.555656 (+   139us) write_op.cc:270] Start()
0709 13:08:45.556000 (+   344us) write_op.cc:276] Timestamp: P: 1783602525555613 usec, L: 0
0709 13:08:45.556030 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.556693 (+   663us) log.cc:844] Serialized 530 byte log entry
0709 13:08:45.558832 (+  2139us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.559247 (+   415us) write_op.cc:301] APPLY: starting
0709 13:08:45.559327 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.560187 (+   860us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.560283 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.561018 (+   735us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.561181 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:45.561232 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:45.561454 (+   222us) log.cc:844] Serialized 25 byte log entry
0709 13:08:45.561643 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.561724 (+    81us) write_op.cc:454] Released schema lock
0709 13:08:45.561781 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.562153 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.562191 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91611,"reported_tablets":51,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":2866,"apply.run_wall_time_us":2864,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":5174,"prepare.run_cpu_time_us":2458,"prepare.run_wall_time_us":2675,"replication_time_us":2682}]]}
I20260709 13:08:45.826845 15539 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50524 (request call id 155) took 2167 ms. Trace:
I20260709 13:08:45.840024 15539 rpcz_store.cc:276] 0709 13:08:43.659051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.659238 (+   187us) service_pool.cc:224] Handling call
0709 13:08:43.671312 (+ 12074us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b5400310010. stack: 00007fad222e7343 00007fad222e7240 00007fad21c761d4 00007fad2b9b4304 00007fad2b9b4299 00007fad221a1db1 00007fad222e1b71 00007fad222e20b2 00007fad2b25ba89 00007fad2b1f3da6 00007fad2b1c5088 00007fad2b2c337e 00007fad297842a4 00007fad29784232 00007fad29784161 00007fad297840dc
0709 13:08:45.826777 (+2155465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37855,"reported_tablets":28,"spinlock_wait_cycles":15681280}
W20260709 13:08:46.119419 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 56367.3us
W20260709 13:08:46.331019 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 165700us
W20260709 13:08:46.346493 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 149881us
I20260709 13:08:46.368484 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:44432
I20260709 13:08:46.369099 15714 raft_consensus.cc:606] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:46.389796 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:44432
I20260709 13:08:46.393976 15714 raft_consensus.cc:606] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:46.405287 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:44432
I20260709 13:08:46.406028 15714 raft_consensus.cc:606] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:46.413141 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:44432
I20260709 13:08:46.413834 15714 raft_consensus.cc:606] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:46.422205 15714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c"
dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
mode: GRACEFUL
new_leader_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:44432
I20260709 13:08:46.422891 15714 raft_consensus.cc:606] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Received request to transfer leadership to TS fec10611791a4ab384f86b212249410e
I20260709 13:08:46.424218 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:46.426034 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:46.440469 22860 raft_consensus.cc:993] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:46.441027 22860 raft_consensus.cc:1081] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:46.448606 15646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:08:46.461329 15646 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.461930 15646 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.485435 15646 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:46.496737 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:46.497331 15714 raft_consensus.cc:3055] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.497632 15714 raft_consensus.cc:740] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:46.498378 15714 consensus_queue.cc:260] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:46.499491 15714 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.498679 16329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:46.500527 16329 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.508641 15714 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:46.512357 15611 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:46.517875 22823 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:46.518478 22823 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:46.519318 22823 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:46.566057 15646 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:46.566094 16329 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 17.
I20260709 13:08:46.593326 15537 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 16 to 17, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 17 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.729641 22875 raft_consensus.cc:993] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:46.732854 22875 raft_consensus.cc:1081] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:46.735998 15646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:08:46.736634 15646 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.737006 15646 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:46.756275 15646 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:46.779066 15646 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:46.780762 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:46.783373 15714 raft_consensus.cc:3055] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:46.790175 15714 raft_consensus.cc:740] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:46.783985 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:46.796092 15796 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:46.804255 22875 raft_consensus.cc:993] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:46.804855 22860 raft_consensus.cc:1081] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:46.809612 15641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:08:46.810213 15641 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.810772 15641 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.796976 15714 consensus_queue.cc:260] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:46.817118 15714 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:47.106966 15715 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:47.109359 22823 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:47.116227 15641 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.159875 15641 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:47.145334 16330 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:47.148432 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 66689.8us
I20260709 13:08:47.159756 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:47.177304 15716 raft_consensus.cc:3055] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:47.177682 15716 raft_consensus.cc:740] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:47.128239 15796 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 21.
I20260709 13:08:47.181126 15714 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 21.
I20260709 13:08:47.187289 22879 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:47.185336 15611 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:47.196249 22823 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:47.196782 22823 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 21 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:47.200594 15716 consensus_queue.cc:260] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.204923 22875 raft_consensus.cc:993] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:47.205425 22875 raft_consensus.cc:1081] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:47.209126 15716 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.215406 22823 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.247591 15716 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
W20260709 13:08:47.260195 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 77034.6us
W20260709 13:08:47.290226 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 56248.6us
I20260709 13:08:47.296551 15611 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:47.299604 22879 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:47.330667 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 147638us
I20260709 13:08:47.409590 22879 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:47.410989 22879 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:47.418761 15610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 113926us
I20260709 13:08:47.427026 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.436201 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:47.436928 15796 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.451841 15796 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 18.
I20260709 13:08:47.469533 15536 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 20 to 21, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 21 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:47.504051 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 168331us
I20260709 13:08:47.511996 22875 raft_consensus.cc:993] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: : Instructing follower fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:47.512539 22875 raft_consensus.cc:1081] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Signalling peer fec10611791a4ab384f86b212249410e to start an election
I20260709 13:08:47.573099 15641 raft_consensus.cc:1240] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:47.574643 15641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:08:47.575246 15641 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.575680 15641 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.599059 15644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff"
dest_uuid: "fec10611791a4ab384f86b212249410e"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:08:47.599907 15644 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.600299 15644 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.630249 15641 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.641348 15646 raft_consensus.cc:1240] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:47.649932 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:47.650828 15716 raft_consensus.cc:3055] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:47.651180 15716 raft_consensus.cc:740] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:47.656914 15716 consensus_queue.cc:260] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.658097 15716 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.667871 15641 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:47.662256 15644 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.688982 15643 raft_consensus.cc:1240] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Rejecting Update request from peer 8ca6a5ab086d47e5a79ef37ddead9f28 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:47.715731 15644 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:47.718132 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:47.718848 15718 raft_consensus.cc:3055] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:47.719192 15718 raft_consensus.cc:740] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:47.719408 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:47.720034 15791 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.720067 15718 consensus_queue.cc:260] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.721679 15718 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.722582 15716 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 20.
I20260709 13:08:47.726672 15611 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:47.727864 22910 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:47.728384 22910 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:47.729290 22910 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.730932 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:47.731500 15793 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.736294 15718 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:47.737634 15611 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e; no voters: 
I20260709 13:08:47.739178 22879 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:47.739900 22879 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Becoming Leader. State: Replica: fec10611791a4ab384f86b212249410e, State: Running, Role: LEADER
I20260709 13:08:47.740830 22879 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:47.746989 15721 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:47.748979 22907 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:47.752367 15796 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:47.766793 15791 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 20.
I20260709 13:08:47.770828 15793 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fec10611791a4ab384f86b212249410e in term 16.
I20260709 13:08:47.783926 22899 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:08:47.993436 15791 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:48.006945 15611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 148687us
W20260709 13:08:48.008850 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 114642us
I20260709 13:08:48.004385 22909 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:47.991442 15536 catalog_manager.cc:5697] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 17 to 18, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 18 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.027488 15536 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 19 to 20, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 20 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.038789 15536 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e reported cstate change: term changed from 15 to 16, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to fec10611791a4ab384f86b212249410e (127.14.45.1). New cstate: current_term: 16 leader_uuid: "fec10611791a4ab384f86b212249410e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.126380 15721 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:48.159672 15716 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:48.160760 22910 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:48.173432 22909 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:48.187167 15793 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:48.189262 22910 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:48.232236 15793 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:48.259160 15718 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer fec10611791a4ab384f86b212249410e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:48.259478 22909 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:48.268757 22909 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:48.885986 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.045581 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:08:49.080130 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:49.155159 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 63082.8us
W20260709 13:08:49.158538 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 65733us
I20260709 13:08:50.082585 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:50.370330 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 153923us
W20260709 13:08:50.421916 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50330.2us
I20260709 13:08:50.600863 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
W20260709 13:08:50.614904 16300 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:50.673950 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 59083.1us
W20260709 13:08:50.706640 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 82737us
W20260709 13:08:50.707909 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 59166.3us
W20260709 13:08:50.713367 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.728303 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.729890 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.733683 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.756735 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.769356 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.770973 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.771953 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.773922 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.778100 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.779072 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.783692 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.786878 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.787468 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.787842 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.791004 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.820637 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.824710 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.855413 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.882781 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.893244 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.893865 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.927148 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.937379 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.940164 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.942633 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.013293 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.223723 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.224323 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.224956 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.257310 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.258664 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.259269 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.260258 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.260800 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.374487 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.523600 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.527321 14516 tablet_replica.cc:333] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.528602 14516 raft_consensus.cc:2243] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.531293 14516 raft_consensus.cc:2272] T 00f37d51951a494996e57f1247bd69ee P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.547624 22961 raft_consensus.cc:493] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.548592 22961 raft_consensus.cc:515] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.552760 22961 leader_election.cc:290] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.553489 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.565194 22961 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:51.566037 22961 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.571925 14516 tablet_replica.cc:333] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.588389 14516 raft_consensus.cc:2243] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.594631 22961 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.596364 14516 raft_consensus.cc:2272] T 6317639150e3411184bf3cbb49ba1154 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.597182 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.597975 22961 raft_consensus.cc:493] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:51.598567 22961 raft_consensus.cc:515] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.602180 14516 tablet_replica.cc:333] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.603065 22961 leader_election.cc:290] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.606560 14516 raft_consensus.cc:2243] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.607553 14516 raft_consensus.cc:2272] T dbf56bc1c60545828ec946a02bb6cf8b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.609094 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000b7a022df94c229b7580329401d5f2" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.605800 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.612329 14516 tablet_replica.cc:333] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.613399 14516 raft_consensus.cc:2243] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.614634 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b106b4017dc84b21a7c6f58814593886" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.615792 14516 raft_consensus.cc:2272] T 264ae6fa375a4fc39d6970b0c40cfd72 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.618621 15610 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:51.620011 22959 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.620755 22959 raft_consensus.cc:493] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:51.621364 22959 raft_consensus.cc:515] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.624114 22959 leader_election.cc:290] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.620167 14516 tablet_replica.cc:333] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.586177 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b565f6448234458882c913c62c38ac0" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.625655 14516 raft_consensus.cc:2243] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.626967 14516 raft_consensus.cc:2272] T c36d0932529945e9a284405282d65321 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.637759 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.640625 14516 tablet_replica.cc:333] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.641779 14516 raft_consensus.cc:2243] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.642742 14516 raft_consensus.cc:2272] T e9f64c9d13524994bf43ee72f72781ee P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.648486 14516 tablet_replica.cc:333] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.651513 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dabdbaded914a498e98f6a03182ab7e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.653424 22953 raft_consensus.cc:493] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.649725 14516 raft_consensus.cc:2243] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.655356 15610 leader_election.cc:304] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.656509 22911 raft_consensus.cc:2749] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:51.656725 15610 leader_election.cc:304] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.657210 22911 raft_consensus.cc:493] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.657945 15610 leader_election.cc:304] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.657840 22911 raft_consensus.cc:515] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.658818 22955 raft_consensus.cc:2706] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Received pre-election callback for term 13 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:08:51.657979 22961 raft_consensus.cc:2749] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:51.660260 22911 leader_election.cc:290] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.660923 14516 raft_consensus.cc:2272] T 1dabdbaded914a498e98f6a03182ab7e P fec10611791a4ab384f86b212249410e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.661381 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.664618 14516 tablet_replica.cc:333] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.654170 22953 raft_consensus.cc:515] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.665860 14516 raft_consensus.cc:2243] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.667126 22953 leader_election.cc:290] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.670099 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.670222 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a58d7b48604275b9a01c8113841008" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.667426 14516 raft_consensus.cc:2272] T 3d1a63ae20354b95b7bd0e7365b598f8 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.681644 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a80ac95da7b40e8b9e155cdaf8a7739" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.689554 14516 tablet_replica.cc:333] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.690632 14516 raft_consensus.cc:2243] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.691834 14516 raft_consensus.cc:2272] T b4aeec01bdbb47c8bd447ebc7aa8075c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.695063 14516 tablet_replica.cc:333] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.695901 14516 raft_consensus.cc:2243] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.697139 14516 raft_consensus.cc:2272] T e43d98ec23cf48ff888ae5baaae1b949 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.701134 14516 tablet_replica.cc:333] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.702062 14516 raft_consensus.cc:2243] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.703267 14516 raft_consensus.cc:2272] T f4cc7c001b764df39f7b82f95bc198cc P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.708107 14516 tablet_replica.cc:333] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.708974 14516 raft_consensus.cc:2243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.709872 14516 raft_consensus.cc:2272] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.712697 14516 tablet_replica.cc:333] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.713793 14516 raft_consensus.cc:2243] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.714243 15610 leader_election.cc:304] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.714872 14516 raft_consensus.cc:2272] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.715507 22953 raft_consensus.cc:2706] T d1a58d7b48604275b9a01c8113841008 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Received pre-election callback for term 20 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:08:51.715626 15610 leader_election.cc:304] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
W20260709 13:08:51.716320 15610 raft_consensus.cc:2686] T 5a80ac95da7b40e8b9e155cdaf8a7739 P fec10611791a4ab384f86b212249410e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:51.735468 14516 tablet_replica.cc:333] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.736555 14516 raft_consensus.cc:2243] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.737433 14516 raft_consensus.cc:2272] T f24ffe6bbf294850b0b75309859cae27 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.743165 14516 tablet_replica.cc:333] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.744589 14516 raft_consensus.cc:2243] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.746304 22953 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.747069 22953 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.749298 22953 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.751392 14516 raft_consensus.cc:2272] T a9dc71c1b2c74ae3a9bd46fccb533628 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.751976 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.752612 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5622436c83fb41fa8923df2295b99818" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.754566 14516 tablet_replica.cc:333] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.755868 14516 raft_consensus.cc:2243] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.757195 22961 raft_consensus.cc:493] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:51.757805 22961 raft_consensus.cc:515] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.759505 14516 raft_consensus.cc:2272] T 641dda60c3af4cf59874ffb47ae0ec1f P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.760114 22961 leader_election.cc:290] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.767290 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.767926 15610 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.768854 22961 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.771342 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "260cdec1e9ff4f2e92f7db3917710d4c" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.762619 14516 tablet_replica.cc:333] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.764248 22953 raft_consensus.cc:493] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.773061 15610 leader_election.cc:304] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:51.773573 22953 raft_consensus.cc:515] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.779872 22953 leader_election.cc:290] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.774907 14516 raft_consensus.cc:2243] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.780539 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.780944 22953 raft_consensus.cc:2749] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:51.781953 14516 raft_consensus.cc:2272] T 95371a1d960048e7af7796052350a058 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.784276 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8c1e0ef68b4538925aca4c0e72487e" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.785147 22961 raft_consensus.cc:493] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.785692 22961 raft_consensus.cc:515] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.786983 22953 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:51.787889 22961 leader_election.cc:290] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.789541 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.787653 22953 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.793300 15610 leader_election.cc:304] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.795083 22961 raft_consensus.cc:2749] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:51.796082 22953 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.796809 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.797645 14516 tablet_replica.cc:333] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.798619 14516 raft_consensus.cc:2243] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.799988 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53d726dd17e47aa93a8e89b12bb84c4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.801649 14516 raft_consensus.cc:2272] T 000b7a022df94c229b7580329401d5f2 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.803037 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a882c727204be4b66080704cceb833" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.804917 15610 leader_election.cc:304] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.808029 22961 raft_consensus.cc:2749] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:51.812067 15610 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.814286 22953 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.813625 14516 tablet_replica.cc:333] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.816237 14516 raft_consensus.cc:2243] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.817853 14516 raft_consensus.cc:2272] T 76331ca323724c289906034e280e8274 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.821408 14516 tablet_replica.cc:333] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.822710 14516 raft_consensus.cc:2243] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.823786 14516 raft_consensus.cc:2272] T 9cd1114f45e54146933cfc74bc32722f P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.827018 14516 tablet_replica.cc:333] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.827783 14516 raft_consensus.cc:2243] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.828989 14516 raft_consensus.cc:2272] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.837373 14516 tablet_replica.cc:333] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.838510 14516 raft_consensus.cc:2243] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.839228 14516 raft_consensus.cc:2272] T 0d5ce40a7af94aa0a543c078bc1fe630 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.843555 14516 tablet_replica.cc:333] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.844524 14516 raft_consensus.cc:2243] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.845592 14516 raft_consensus.cc:2272] T 17db433a32844f26aa2fe7c2d4e4bf66 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.849855 14516 tablet_replica.cc:333] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.852035 14516 raft_consensus.cc:2243] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.852946 14516 raft_consensus.cc:2272] T b106b4017dc84b21a7c6f58814593886 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.856838 14516 tablet_replica.cc:333] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.857638 14516 raft_consensus.cc:2243] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.862049 14516 raft_consensus.cc:2272] T 3cde3f8ed1454b789014048b7d1e4af8 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.868074 22953 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:51.868717 22953 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.869201 14516 tablet_replica.cc:333] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.871398 14516 raft_consensus.cc:2243] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.872649 14516 raft_consensus.cc:2272] T 8d1d6e542161416d9033cefcbd0c06e3 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.872931 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.875816 14516 tablet_replica.cc:333] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.876140 22953 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.876688 14516 raft_consensus.cc:2243] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.877219 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6e933897cb4278b93a8cca027153ac" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.877499 14516 raft_consensus.cc:2272] T 260cdec1e9ff4f2e92f7db3917710d4c P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.878907 15610 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:51.880427 14516 tablet_replica.cc:333] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.881402 14516 raft_consensus.cc:2243] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.882241 22953 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.894681 14516 raft_consensus.cc:2272] T a8f5c34f652e44ef80105d4e8021a365 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.897878 14516 tablet_replica.cc:333] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.909430 14516 raft_consensus.cc:2243] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.910578 14516 raft_consensus.cc:2272] T f6940e9e6caf46bd88b8db528efa12e8 P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.913700 14516 tablet_replica.cc:333] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.914636 14516 raft_consensus.cc:2243] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.915984 14516 raft_consensus.cc:2272] T 3836f44d54d2426aa13fe94be57f8fcb P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.916322 22953 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:51.917124 22953 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.919128 14516 tablet_replica.cc:333] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.920101 14516 raft_consensus.cc:2243] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.920333 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.920912 14516 raft_consensus.cc:2272] T 5622436c83fb41fa8923df2295b99818 P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.924237 22961 raft_consensus.cc:493] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 228b1ac5589e48af9bbf6caecd6aeaea)
I20260709 13:08:51.924886 22961 raft_consensus.cc:515] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:51.925104 22953 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.927106 22961 leader_election.cc:290] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:51.929427 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1fac517a64a4e9eaa1931a61e14dd" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.929847 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:51.931392 15610 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:08:51.932153 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "493304a609d247829052517242c00e96" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.932832 22955 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:51.933836 15610 leader_election.cc:304] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.935541 22955 raft_consensus.cc:2749] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.935951 14516 tablet_replica.cc:333] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.936919 14516 raft_consensus.cc:2243] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.937906 14516 raft_consensus.cc:2272] T 0e2577557ef849f9bd90a2b23564a72e P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.941187 14516 tablet_replica.cc:333] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.942099 14516 raft_consensus.cc:2243] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.943179 14516 raft_consensus.cc:2272] T 7e1ddc8959ec401badd16f3610580c0b P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.956779 14516 tablet_replica.cc:333] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.957665 14516 raft_consensus.cc:2243] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.958434 14516 raft_consensus.cc:2272] T a8b1fac517a64a4e9eaa1931a61e14dd P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.961920 14516 tablet_replica.cc:333] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.962780 14516 raft_consensus.cc:2243] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.963478 14516 raft_consensus.cc:2272] T 6b555226593f4046be916b50c89b97ed P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.969630 22953 raft_consensus.cc:493] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:08:51.970300 22953 raft_consensus.cc:515] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.975381 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.975926 22953 leader_election.cc:290] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:51.978032 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa29a3025a254b5ca5f1a66e394cec53" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:51.978647 14516 tablet_replica.cc:333] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.979600 14516 raft_consensus.cc:2243] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.980731 14516 raft_consensus.cc:2272] T b3d5d97766ab4411805e543ed41f9f38 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.983896 14516 tablet_replica.cc:333] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.984102 15610 leader_election.cc:304] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:51.984773 14516 raft_consensus.cc:2243] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.984938 22955 raft_consensus.cc:2749] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:51.984531 22953 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:51.986197 14516 raft_consensus.cc:2272] T c6d6772bfc824de6a5a77d8362f09c57 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.989459 14516 tablet_replica.cc:333] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:51.991410 22953 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:51.994398 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:51.996083 22955 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:51.996759 22955 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.000643 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:52.001861 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40bb44d33b449189eb6c71fbb47dca4" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:52.002424 14516 raft_consensus.cc:2243] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.003273 22955 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:52.004482 15611 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:52.006880 22955 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:52.003302 14516 raft_consensus.cc:2272] T d53d726dd17e47aa93a8e89b12bb84c4 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.014343 22953 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:52.014927 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab1a40028dd4bd8989c0eef484214fb" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:52.017001 15610 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:52.018229 14516 tablet_replica.cc:333] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.019191 14516 raft_consensus.cc:2243] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.019946 22953 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:52.020012 14516 raft_consensus.cc:2272] T 493304a609d247829052517242c00e96 P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.023748 14516 tablet_replica.cc:333] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.024636 14516 raft_consensus.cc:2243] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.025556 14516 raft_consensus.cc:2272] T 8ab1a40028dd4bd8989c0eef484214fb P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.029358 14516 tablet_replica.cc:333] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.038223 14516 raft_consensus.cc:2243] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.039552 14516 raft_consensus.cc:2272] T 84e21e8d93b04fda8cbe6eff63c91d00 P fec10611791a4ab384f86b212249410e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.042671 14516 tablet_replica.cc:333] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.043404 14516 raft_consensus.cc:2243] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.062307 14516 raft_consensus.cc:2272] T b40bb44d33b449189eb6c71fbb47dca4 P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.064846 22953 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:08:52.065351 14516 tablet_replica.cc:333] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.065505 22953 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.066322 14516 raft_consensus.cc:2243] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.067139 14516 raft_consensus.cc:2272] T fa29a3025a254b5ca5f1a66e394cec53 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.068060 22953 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:52.068804 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:52.071480 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b41c8b77bb478d9a07b1fa9c45f64a" candidate_uuid: "fec10611791a4ab384f86b212249410e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:52.086301 14516 tablet_replica.cc:333] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.087231 14516 raft_consensus.cc:2243] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.085671 15610 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fec10611791a4ab384f86b212249410e; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:08:52.087890 14516 raft_consensus.cc:2272] T 9c6e933897cb4278b93a8cca027153ac P fec10611791a4ab384f86b212249410e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.088985 22953 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:52.090870 14516 tablet_replica.cc:333] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.091722 14516 raft_consensus.cc:2243] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.092860 14516 raft_consensus.cc:2272] T 124c8d611c0e46e196764635f142c5f3 P fec10611791a4ab384f86b212249410e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.095885 14516 tablet_replica.cc:333] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.096573 14516 raft_consensus.cc:2243] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.097215 14516 raft_consensus.cc:2272] T 9c8c1e0ef68b4538925aca4c0e72487e P fec10611791a4ab384f86b212249410e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.099984 14516 tablet_replica.cc:333] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.100633 14516 raft_consensus.cc:2243] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.110090 14516 raft_consensus.cc:2272] T 4d7dd54a086d47c196a1227a925bbdff P fec10611791a4ab384f86b212249410e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.122057 14516 tablet_replica.cc:333] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.122910 14516 raft_consensus.cc:2243] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.123728 14516 raft_consensus.cc:2272] T e7a882c727204be4b66080704cceb833 P fec10611791a4ab384f86b212249410e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.126838 14516 tablet_replica.cc:333] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.127485 14516 raft_consensus.cc:2243] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.128082 14516 raft_consensus.cc:2272] T d1b41c8b77bb478d9a07b1fa9c45f64a P fec10611791a4ab384f86b212249410e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.135656 14516 tablet_replica.cc:333] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.136493 14516 raft_consensus.cc:2243] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.144207 14516 raft_consensus.cc:2272] T 2587899a27f245e9b0ef17e109a8e540 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.148145 14516 tablet_replica.cc:333] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e: stopping tablet replica
I20260709 13:08:52.148911 14516 raft_consensus.cc:2243] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.149696 14516 raft_consensus.cc:2272] T 9b565f6448234458882c913c62c38ac0 P fec10611791a4ab384f86b212249410e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.821856 22896 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:52.822425 22896 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.825524 22943 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:52.826207 22943 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.829223 22943 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:52.830574 22896 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:52.836829 15762 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:52.844792 15762 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:52.884392 22896 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:52.885311 22896 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.891117 22881 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:52.892441 22881 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:52.894629 15762 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:52.911592 22881 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:52.912247 22896 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:52.923471 22947 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:52.924233 22947 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.926844 22947 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:52.929533 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:52.934541 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:52.946307 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:52.952965 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:52.956317 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
W20260709 13:08:52.974726 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:52.976469 22956 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:52.977157 22956 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:52.979539 22956 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:52.981909 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:52.986045 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.005908 22947 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.006466 22947 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.007455 22956 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.008113 22956 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.026957 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.028164 22947 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.028338 22881 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.029961 22956 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.034817 15760 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.038290 22943 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.038923 22943 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.043308 22943 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.036813 22896 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:53.047022 15762 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.052641 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.054723 15760 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.056015 22968 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.060412 15760 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.062515 22896 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:53.088174 22957 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.088973 22957 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.093115 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.095165 22957 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:53.104728 16300 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.105567 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:53.117786 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.137630 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.126744 22896 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.148689 22896 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.155931 22896 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:53.159538 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.166596 22957 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:53.173465 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 68760.3us
I20260709 13:08:53.182044 22956 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.182811 22956 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.185248 22956 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:53.186257 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 76438us
W20260709 13:08:53.193863 15762 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.205041 22896 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:53.207612 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:41485, user_credentials={real_user=slave}} blocked reactor thread for 192543us
I20260709 13:08:53.213609 22896 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.227403 22947 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.228014 22947 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.230896 22947 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.235823 22947 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.236547 22947 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.239174 22947 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.240135 22972 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.240861 22972 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.243814 22972 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.260874 22956 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.291706 22956 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.294384 22956 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.263926 22970 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.295457 22970 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.298317 22970 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:53.272058 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 57192.8us
I20260709 13:08:53.279958 22896 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.286711 22968 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.300942 22968 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.304061 22968 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:53.308815 22943 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.309607 22943 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.311877 22943 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.313308 22943 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.313952 22943 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.316103 22943 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.332680 22957 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.337534 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.333228 22957 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.343564 22957 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.345007 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.345696 15793 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 16.
I20260709 13:08:53.346935 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.348714 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
W20260709 13:08:53.349695 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.350714 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.370240 15791 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
I20260709 13:08:53.348839 22957 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:53.371474 16327 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:53.373807 22957 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.374428 22957 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.364212 22968 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.378144 22968 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.380851 22968 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.386971 22957 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.366707 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.365902 22972 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.438117 22972 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.403470 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.440572 15790 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 16.
I20260709 13:08:53.405961 15716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.441726 15716 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:53.407501 15718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.442939 15718 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 21.
I20260709 13:08:53.409446 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.444180 15791 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:53.410658 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.445072 15796 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:53.413601 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.415832 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.446069 15794 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:53.416296 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.447084 15721 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
I20260709 13:08:53.447387 15793 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:53.418529 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.424497 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.448226 15720 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:53.431455 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:53.449021 15719 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 18.
I20260709 13:08:53.429656 22947 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
W20260709 13:08:53.439929 14516 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15668)
I20260709 13:08:53.451959 22947 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.453063 15715 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:53.446028 15789 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
W20260709 13:08:53.391847 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.457799 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65996.4us
I20260709 13:08:53.476433 22972 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.479938 22947 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.491508 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.492937 22972 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:53.493626 22972 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.496840 22972 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.509722 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
W20260709 13:08:53.433542 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.510833 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 77346.8us
I20260709 13:08:53.537084 22970 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.537775 22970 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.539980 22970 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.547036 22957 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.561311 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.568217 22956 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:53.568694 22956 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.569463 22956 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:53.590263 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.597298 22943 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.601876 22943 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.599154 22968 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.603814 22968 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:53.624487 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.626832 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.627347 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.627755 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.631229 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.632138 22970 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:53.632650 22970 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.633476 22970 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:53.651820 15688 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.652736 15688 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.658046 22956 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.660427 22956 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:53.662477 15762 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.663089 15762 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.663556 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.664585 15762 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.666230 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.666759 15688 leader_election.cc:336] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.688933 15688 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
W20260709 13:08:53.690071 15688 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.654826 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.690869 22947 raft_consensus.cc:2749] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.691591 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.692575 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
W20260709 13:08:53.628156 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.693594 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 65478.1us
I20260709 13:08:53.694528 22967 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:53.694943 22967 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.695325 22967 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:53.595325 22972 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.673172 22943 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:53.691728 22947 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:53.698513 22947 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.699009 22947 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:53.692659 22969 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:53.698146 15789 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 228b1ac5589e48af9bbf6caecd6aeaea in current term 17: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:53.702008 22969 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.702546 22969 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.710501 22970 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.711313 22967 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.715405 22967 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.718732 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:53.719798 15793 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:53.719013 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:08:53.720698 15762 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.713364 22970 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.720927 15794 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
W20260709 13:08:53.721321 15762 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.721887 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.723078 15762 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.723567 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.723937 15762 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.724365 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.724844 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.737354 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.737934 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.738415 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.674722 22968 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:53.675902 22956 raft_consensus.cc:2749] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.742612 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:53.743466 16330 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:08:53.745157 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.748131 22881 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:53.748844 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.751361 15762 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.740995 22972 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:53.751859 22947 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.764635 22947 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:53.753134 15688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 62312.6us
W20260709 13:08:53.765460 15688 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.750842 22969 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:53.758613 15762 leader_election.cc:336] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.762243 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.768335 22969 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.769186 22972 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:53.769755 22972 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.770282 22972 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:53.774888 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.775825 15762 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:53.786971 15760 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.788309 22943 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:53.792002 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 99485.9us
I20260709 13:08:53.792754 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.794728 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:53.795507 16330 raft_consensus.cc:2393] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 17: Already voted for candidate 228b1ac5589e48af9bbf6caecd6aeaea in this term.
I20260709 13:08:53.795338 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.796111 22956 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.796514 22956 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.796903 22956 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.796970 22969 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.797513 22969 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.797956 22969 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.800665 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.801542 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.807065 22956 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.810027 22970 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:53.810240 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.810544 22970 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.810981 22947 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:53.811012 22970 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.811508 22947 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.811929 22947 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.815932 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43d98ec23cf48ff888ae5baaae1b949" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:53.816638 15794 raft_consensus.cc:3060] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.817935 15759 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 228b1ac5589e48af9bbf6caecd6aeaea, fec10611791a4ab384f86b212249410e
I20260709 13:08:53.822037 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7dd54a086d47c196a1227a925bbdff" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:53.822695 15793 raft_consensus.cc:3060] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.828521 22972 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.830684 15796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836f44d54d2426aa13fe94be57f8fcb" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:53.831296 15796 raft_consensus.cc:3060] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:53.831614 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cc7c001b764df39f7b82f95bc198cc" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:53.832204 15789 raft_consensus.cc:3060] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:53.836898 15794 raft_consensus.cc:2468] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:53.839841 15789 raft_consensus.cc:2468] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 22.
I20260709 13:08:53.841807 22943 raft_consensus.cc:2749] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.842653 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4aeec01bdbb47c8bd447ebc7aa8075c" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:53.880353 15791 raft_consensus.cc:3060] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.844645 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:53.886044 15795 raft_consensus.cc:3060] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.896143 15795 raft_consensus.cc:2468] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:53.896764 22967 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.897325 22967 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:53.899827 15791 raft_consensus.cc:2468] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:53.899967 22967 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:08:53.857172 15793 raft_consensus.cc:2468] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:53.864564 15796 raft_consensus.cc:2468] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 22.
I20260709 13:08:53.809336 22956 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.901185 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:08:53.901867 16330 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 17.
I20260709 13:08:53.866200 22974 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:53.902619 22974 raft_consensus.cc:493] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.903008 22974 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.867216 22972 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:53.872835 15762 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:53.903843 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.873571 15760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 63405.7us
I20260709 13:08:53.906498 15685 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.907403 15685 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.909129 22975 raft_consensus.cc:2804] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:53.909610 22975 raft_consensus.cc:697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:53.910574 22975 consensus_queue.cc:237] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.914258 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f5c34f652e44ef80105d4e8021a365" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:53.914479 22956 raft_consensus.cc:2804] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:53.914902 16330 raft_consensus.cc:3060] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.906911 15760 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.919368 22972 raft_consensus.cc:2764] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:08:53.922144 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.924810 15760 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.876667 22969 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.876755 22947 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.944139 22947 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.926216 22972 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:53.945091 22972 raft_consensus.cc:493] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.945501 22972 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.938737 22956 raft_consensus.cc:697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:53.875572 22970 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.951390 22970 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.952216 22943 raft_consensus.cc:2764] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:53.952657 22956 consensus_queue.cc:237] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.956357 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.961979 22969 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:53.966898 22943 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.967628 22943 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.968072 22943 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:53.971508 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 64170.2us
I20260709 13:08:53.972321 15685 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.973229 15685 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.974035 22976 raft_consensus.cc:2804] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:53.974700 22976 raft_consensus.cc:697] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:53.976204 22976 consensus_queue.cc:237] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.974249 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:53.977713 15685 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.978278 22967 raft_consensus.cc:2804] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:53.980605 22967 raft_consensus.cc:697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:53.980942 22947 raft_consensus.cc:2804] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:53.981472 22947 raft_consensus.cc:697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:53.981845 22967 consensus_queue.cc:237] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.982517 22947 consensus_queue.cc:237] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.984247 15685 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:53.993221 22975 raft_consensus.cc:2804] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:53.994582 22975 raft_consensus.cc:697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:53.994450 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:53.995527 22975 consensus_queue.cc:237] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:53.996034 22970 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.996439 22970 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:53.996851 22970 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.001530 22972 raft_consensus.cc:515] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.004045 16330 raft_consensus.cc:2468] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 17.
I20260709 13:08:54.004531 22968 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:54.007097 22968 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:54.007503 22968 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:54.015093 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c8d611c0e46e196764635f142c5f3" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:54.015836 15791 raft_consensus.cc:3060] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:54.016532 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:54.020218 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:54.021234 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:54.021878 15719 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 19.
W20260709 13:08:54.019833 15688 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.029574 15759 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:54.031060 22896 raft_consensus.cc:2804] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:54.040062 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.047976 15688 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.049103 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.052220 15688 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.065227 22896 raft_consensus.cc:697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:54.054769 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1ddc8959ec401badd16f3610580c0b" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:54.079396 15791 raft_consensus.cc:2468] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:54.087611 22972 leader_election.cc:290] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:54.074484 22896 consensus_queue.cc:237] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:54.109684 22970 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:54.066293 22974 raft_consensus.cc:515] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.114573 22943 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.118059 15794 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 19: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
I20260709 13:08:54.118958 22974 leader_election.cc:290] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:54.119802 22943 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:54.121982 15762 leader_election.cc:336] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.130460 22968 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.131814 15795 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in current term 21: Already voted for candidate c1927141dc2540dab644a00fd6843fc6 in this term.
W20260709 13:08:54.137647 15688 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.138470 22970 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:08:54.138948 15688 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.139837 15688 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.148939 15762 leader_election.cc:336] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.149608 15762 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.182335 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 120616us
W20260709 13:08:54.184779 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.188012 15688 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.189064 15688 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.190304 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.190876 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.194219 22968 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:54.204017 15536 catalog_manager.cc:5697] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 16 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 17 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.191394 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.215487 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde3f8ed1454b789014048b7d1e4af8" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:08:54.216393 16327 raft_consensus.cc:3060] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.220263 15685 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:54.223434 22967 raft_consensus.cc:2804] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:54.223985 22967 raft_consensus.cc:697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:54.224913 22967 consensus_queue.cc:237] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.224852 15537 catalog_manager.cc:5697] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 21 to 22, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 22 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.226732 15537 catalog_manager.cc:5697] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 19 to 20, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 20 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.209697 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.228948 15688 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.229648 15688 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.230566 15688 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.231244 15688 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.231218 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:54.228281 15537 catalog_manager.cc:5697] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 17 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 18 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.239995 15762 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.241516 16327 raft_consensus.cc:2468] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 18.
I20260709 13:08:54.243183 15760 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:54.243404 22896 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:54.243989 22896 raft_consensus.cc:493] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fec10611791a4ab384f86b212249410e)
I20260709 13:08:54.244442 22896 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.256331 15685 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: 
I20260709 13:08:54.258882 22974 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:54.266817 15688 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.267536 15688 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.268265 15688 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.269296 22991 raft_consensus.cc:2804] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:54.271920 22896 raft_consensus.cc:515] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.272670 22991 raft_consensus.cc:697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:54.273679 22991 consensus_queue.cc:237] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:54.277470 15688 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:54.278290 15688 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.278726 15688 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:54.290418 22956 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:08:54.291322 15688 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.291810 15688 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:08:54.293066 22956 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:54.294699 15717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76331ca323724c289906034e280e8274" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:54.295295 15717 raft_consensus.cc:3060] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.298184 22896 leader_election.cc:290] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:08:54.299602 15719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d6772bfc824de6a5a77d8362f09c57" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:54.299873 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:54.300222 15719 raft_consensus.cc:3060] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.300621 15715 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 19: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:54.303287 15717 raft_consensus.cc:2468] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:54.307734 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:54.308482 15720 raft_consensus.cc:2393] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 21: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:54.309275 15719 raft_consensus.cc:2468] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:54.311956 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e21e8d93b04fda8cbe6eff63c91d00" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28"
I20260709 13:08:54.312543 15721 raft_consensus.cc:3060] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:54.313612 15762 leader_election.cc:336] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:54.329116 15721 raft_consensus.cc:2468] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 20.
I20260709 13:08:54.333382 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:54.334816 15760 leader_election.cc:304] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:54.336025 22943 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:54.336913 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.337405 22943 raft_consensus.cc:2804] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:54.338061 22943 raft_consensus.cc:697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:54.340062 22943 consensus_queue.cc:237] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.344053 15760 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:54.349011 22974 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:54.360292 15760 leader_election.cc:304] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:54.361703 22896 raft_consensus.cc:2804] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:54.362290 22896 raft_consensus.cc:697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:54.364742 22896 consensus_queue.cc:237] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:54.366835 15760 leader_election.cc:304] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:54.367951 22943 raft_consensus.cc:2804] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:54.368621 22943 raft_consensus.cc:697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:08:54.371170 22943 consensus_queue.cc:237] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:54.373643 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.394166 15795 raft_consensus.cc:1275] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:08:54.395926 22991 consensus_queue.cc:1048] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:08:54.421664 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.438695 15688 consensus_peers.cc:597] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.439302 15688 consensus_peers.cc:597] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.452157 14516 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15668)
W20260709 13:08:54.492568 15688 consensus_peers.cc:597] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.493127 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.500893 15795 raft_consensus.cc:1275] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:54.511638 22956 consensus_queue.cc:1048] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:54.514911 15795 raft_consensus.cc:1275] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:54.518273 22956 consensus_queue.cc:1048] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:54.548028 15688 consensus_peers.cc:597] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.564531 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.566380 15795 raft_consensus.cc:1275] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:54.568095 22956 consensus_queue.cc:1048] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:54.567801 15536 catalog_manager.cc:5697] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 19 to 20, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 20 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.569717 15536 catalog_manager.cc:5697] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 19 to 20, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 20 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:54.578156 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.586305 15536 catalog_manager.cc:5697] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 19 to 20, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 20 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.610617 15795 raft_consensus.cc:1275] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:08:54.612468 15688 consensus_peers.cc:597] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.614940 22947 consensus_queue.cc:1048] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:54.625002 15791 raft_consensus.cc:1275] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:54.639532 15537 catalog_manager.cc:5697] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 20 to 21, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 21 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.641489 15537 catalog_manager.cc:5697] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 21 to 22, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 22 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.643002 15688 consensus_peers.cc:597] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.643267 15537 catalog_manager.cc:5697] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 20 to 21, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 21 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.645195 15537 catalog_manager.cc:5697] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 16 to 17, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 17 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.650776 15537 catalog_manager.cc:5697] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 17 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 18 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.654424 22956 consensus_queue.cc:1048] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:54.720260 16327 raft_consensus.cc:1275] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:54.721921 22943 consensus_queue.cc:1048] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:54.746031 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.785413 15721 raft_consensus.cc:1275] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:08:54.787319 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.788126 22974 consensus_queue.cc:1048] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:54.804843 16330 raft_consensus.cc:1275] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:54.806731 22978 consensus_queue.cc:1048] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:54.839749 15795 raft_consensus.cc:1275] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:54.841709 22947 consensus_queue.cc:1048] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:54.869762 15717 raft_consensus.cc:1275] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:08:54.878041 15688 consensus_peers.cc:597] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.880550 22896 consensus_queue.cc:1048] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:54.886730 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.948053 15721 raft_consensus.cc:1275] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:08:54.970085 15688 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.977428 22943 consensus_queue.cc:1048] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:55.350813 22881 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.351356 22881 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:55.353482 22881 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:55.361613 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:55.362475 15794 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 17.
I20260709 13:08:55.364481 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:55.366693 23010 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.367332 23010 raft_consensus.cc:493] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.367764 23010 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:55.423713 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:55.428460 23010 raft_consensus.cc:515] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:08:55.452821 14516 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15668)
I20260709 13:08:55.454797 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1d6e542161416d9033cefcbd0c06e3" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:55.455574 15795 raft_consensus.cc:3060] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.465381 15795 raft_consensus.cc:2468] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 228b1ac5589e48af9bbf6caecd6aeaea in term 18.
I20260709 13:08:55.466950 16297 leader_election.cc:304] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:55.467970 22881 raft_consensus.cc:2804] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:55.468532 22881 raft_consensus.cc:697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Becoming Leader. State: Replica: 228b1ac5589e48af9bbf6caecd6aeaea, State: Running, Role: LEADER
I20260709 13:08:55.469458 22881 consensus_queue.cc:237] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:08:55.499583 15539 catalog_manager.cc:5697] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: term changed from 16 to 18, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4). New cstate: current_term: 18 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.511937 23010 leader_election.cc:290] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:55.539746 16300 leader_election.cc:336] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:55.616978 15762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111) [suppressed 413 similar messages]
W20260709 13:08:55.675938 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.689256 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.711803 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.721460 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.732751 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.770054 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.783604 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.798851 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.802795 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.832646 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.835450 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.842851 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.891589 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.895130 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.895355 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.906850 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.910434 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.919325 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.938465 15795 raft_consensus.cc:1275] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:55.940810 22881 consensus_queue.cc:1048] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:55.999898 22947 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.001091 22947 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:56.015782 22947 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:56.018404 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:56.019469 15794 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 21.
I20260709 13:08:56.021020 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:56.028416 22947 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:56.030488 22947 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.031232 22947 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:56.083407 22947 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:56.102065 23026 log.cc:927] Time spent T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:08:56.108934 15688 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:56.110080 22978 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.129719 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 103851us
I20260709 13:08:56.132633 22947 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:56.130477 22978 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:56.180413 15688 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:56.211160 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:56.213832 23040 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.214476 23040 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:56.216523 23040 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:08:56.234722 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.240584 22978 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:08:56.243321 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5d97766ab4411805e543ed41f9f38" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:56.244065 15794 raft_consensus.cc:3060] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:56.247728 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:08:56.248438 15795 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 19.
W20260709 13:08:56.259493 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.259985 15762 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:56.262483 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:56.263326 22991 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:56.263796 22991 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.264138 22991 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:56.273133 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:56.276752 22991 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:56.263127 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:56.280484 22991 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Requested vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:08:56.281193 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.286700 15688 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:08:56.305291 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6"
I20260709 13:08:56.305935 15795 raft_consensus.cc:3060] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:56.301992 15794 raft_consensus.cc:2468] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 22.
I20260709 13:08:56.313100 15685 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: fec10611791a4ab384f86b212249410e
I20260709 13:08:56.314934 23049 raft_consensus.cc:2804] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:56.315567 23049 raft_consensus.cc:697] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:56.317278 15795 raft_consensus.cc:2468] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in term 20.
I20260709 13:08:56.316543 23049 consensus_queue.cc:237] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:08:56.336620 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.337373 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:56.337258 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2587899a27f245e9b0ef17e109a8e540" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" is_pre_election: true
I20260709 13:08:56.338410 15721 raft_consensus.cc:2393] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1927141dc2540dab644a00fd6843fc6 in current term 20: Already voted for candidate 8ca6a5ab086d47e5a79ef37ddead9f28 in this term.
I20260709 13:08:56.339161 15685 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:08:56.340018 22991 raft_consensus.cc:2804] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:56.340598 22991 raft_consensus.cc:697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Becoming Leader. State: Replica: 8ca6a5ab086d47e5a79ef37ddead9f28, State: Running, Role: LEADER
I20260709 13:08:56.341686 22991 consensus_queue.cc:237] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:08:56.354733 15539 catalog_manager.cc:5697] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 20 to 22, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 22 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.375809 15760 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:08:56.377074 23040 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:56.393268 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.416865 15688 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:08:56.453398 14516 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15668)
I20260709 13:08:56.453732 15539 catalog_manager.cc:5697] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 reported cstate change: term changed from 18 to 20, leader changed from fec10611791a4ab384f86b212249410e (127.14.45.1) to 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2). New cstate: current_term: 20 leader_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:56.465051 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.556945 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.639771 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.715533 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.745987 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.772449 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.815203 15688 consensus_peers.cc:597] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.827196 15795 raft_consensus.cc:1275] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:08:56.845299 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:56.847747 22978 consensus_queue.cc:1048] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:56.852607 15688 consensus_peers.cc:597] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.870332 15795 raft_consensus.cc:1275] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Refusing update from remote peer 8ca6a5ab086d47e5a79ef37ddead9f28: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:56.881891 22991 consensus_queue.cc:1048] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:56.882658 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.927228 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:56.949704 15688 consensus_peers.cc:597] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.018694 15685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 58824.9us
W20260709 13:08:57.029037 15688 consensus_peers.cc:597] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.165727 15688 consensus_peers.cc:597] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.199929 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.252875 15688 consensus_peers.cc:597] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.253552 15688 consensus_peers.cc:597] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.267279 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:57.286453 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.313858 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.380749 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.392329 15688 consensus_peers.cc:597] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.415113 15688 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.432821 15688 consensus_peers.cc:597] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.453992 14516 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15668)
W20260709 13:08:58.067101 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.091820 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.098783 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.153700 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.164044 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.193511 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.269073 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.285178 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.341014 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.375026 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.456630 14516 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15668)
W20260709 13:08:58.484563 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.498545 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.509900 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.555540 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.574476 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.576378 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.577267 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.630563 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.644410 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.659096 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.675236 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.703977 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.731212 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.832015 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.919732 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.946390 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.001045 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.038646 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.094102 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.106611 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.183069 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.208298 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.272574 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.322028 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.350381 15688 consensus_peers.cc:597] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.359938 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.380630 15688 consensus_peers.cc:597] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.455639 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.457867 14516 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15668)
W20260709 13:08:59.518880 15688 consensus_peers.cc:597] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.596302 15688 consensus_peers.cc:597] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.605729 15688 consensus_peers.cc:597] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.610283 15688 consensus_peers.cc:597] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.618325 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.715094 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.732431 15688 consensus_peers.cc:597] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.757889 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.464958 14516 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:00.632855 15762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111) [suppressed 427 similar messages]
W20260709 13:09:00.646080 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 49738.9us
W20260709 13:09:00.697350 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.700336 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.717207 15688 consensus_peers.cc:597] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.722054 15688 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.734354 15688 consensus_peers.cc:597] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.848765 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.889282 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.917385 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08003e96a0 after lost signal to thread 14519
W20260709 13:09:00.918738 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08002e22a0 after lost signal to thread 15579
W20260709 13:09:00.920183 15576 debug-util.cc:398] Leaking SignalData structure 0x7b0800058360 after lost signal to thread 15746
W20260709 13:09:00.921540 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2860 after lost signal to thread 15820
W20260709 13:09:00.924857 15576 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd520 after lost signal to thread 16358
W20260709 13:09:00.925511 15576 debug-util.cc:398] Leaking SignalData structure 0x7b080004eae0 after lost signal to thread 23069
W20260709 13:09:00.943468 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.966650 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.093756 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.101914 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.112237 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.245414 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.246335 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.312727 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.372731 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.418043 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.442786 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 70213.4us
W20260709 13:09:01.457094 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.465656 14516 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:01.468425 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.478073 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.547420 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.574218 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.652652 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.653250 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.653762 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.661219 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.662417 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:01.741041 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.023710 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.105687 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.229271 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.232366 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.268535 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.377115 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.466284 14516 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:02.983278 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:03.155990 16327 consensus_queue.cc:237] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:09:03.158010 16300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 154631us
W20260709 13:09:03.223332 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.230089 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.233188 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.238397 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.241609 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.244508 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.248838 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.268877 15688 consensus_peers.cc:597] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.269078 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:03.284271 16298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:40695, user_credentials={real_user=slave}} blocked reactor thread for 110522us
W20260709 13:09:03.304539 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:03.313226 15795 raft_consensus.cc:1275] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Refusing update from remote peer 228b1ac5589e48af9bbf6caecd6aeaea: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:03.326191 23115 consensus_queue.cc:1048] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:03.344671 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.357844 23116 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:09:03.359922 15795 raft_consensus.cc:2955] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } } }
I20260709 13:09:03.373952 15529 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 00f37d51951a494996e57f1247bd69ee with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
W20260709 13:09:03.397933 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:03.403555 15539 catalog_manager.cc:5697] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea reported cstate change: config changed from index 4 to 11, VOTER 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) evicted. New cstate: current_term: 15 leader_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.466852 14516 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:03.498876 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.531265 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:03.549661 15707 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f37d51951a494996e57f1247bd69ee with delete_type TABLET_DATA_TOMBSTONED (TS 8ca6a5ab086d47e5a79ef37ddead9f28 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:53344
W20260709 13:09:03.567384 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:03.578724 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:03.587170 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:03.598661 23122 tablet_replica.cc:333] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:03.605932 23122 raft_consensus.cc:2243] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:03.617852 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:03.625080 23122 raft_consensus.cc:2272] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.629501 23122 ts_tablet_manager.cc:1916] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:03.690925 23122 ts_tablet_manager.cc:1929] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:09:03.691574 23122 log.cc:1199] T 00f37d51951a494996e57f1247bd69ee P 8ca6a5ab086d47e5a79ef37ddead9f28: Deleting WAL directory at /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/wals/00f37d51951a494996e57f1247bd69ee
W20260709 13:09:03.691896 15688 consensus_peers.cc:597] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:03.694316 15530 catalog_manager.cc:5028] TS 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): tablet 00f37d51951a494996e57f1247bd69ee (table test-workload [id=b62e816ecac94066aa90f229cf7e7cb9]) successfully deleted
W20260709 13:09:03.697517 15688 consensus_peers.cc:597] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.698014 15688 consensus_peers.cc:597] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.723276 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.730020 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.730571 15688 consensus_peers.cc:597] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.747671 15688 consensus_peers.cc:597] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.748302 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:03.751077 15688 consensus_peers.cc:597] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.758114 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:03.764542 15688 consensus_peers.cc:597] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.945116 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.946041 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.135486 15743 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8fc0 after lost signal to thread 14519
W20260709 13:09:04.136747 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800040240 after lost signal to thread 15579
W20260709 13:09:04.147708 15743 debug-util.cc:398] Leaking SignalData structure 0x7b080021d3a0 after lost signal to thread 15746
W20260709 13:09:04.149107 15743 debug-util.cc:398] Leaking SignalData structure 0x7b080027c4a0 after lost signal to thread 15820
W20260709 13:09:04.151536 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800042880 after lost signal to thread 16358
W20260709 13:09:04.181176 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.217424 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 50429.6us
W20260709 13:09:04.266499 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.325858 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.404026 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.415753 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.426190 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.408259 15688 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.467352 14516 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:04.467839 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.517417 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.520602 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.535415 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.823447 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:04.839880 15688 consensus_peers.cc:597] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.899104 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.045439 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.097898 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.131857 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.233217 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.243083 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.467897 14516 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:05.551682 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.558202 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.553305 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.558754 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.589607 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.623358 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.642529 15688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111) [suppressed 483 similar messages]
W20260709 13:09:05.660933 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:05.706938 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.801689 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.814688 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.866986 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:05.874401 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:05.893574 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.967348 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:05.969473 15688 consensus_peers.cc:597] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.998623 15688 consensus_peers.cc:597] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.002942 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.058305 15688 consensus_peers.cc:597] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.064450 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.078352 15688 consensus_peers.cc:597] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.096172 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.126989 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.155292 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.206120 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.266096 15688 consensus_peers.cc:597] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.341912 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.441589 15688 consensus_peers.cc:597] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.454819 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.458917 16355 debug-util.cc:398] Leaking SignalData structure 0x7b0800060520 after lost signal to thread 14519
W20260709 13:09:06.460206 16355 debug-util.cc:398] Leaking SignalData structure 0x7b0800327940 after lost signal to thread 15579
W20260709 13:09:06.461705 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7a40 after lost signal to thread 15746
W20260709 13:09:06.463353 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe480 after lost signal to thread 15820
W20260709 13:09:06.464835 16355 debug-util.cc:398] Leaking SignalData structure 0x7b08001369e0 after lost signal to thread 16358
W20260709 13:09:06.468550 14516 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:06.474288 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.508800 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.515493 15688 consensus_peers.cc:597] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.539530 15688 consensus_peers.cc:597] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.545290 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.745090 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:06.782125 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.801882 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.009542 15688 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.036106 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.059702 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.069154 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.072286 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.100482 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.139478 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.360174 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.385442 15688 consensus_peers.cc:597] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.469177 14516 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 15668)
W20260709 13:09:07.489681 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.636823 15688 consensus_peers.cc:597] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.684263 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.772660 15688 consensus_peers.cc:597] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.776173 15688 consensus_peers.cc:597] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.803593 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.831974 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.839443 15688 consensus_peers.cc:597] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:07.984342 15688 consensus_peers.cc:597] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.021847 15688 consensus_peers.cc:597] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.093899 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.094982 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.138792 15688 consensus_peers.cc:597] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.159953 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.183867 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.237242 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.326614 15688 consensus_peers.cc:597] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.391770 15688 consensus_peers.cc:597] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.404058 15688 consensus_peers.cc:597] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.436888 15688 consensus_peers.cc:597] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.468992 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.487387 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.502981 15688 consensus_peers.cc:597] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.588766 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.646749 15688 consensus_peers.cc:597] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.654255 15688 consensus_peers.cc:597] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.742729 15688 consensus_peers.cc:597] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.761052 15688 consensus_peers.cc:597] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.769210 15688 consensus_peers.cc:597] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.781579 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.811554 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:08.824781 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
W20260709 13:09:08.832592 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.836895 15688 consensus_peers.cc:597] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.839459 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:08.878701 15688 consensus_peers.cc:597] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.884344 15688 consensus_peers.cc:597] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.947338 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.002751 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:09.167315 15688 consensus_peers.cc:597] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:09.189860 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
W20260709 13:09:09.224640 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.226970 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:09.241719 15760 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.242405 15760 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.254885 16298 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.265653 16298 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.284264 15760 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.287874 15760 consensus_peers.cc:597] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.296406 15760 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.297658 16298 consensus_peers.cc:597] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.298297 15760 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.319644 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:09.357875 15760 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.388943 15760 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.407253 15760 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.439095 16298 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.449322 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:09.475767 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:09.478435 14516 tablet_replica.cc:333] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
W20260709 13:09:09.480439 16298 consensus_peers.cc:597] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.481091 14516 raft_consensus.cc:2243] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.481926 14516 raft_consensus.cc:2272] T 6317639150e3411184bf3cbb49ba1154 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.494516 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:09.498934 16298 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.509640 15760 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.523388 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:09.532982 15760 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.543761 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:09.546056 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:09.548625 14516 tablet_replica.cc:333] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.552147 14516 raft_consensus.cc:2243] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.553345 14516 raft_consensus.cc:2272] T 2555c9ee274d4274a4cf64af7f5c3609 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.556226 15760 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.558561 14516 tablet_replica.cc:333] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.559775 14516 raft_consensus.cc:2243] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.561026 14516 raft_consensus.cc:2272] T dbf56bc1c60545828ec946a02bb6cf8b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.562783 15760 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.563917 14516 tablet_replica.cc:333] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.564851 14516 raft_consensus.cc:2243] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.568058 14516 raft_consensus.cc:2272] T d084942b6c014c78b9a4ece4089fb430 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.572173 14516 tablet_replica.cc:333] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.577663 14516 raft_consensus.cc:2243] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.579115 14516 raft_consensus.cc:2272] T f3fb28c93eda43e09b6d9552f89d12ba P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.581792 14516 tablet_replica.cc:333] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.582590 14516 raft_consensus.cc:2243] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.583339 14516 raft_consensus.cc:2272] T 264ae6fa375a4fc39d6970b0c40cfd72 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.585434 15760 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.586349 14516 tablet_replica.cc:333] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.589913 14516 raft_consensus.cc:2243] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.591213 14516 raft_consensus.cc:2272] T f24ffe6bbf294850b0b75309859cae27 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.594285 14516 tablet_replica.cc:333] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.595268 14516 raft_consensus.cc:2243] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.596531 14516 raft_consensus.cc:2272] T 3d1a63ae20354b95b7bd0e7365b598f8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.607015 16298 consensus_peers.cc:597] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.605408 14516 tablet_replica.cc:333] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.610216 14516 raft_consensus.cc:2243] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.612326 14516 raft_consensus.cc:2272] T c36d0932529945e9a284405282d65321 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.645382 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:09.648005 14516 tablet_replica.cc:333] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.649114 14516 raft_consensus.cc:2243] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.650501 14516 raft_consensus.cc:2272] T e43d98ec23cf48ff888ae5baaae1b949 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.658212 14516 tablet_replica.cc:333] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.658987 14516 raft_consensus.cc:2243] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.660061 14516 raft_consensus.cc:2272] T b4aeec01bdbb47c8bd447ebc7aa8075c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.662791 14516 tablet_replica.cc:333] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
W20260709 13:09:09.663105 15688 consensus_peers.cc:597] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:09.663620 14516 raft_consensus.cc:2243] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.665670 14516 raft_consensus.cc:2272] T f4cc7c001b764df39f7b82f95bc198cc P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.668426 14516 tablet_replica.cc:333] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.669322 14516 raft_consensus.cc:2243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.670310 14516 raft_consensus.cc:2272] T 5a80ac95da7b40e8b9e155cdaf8a7739 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.672945 14516 tablet_replica.cc:333] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.673806 14516 raft_consensus.cc:2243] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:09.675884 15760 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.674502 14516 raft_consensus.cc:2272] T d1a58d7b48604275b9a01c8113841008 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.686771 14516 tablet_replica.cc:333] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.688277 14516 raft_consensus.cc:2243] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.689468 14516 raft_consensus.cc:2272] T 641dda60c3af4cf59874ffb47ae0ec1f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.692683 14516 tablet_replica.cc:333] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.693584 14516 raft_consensus.cc:2243] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.694759 14516 raft_consensus.cc:2272] T 95371a1d960048e7af7796052350a058 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.695497 15760 consensus_peers.cc:597] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.697535 14516 tablet_replica.cc:333] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.700951 14516 raft_consensus.cc:2243] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.702147 14516 raft_consensus.cc:2272] T 000b7a022df94c229b7580329401d5f2 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.704977 14516 tablet_replica.cc:333] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.705861 14516 raft_consensus.cc:2243] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.706867 14516 raft_consensus.cc:2272] T 76331ca323724c289906034e280e8274 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.709832 14516 tablet_replica.cc:333] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.710678 14516 raft_consensus.cc:2243] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.711866 14516 raft_consensus.cc:2272] T 0d5ce40a7af94aa0a543c078bc1fe630 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.714457 14516 tablet_replica.cc:333] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.715348 14516 raft_consensus.cc:2243] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.716573 14516 raft_consensus.cc:2272] T 17db433a32844f26aa2fe7c2d4e4bf66 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.719404 14516 tablet_replica.cc:333] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.727255 14516 raft_consensus.cc:2243] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.728700 14516 raft_consensus.cc:2272] T 3cde3f8ed1454b789014048b7d1e4af8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.731655 14516 tablet_replica.cc:333] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.732652 14516 raft_consensus.cc:2243] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.733449 14516 raft_consensus.cc:2272] T 9cd1114f45e54146933cfc74bc32722f P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:09.736431 15760 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.755550 14516 tablet_replica.cc:333] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.756677 14516 raft_consensus.cc:2243] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.758343 14516 raft_consensus.cc:2272] T 3836f44d54d2426aa13fe94be57f8fcb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.761543 14516 tablet_replica.cc:333] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.762686 14516 raft_consensus.cc:2243] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.763355 14516 raft_consensus.cc:2272] T 260cdec1e9ff4f2e92f7db3917710d4c P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.765956 14516 tablet_replica.cc:333] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.766753 14516 raft_consensus.cc:2243] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.768190 14516 raft_consensus.cc:2272] T 124c8d611c0e46e196764635f142c5f3 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.792254 14516 tablet_replica.cc:333] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.793452 14516 raft_consensus.cc:2243] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:09:09.794214 15685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.796411 14516 raft_consensus.cc:2272] T 9c6e933897cb4278b93a8cca027153ac P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.802562 14516 tablet_replica.cc:333] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.803881 14516 raft_consensus.cc:2243] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.804586 14516 raft_consensus.cc:2272] T 0e2577557ef849f9bd90a2b23564a72e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.810968 14516 tablet_replica.cc:333] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.811800 14516 raft_consensus.cc:2243] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.813236 14516 raft_consensus.cc:2272] T 7e1ddc8959ec401badd16f3610580c0b P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.826622 14516 tablet_replica.cc:333] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.827489 14516 raft_consensus.cc:2243] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.828202 14516 raft_consensus.cc:2272] T 931130cafbad4fe6ad371c4a32da2678 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.830814 14516 tablet_replica.cc:333] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.831614 14516 raft_consensus.cc:2243] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.832710 14516 raft_consensus.cc:2272] T a8b1fac517a64a4e9eaa1931a61e14dd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.844162 14516 tablet_replica.cc:333] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.845211 14516 raft_consensus.cc:2243] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.846442 14516 raft_consensus.cc:2272] T 95d881615f17486b87fb31ab586c91fd P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.850603 14516 tablet_replica.cc:333] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.853446 14516 raft_consensus.cc:2243] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.854679 14516 raft_consensus.cc:2272] T 8ab1a40028dd4bd8989c0eef484214fb P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.858613 14516 tablet_replica.cc:333] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.859473 14516 raft_consensus.cc:2243] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.860504 14516 raft_consensus.cc:2272] T 5155e26439a345ae8f836c6cc4f0ab34 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.863551 14516 tablet_replica.cc:333] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.864328 14516 raft_consensus.cc:2243] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.865010 14516 raft_consensus.cc:2272] T 84e21e8d93b04fda8cbe6eff63c91d00 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.867847 14516 tablet_replica.cc:333] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.868600 14516 raft_consensus.cc:2243] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.869390 14516 raft_consensus.cc:2272] T d53d726dd17e47aa93a8e89b12bb84c4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.872501 14516 tablet_replica.cc:333] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.874190 14516 raft_consensus.cc:2243] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.875058 14516 raft_consensus.cc:2272] T 356b3bbf62c44a84bc360356d580684d P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.881400 14516 tablet_replica.cc:333] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.882221 14516 raft_consensus.cc:2243] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.883011 14516 raft_consensus.cc:2272] T fa29a3025a254b5ca5f1a66e394cec53 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.886142 14516 tablet_replica.cc:333] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.886914 14516 raft_consensus.cc:2243] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.887776 14516 raft_consensus.cc:2272] T 6b555226593f4046be916b50c89b97ed P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.890308 14516 tablet_replica.cc:333] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.891057 14516 raft_consensus.cc:2243] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.891688 14516 raft_consensus.cc:2272] T c6d6772bfc824de6a5a77d8362f09c57 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.894160 14516 tablet_replica.cc:333] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.894901 14516 raft_consensus.cc:2243] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.896062 14516 raft_consensus.cc:2272] T b3d5d97766ab4411805e543ed41f9f38 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.909511 14516 tablet_replica.cc:333] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.910404 14516 raft_consensus.cc:2243] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.911460 14516 raft_consensus.cc:2272] T 9c8c1e0ef68b4538925aca4c0e72487e P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.914110 14516 tablet_replica.cc:333] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.914884 14516 raft_consensus.cc:2243] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.916424 14516 raft_consensus.cc:2272] T 4d7dd54a086d47c196a1227a925bbdff P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.919130 14516 tablet_replica.cc:333] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.919920 14516 raft_consensus.cc:2243] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.925770 14516 raft_consensus.cc:2272] T f6940e9e6caf46bd88b8db528efa12e8 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.928342 14516 tablet_replica.cc:333] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.929076 14516 raft_consensus.cc:2243] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.930253 14516 raft_consensus.cc:2272] T b40bb44d33b449189eb6c71fbb47dca4 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.940152 14516 tablet_replica.cc:333] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.941241 14516 raft_consensus.cc:2243] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.941948 14516 raft_consensus.cc:2272] T 17999909d8e0416d88f73b762dbb4bd6 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.944480 14516 tablet_replica.cc:333] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.945259 14516 raft_consensus.cc:2243] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:09.945990 14516 raft_consensus.cc:2272] T 9b565f6448234458882c913c62c38ac0 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.949222 14516 tablet_replica.cc:333] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.951285 14516 raft_consensus.cc:2243] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.952425 14516 raft_consensus.cc:2272] T d1b41c8b77bb478d9a07b1fa9c45f64a P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.958436 14516 tablet_replica.cc:333] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.959460 14516 raft_consensus.cc:2243] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.962443 14516 raft_consensus.cc:2272] T 2587899a27f245e9b0ef17e109a8e540 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:09.974205 14516 tablet_replica.cc:333] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28: stopping tablet replica
I20260709 13:09:09.977805 14516 raft_consensus.cc:2243] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:09.978986 14516 raft_consensus.cc:2272] T e7a882c727204be4b66080704cceb833 P 8ca6a5ab086d47e5a79ef37ddead9f28 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:10.194010 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:10.258203 15762 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:10.261113 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:10.382297 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.438082 15762 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.484251 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:10.650609 15762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111) [suppressed 533 similar messages]
I20260709 13:09:10.680114 23159 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.680711 23159 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.696301 23156 raft_consensus.cc:493] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.696973 23156 raft_consensus.cc:515] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:09:10.699415 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:10.720896 16298 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:10.723843 23156 leader_election.cc:290] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:10.722168 16298 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:10.731191 23131 raft_consensus.cc:493] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.731853 23131 raft_consensus.cc:515] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:10.733883 23131 leader_election.cc:290] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:10.735508 23164 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.737912 23159 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:10.743346 16297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:35499, user_credentials={real_user=slave}} blocked reactor thread for 49475.8us
I20260709 13:09:10.755079 23155 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.755787 23155 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.758100 23155 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:10.771337 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:10.776077 23156 raft_consensus.cc:493] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.776944 23156 raft_consensus.cc:515] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:10.783875 23156 leader_election.cc:290] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:10.772692 15760 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:10.800408 15760 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:10.788473 23164 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.801162 23164 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.803642 23164 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
I20260709 13:09:10.805344 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
W20260709 13:09:10.773082 16298 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:10.814356 16300 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:10.819487 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:10.825609 23156 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.826686 23156 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:09:10.822845 16298 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:10.839136 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:09:10.841519 23165 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:10.828230 15762 consensus_peers.cc:597] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:10.828693 23164 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:10.836318 15760 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:10.848968 15762 leader_election.cc:336] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:10.849454 15762 leader_election.cc:304] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:10.856331 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:09:10.857049 16327 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:09:10.864775 23131 raft_consensus.cc:2749] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:10.866555 15762 leader_election.cc:336] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:10.867039 23156 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:09:10.873703 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:09:10.875787 23156 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:10.878585 23156 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.879046 23156 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:10.883966 23165 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.884624 23165 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.871058 15762 leader_election.cc:304] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:10.887596 23165 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:10.893114 23131 raft_consensus.cc:2749] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:10.904544 15760 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:10.913932 16298 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:10.927327 23165 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.933879 23165 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.936546 23131 raft_consensus.cc:493] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.942970 23131 raft_consensus.cc:515] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:10.944988 23131 leader_election.cc:290] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:10.947036 23165 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:10.937127 15762 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:10.955004 15762 leader_election.cc:336] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:10.955477 15762 leader_election.cc:304] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:10.953171 23131 raft_consensus.cc:493] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.956188 23131 raft_consensus.cc:515] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:10.958112 23131 leader_election.cc:290] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:10.950564 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:10.960628 23131 raft_consensus.cc:2749] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:10.964709 23165 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.967044 23165 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.975117 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c1927141dc2540dab644a00fd6843fc6" is_pre_election: true
I20260709 13:09:10.976917 23131 raft_consensus.cc:493] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.977717 23131 raft_consensus.cc:515] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:09:10.983143 15762 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.984144 15762 consensus_peers.cc:597] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:10.987260 23131 leader_election.cc:290] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:10.990931 23164 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:10.991523 23164 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:10.993963 23164 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:10.996979 16300 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.000726 16300 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:10.932938 23156 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:11.000270 23165 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:10.997352 16298 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.010381 16298 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:10.999864 15760 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.011917 23165 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:11.013726 15760 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.012343 23156 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:09:11.012806 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:09:11.018961 23165 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:11.023043 23131 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.023536 23131 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:11.025403 23131 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
W20260709 13:09:11.033401 15760 leader_election.cc:336] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.034495 16300 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:11.042627 16298 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.022675 15762 leader_election.cc:336] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.045469 15762 leader_election.cc:304] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.044431 16300 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.047201 23165 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:11.048396 15762 leader_election.cc:336] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.051543 15762 leader_election.cc:304] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.050863 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3fb28c93eda43e09b6d9552f89d12ba" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:09:11.048929 23156 raft_consensus.cc:2749] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:11.054414 16327 raft_consensus.cc:3060] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.054893 23131 raft_consensus.cc:493] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.055351 23131 raft_consensus.cc:515] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.057157 23131 leader_election.cc:290] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:11.057998 23156 raft_consensus.cc:2749] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:11.059995 15760 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.051633 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" is_pre_election: true
I20260709 13:09:11.075730 23166 raft_consensus.cc:493] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
W20260709 13:09:11.060585 15760 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.076650 16333 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 14.
I20260709 13:09:11.077075 23166 raft_consensus.cc:515] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.076290 23165 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.078219 23165 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:09:11.076061 16300 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.079195 16300 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.079526 23166 leader_election.cc:290] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:11.067229 16327 raft_consensus.cc:2468] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 16.
I20260709 13:09:11.081684 23159 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:11.082293 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:09:11.082480 23159 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.082932 23159 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:11.084220 23166 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:11.084659 23166 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.084888 23159 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:11.085069 23166 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.089300 23165 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:11.092795 16298 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.097019 16298 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.064510 23131 raft_consensus.cc:493] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.099687 15759 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28
I20260709 13:09:11.098111 23131 raft_consensus.cc:515] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.100884 23156 raft_consensus.cc:2804] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:11.101959 23131 leader_election.cc:290] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:11.102869 16300 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:11.103048 15762 leader_election.cc:336] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.103400 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.103528 15762 leader_election.cc:304] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.093329 23166 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:11.105698 23166 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Requested vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485)
I20260709 13:09:11.106400 23166 raft_consensus.cc:2749] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:11.107522 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d881615f17486b87fb31ab586c91fd" candidate_uuid: "c1927141dc2540dab644a00fd6843fc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "228b1ac5589e48af9bbf6caecd6aeaea"
I20260709 13:09:11.107728 23156 raft_consensus.cc:697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:09:11.108115 16327 raft_consensus.cc:3060] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.108855 23156 consensus_queue.cc:237] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
W20260709 13:09:11.105543 15760 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.112278 15760 leader_election.cc:336] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.112612 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.111536 23165 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:11.113085 16300 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.114818 23165 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:11.120684 16327 raft_consensus.cc:2468] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1927141dc2540dab644a00fd6843fc6 in term 15.
I20260709 13:09:11.135264 15759 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea, c1927141dc2540dab644a00fd6843fc6; no voters: 
I20260709 13:09:11.136096 23156 raft_consensus.cc:2804] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:11.136643 23156 raft_consensus.cc:697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Becoming Leader. State: Replica: c1927141dc2540dab644a00fd6843fc6, State: Running, Role: LEADER
I20260709 13:09:11.137552 23156 consensus_queue.cc:237] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:11.144387 23167 raft_consensus.cc:493] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.145017 23167 raft_consensus.cc:515] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:09:11.150907 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.151165 15760 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.152339 15760 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.156723 23131 raft_consensus.cc:493] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.157371 23131 raft_consensus.cc:515] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
W20260709 13:09:11.158838 15762 leader_election.cc:336] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.159319 15762 leader_election.cc:304] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.155889 15539 catalog_manager.cc:5697] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 15 to 16, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 16 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.168323 23131 leader_election.cc:290] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:11.170202 23131 raft_consensus.cc:493] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.174160 23167 leader_election.cc:290] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:11.174803 23167 raft_consensus.cc:2749] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:11.170805 23131 raft_consensus.cc:515] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.194581 23131 leader_election.cc:290] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:11.204234 23131 raft_consensus.cc:493] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.204748 23131 raft_consensus.cc:515] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.206893 23131 leader_election.cc:290] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:11.209129 15762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:46181, user_credentials={real_user=slave}} blocked reactor thread for 50321.1us
W20260709 13:09:11.215063 15762 leader_election.cc:336] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.215553 15762 leader_election.cc:304] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:09:11.219153 15760 leader_election.cc:336] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.219755 15760 leader_election.cc:336] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.220377 15760 leader_election.cc:336] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.222267 23131 raft_consensus.cc:2749] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:11.223457 15762 leader_election.cc:336] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.223913 15762 leader_election.cc:304] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.224665 23131 raft_consensus.cc:2749] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:11.228823 15760 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:11.230728 15762 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.239485 15762 leader_election.cc:336] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.239953 15762 leader_election.cc:304] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.242452 23131 raft_consensus.cc:2749] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:11.243289 23131 raft_consensus.cc:493] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.243762 23131 raft_consensus.cc:515] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.247130 23131 leader_election.cc:290] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:11.251405 15762 leader_election.cc:336] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.251919 15762 leader_election.cc:304] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:09:11.254828 15760 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.257419 23173 raft_consensus.cc:2749] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:11.257519 15762 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.258220 15762 leader_election.cc:336] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.258711 15762 leader_election.cc:304] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.259680 23173 raft_consensus.cc:2749] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:11.259976 15762 leader_election.cc:336] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.260470 15762 leader_election.cc:304] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.305284 23171 raft_consensus.cc:2749] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:11.349378 15539 catalog_manager.cc:5697] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 reported cstate change: term changed from 14 to 15, leader changed from 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2) to c1927141dc2540dab644a00fd6843fc6 (127.14.45.3). New cstate: current_term: 15 leader_uuid: "c1927141dc2540dab644a00fd6843fc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.356446 23171 raft_consensus.cc:493] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.357311 23171 raft_consensus.cc:515] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.366173 23171 leader_election.cc:290] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:11.370801 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.373900 15760 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.401678 23171 raft_consensus.cc:493] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:11.402657 23171 raft_consensus.cc:515] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } }
I20260709 13:09:11.405107 23171 leader_election.cc:290] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:11.385546 15762 leader_election.cc:336] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:11.409947 15760 leader_election.cc:336] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:11.411202 15762 leader_election.cc:304] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.412010 23171 raft_consensus.cc:2749] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:11.414201 15762 leader_election.cc:336] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.414623 15762 leader_election.cc:304] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.415302 23171 raft_consensus.cc:2749] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:11.421963 15762 leader_election.cc:336] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:11.422591 15762 leader_election.cc:304] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1927141dc2540dab644a00fd6843fc6; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:11.423411 23171 raft_consensus.cc:2749] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:11.447541 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:11.524698 16327 raft_consensus.cc:1275] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:09:11.528375 23171 consensus_queue.cc:1048] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:11.559928 15762 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.602315 15762 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.626960 15760 consensus_peers.cc:597] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:11.627640 15762 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.630800 15760 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.649847 16298 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.728864 15760 consensus_peers.cc:597] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:11.729409 15760 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.744095 16298 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.774760 15760 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:11.760304 16327 raft_consensus.cc:1275] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Refusing update from remote peer c1927141dc2540dab644a00fd6843fc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:11.793550 23173 consensus_queue.cc:1048] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:11.812394 15760 consensus_peers.cc:597] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.821146 16298 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.821929 16298 consensus_peers.cc:597] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.847559 16298 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.836647 15760 consensus_peers.cc:597] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.875986 15762 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.913039 15762 consensus_peers.cc:597] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.941004 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.967182 15760 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.967906 15760 consensus_peers.cc:597] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.986279 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.986884 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:11.986877 15760 consensus_peers.cc:597] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.992192 15760 consensus_peers.cc:597] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.058686 15760 consensus_peers.cc:597] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.116707 15760 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.161985 15760 consensus_peers.cc:597] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.170800 16298 consensus_peers.cc:597] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.182875 15760 consensus_peers.cc:597] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:12.194798 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
W20260709 13:09:12.221169 15762 consensus_peers.cc:597] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:12.221972 15762 consensus_peers.cc:597] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:12.270092 15760 consensus_peers.cc:597] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.271327 15760 consensus_peers.cc:597] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.303680 15762 consensus_peers.cc:597] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:12.310668 16298 consensus_peers.cc:597] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:12.385229 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
W20260709 13:09:12.387298 15760 consensus_peers.cc:597] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.392647 16297 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.397065 16297 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.413646 23183 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:12.414440 23183 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:12.417810 23183 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:12.432497 16298 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:12.434918 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:12.435454 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:12.436216 23183 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:12.465051 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:12.466394 14516 tablet_replica.cc:333] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.467473 14516 raft_consensus.cc:2243] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.468813 14516 raft_consensus.cc:2272] T 00f37d51951a494996e57f1247bd69ee P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.472048 14516 tablet_replica.cc:333] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.472968 14516 raft_consensus.cc:2243] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.475281 14516 raft_consensus.cc:2272] T 6317639150e3411184bf3cbb49ba1154 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.479869 15760 consensus_peers.cc:597] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:12.481901 14516 tablet_replica.cc:333] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.482960 14516 raft_consensus.cc:2243] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.483733 14516 raft_consensus.cc:2272] T 2555c9ee274d4274a4cf64af7f5c3609 P c1927141dc2540dab644a00fd6843fc6 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.485905 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:12.486500 14516 tablet_replica.cc:333] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.487419 14516 raft_consensus.cc:2243] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.488466 14516 raft_consensus.cc:2272] T f3fb28c93eda43e09b6d9552f89d12ba P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.491317 14516 tablet_replica.cc:333] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.492120 14516 raft_consensus.cc:2243] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.493345 14516 raft_consensus.cc:2272] T 264ae6fa375a4fc39d6970b0c40cfd72 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.498162 14516 tablet_replica.cc:333] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.499071 14516 raft_consensus.cc:2243] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:12.499992 16297 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.500797 14516 raft_consensus.cc:2272] T d084942b6c014c78b9a4ece4089fb430 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.503729 14516 tablet_replica.cc:333] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.504638 14516 raft_consensus.cc:2243] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.505358 14516 raft_consensus.cc:2272] T e9f64c9d13524994bf43ee72f72781ee P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.508123 14516 tablet_replica.cc:333] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.509313 14516 raft_consensus.cc:2243] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.510408 14516 raft_consensus.cc:2272] T 3d1a63ae20354b95b7bd0e7365b598f8 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.513320 14516 tablet_replica.cc:333] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.514196 14516 raft_consensus.cc:2243] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.514900 14516 raft_consensus.cc:2272] T 1dabdbaded914a498e98f6a03182ab7e P c1927141dc2540dab644a00fd6843fc6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.516973 14516 tablet_replica.cc:333] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.517907 14516 raft_consensus.cc:2243] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.517989 23183 raft_consensus.cc:493] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:12.518692 14516 raft_consensus.cc:2272] T b4aeec01bdbb47c8bd447ebc7aa8075c P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.518782 23183 raft_consensus.cc:515] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:12.521581 14516 tablet_replica.cc:333] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.522094 23183 leader_election.cc:290] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:12.522583 14516 raft_consensus.cc:2243] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.523571 14516 raft_consensus.cc:2272] T e43d98ec23cf48ff888ae5baaae1b949 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.527208 14516 tablet_replica.cc:333] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
W20260709 13:09:12.527925 16298 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:12.528213 14516 raft_consensus.cc:2243] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.529476 14516 raft_consensus.cc:2272] T f4cc7c001b764df39f7b82f95bc198cc P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.531862 16300 leader_election.cc:336] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:12.532588 14516 tablet_replica.cc:333] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.532621 16300 leader_election.cc:304] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:12.533830 23183 raft_consensus.cc:2749] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:12.533886 14516 raft_consensus.cc:2243] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.587859 14516 raft_consensus.cc:2272] T 5a80ac95da7b40e8b9e155cdaf8a7739 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.591310 14516 tablet_replica.cc:333] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.599436 14516 raft_consensus.cc:2243] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.601176 14516 raft_consensus.cc:2272] T d1a58d7b48604275b9a01c8113841008 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.604604 14516 tablet_replica.cc:333] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.605595 14516 raft_consensus.cc:2243] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.606891 14516 raft_consensus.cc:2272] T f24ffe6bbf294850b0b75309859cae27 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.609866 14516 tablet_replica.cc:333] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.610723 14516 raft_consensus.cc:2243] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.611477 14516 raft_consensus.cc:2272] T a9dc71c1b2c74ae3a9bd46fccb533628 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.616703 15762 consensus_peers.cc:597] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:12.618654 14516 tablet_replica.cc:333] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.619664 14516 raft_consensus.cc:2243] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.637565 14516 raft_consensus.cc:2272] T 641dda60c3af4cf59874ffb47ae0ec1f P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.641353 14516 tablet_replica.cc:333] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.642930 14516 raft_consensus.cc:2243] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.643803 14516 raft_consensus.cc:2272] T 95371a1d960048e7af7796052350a058 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.647071 14516 tablet_replica.cc:333] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.648097 14516 raft_consensus.cc:2243] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.648924 14516 raft_consensus.cc:2272] T 8d1d6e542161416d9033cefcbd0c06e3 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.652938 14516 tablet_replica.cc:333] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.654150 14516 raft_consensus.cc:2243] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.655503 14516 raft_consensus.cc:2272] T a8f5c34f652e44ef80105d4e8021a365 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.659253 14516 tablet_replica.cc:333] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.660454 14516 raft_consensus.cc:2243] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.662346 14516 raft_consensus.cc:2272] T 76331ca323724c289906034e280e8274 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.666276 14516 tablet_replica.cc:333] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.667621 14516 raft_consensus.cc:2243] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.668540 14516 raft_consensus.cc:2272] T b106b4017dc84b21a7c6f58814593886 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.672180 14516 tablet_replica.cc:333] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.673353 14516 raft_consensus.cc:2243] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.675215 14516 raft_consensus.cc:2272] T 9cd1114f45e54146933cfc74bc32722f P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.678858 14516 tablet_replica.cc:333] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.680013 14516 raft_consensus.cc:2243] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.680945 14516 raft_consensus.cc:2272] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.685027 14516 tablet_replica.cc:333] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.686203 14516 raft_consensus.cc:2243] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.687168 14516 raft_consensus.cc:2272] T 3836f44d54d2426aa13fe94be57f8fcb P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.690790 14516 tablet_replica.cc:333] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.691900 14516 raft_consensus.cc:2243] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.692938 14516 raft_consensus.cc:2272] T 8ab1a40028dd4bd8989c0eef484214fb P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.696734 14516 tablet_replica.cc:333] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.697934 14516 raft_consensus.cc:2243] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.699733 14516 raft_consensus.cc:2272] T 84e21e8d93b04fda8cbe6eff63c91d00 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.703603 14516 tablet_replica.cc:333] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.704828 14516 raft_consensus.cc:2243] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.714785 14516 raft_consensus.cc:2272] T 5155e26439a345ae8f836c6cc4f0ab34 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.718876 14516 tablet_replica.cc:333] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.720206 14516 raft_consensus.cc:2243] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.721936 14516 raft_consensus.cc:2272] T d53d726dd17e47aa93a8e89b12bb84c4 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.726900 14516 tablet_replica.cc:333] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.740743 14516 raft_consensus.cc:2243] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.742512 14516 raft_consensus.cc:2272] T 356b3bbf62c44a84bc360356d580684d P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.746703 14516 tablet_replica.cc:333] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.747995 14516 raft_consensus.cc:2243] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.750291 14516 raft_consensus.cc:2272] T 493304a609d247829052517242c00e96 P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.759202 14516 tablet_replica.cc:333] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.760329 14516 raft_consensus.cc:2243] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.761698 14516 raft_consensus.cc:2272] T 5622436c83fb41fa8923df2295b99818 P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.769465 14516 tablet_replica.cc:333] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.772686 14516 raft_consensus.cc:2243] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.774554 14516 raft_consensus.cc:2272] T d1b41c8b77bb478d9a07b1fa9c45f64a P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.782284 14516 tablet_replica.cc:333] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.790652 14516 raft_consensus.cc:2243] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.792083 14516 raft_consensus.cc:2272] T 7e1ddc8959ec401badd16f3610580c0b P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.795954 14516 tablet_replica.cc:333] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.806474 14516 raft_consensus.cc:2243] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.808370 14516 raft_consensus.cc:2272] T 0e2577557ef849f9bd90a2b23564a72e P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.812281 14516 tablet_replica.cc:333] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.813499 14516 raft_consensus.cc:2243] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.814515 14516 raft_consensus.cc:2272] T 931130cafbad4fe6ad371c4a32da2678 P c1927141dc2540dab644a00fd6843fc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.818315 14516 tablet_replica.cc:333] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.828272 14516 raft_consensus.cc:2243] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.829706 14516 raft_consensus.cc:2272] T 95d881615f17486b87fb31ab586c91fd P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.851557 14516 tablet_replica.cc:333] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.852531 14516 raft_consensus.cc:2243] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.853400 14516 raft_consensus.cc:2272] T 2587899a27f245e9b0ef17e109a8e540 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.878507 14516 tablet_replica.cc:333] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.879534 14516 raft_consensus.cc:2243] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.897854 14516 raft_consensus.cc:2272] T 9b565f6448234458882c913c62c38ac0 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.901067 14516 tablet_replica.cc:333] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.902011 14516 raft_consensus.cc:2243] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.903112 14516 raft_consensus.cc:2272] T fa29a3025a254b5ca5f1a66e394cec53 P c1927141dc2540dab644a00fd6843fc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.905956 14516 tablet_replica.cc:333] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.906800 14516 raft_consensus.cc:2243] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.907572 14516 raft_consensus.cc:2272] T 124c8d611c0e46e196764635f142c5f3 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.909619 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:12.922449 14516 tablet_replica.cc:333] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.923367 14516 raft_consensus.cc:2243] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.925033 14516 raft_consensus.cc:2272] T 6b555226593f4046be916b50c89b97ed P c1927141dc2540dab644a00fd6843fc6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.926558 16297 consensus_peers.cc:597] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.927232 16297 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.927906 16297 consensus_peers.cc:597] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.928189 14516 tablet_replica.cc:333] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
W20260709 13:09:12.928335 16297 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.928912 16297 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.929033 14516 raft_consensus.cc:2243] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.931638 14516 raft_consensus.cc:2272] T b3d5d97766ab4411805e543ed41f9f38 P c1927141dc2540dab644a00fd6843fc6 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.927155 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:12.934614 14516 tablet_replica.cc:333] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.935453 14516 raft_consensus.cc:2243] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:12.937013 14516 raft_consensus.cc:2272] T c6d6772bfc824de6a5a77d8362f09c57 P c1927141dc2540dab644a00fd6843fc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.939812 14516 tablet_replica.cc:333] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.940554 14516 raft_consensus.cc:2243] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.941263 14516 raft_consensus.cc:2272] T e7a882c727204be4b66080704cceb833 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.944077 14516 tablet_replica.cc:333] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.944792 14516 raft_consensus.cc:2243] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.945393 14516 raft_consensus.cc:2272] T f6940e9e6caf46bd88b8db528efa12e8 P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.947666 23192 raft_consensus.cc:493] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:12.948321 14516 tablet_replica.cc:333] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.948357 23192 raft_consensus.cc:515] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:12.949333 14516 raft_consensus.cc:2243] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.950135 14516 raft_consensus.cc:2272] T b40bb44d33b449189eb6c71fbb47dca4 P c1927141dc2540dab644a00fd6843fc6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.951083 23192 leader_election.cc:290] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:12.953035 14516 tablet_replica.cc:333] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.953899 14516 raft_consensus.cc:2243] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.954958 14516 raft_consensus.cc:2272] T 17999909d8e0416d88f73b762dbb4bd6 P c1927141dc2540dab644a00fd6843fc6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.957654 14516 tablet_replica.cc:333] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.958410 14516 raft_consensus.cc:2243] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:09:12.959576 16298 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:12.959724 14516 raft_consensus.cc:2272] T 9c8c1e0ef68b4538925aca4c0e72487e P c1927141dc2540dab644a00fd6843fc6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.960177 16300 leader_election.cc:336] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:12.960642 16300 leader_election.cc:304] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:12.961897 23192 raft_consensus.cc:2749] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:12.962584 14516 tablet_replica.cc:333] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6: stopping tablet replica
I20260709 13:09:12.963371 14516 raft_consensus.cc:2243] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.964184 14516 raft_consensus.cc:2272] T 4d7dd54a086d47c196a1227a925bbdff P c1927141dc2540dab644a00fd6843fc6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:12.970510 16297 consensus_peers.cc:597] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.971149 16297 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.972205 16297 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.972815 16297 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:12.973249 16297 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.034320 23192 raft_consensus.cc:493] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:13.035142 23192 raft_consensus.cc:515] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.037627 23192 leader_election.cc:290] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:13.042567 16300 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:13.044941 16298 leader_election.cc:336] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:13.045519 16298 leader_election.cc:304] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:13.046936 23192 raft_consensus.cc:2749] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:13.060374 23192 raft_consensus.cc:493] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:13.061815 23192 raft_consensus.cc:515] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.063788 23191 raft_consensus.cc:493] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:13.064072 23192 leader_election.cc:290] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
I20260709 13:09:13.064550 23191 raft_consensus.cc:515] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.068475 23191 leader_election.cc:290] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:13.072510 16300 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:13.073217 16300 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:13.211061 23191 raft_consensus.cc:493] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:13.211766 23191 raft_consensus.cc:515] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.213991 23191 leader_election.cc:290] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:13.217361 16300 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
W20260709 13:09:13.406204 16300 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:13.428393 16300 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:13.582633 23187 raft_consensus.cc:493] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:13.583227 23187 raft_consensus.cc:515] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.585367 23187 leader_election.cc:290] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:13.588959 16297 leader_election.cc:336] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
W20260709 13:09:13.638458 15817 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0fa0 after lost signal to thread 14519
W20260709 13:09:13.639478 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080026b1a0 after lost signal to thread 15579
W20260709 13:09:13.639941 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080017a800 after lost signal to thread 15820
W20260709 13:09:13.640882 15817 debug-util.cc:398] Leaking SignalData structure 0x7b080030aae0 after lost signal to thread 16358
W20260709 13:09:13.739866 16300 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:13.771384 23187 raft_consensus.cc:493] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:13.772017 23187 raft_consensus.cc:515] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.774252 23187 leader_election.cc:290] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:13.778832 16297 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
I20260709 13:09:13.781770 23187 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:13.782720 23187 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.788736 23192 raft_consensus.cc:493] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:13.789386 23192 raft_consensus.cc:515] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.791764 23192 leader_election.cc:290] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:13.792081 16300 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:13.793359 23187 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:13.798080 16297 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
W20260709 13:09:13.798615 16297 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
I20260709 13:09:13.799010 16297 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:09:13.799803 23192 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.888955 23192 raft_consensus.cc:493] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:13.889599 23192 raft_consensus.cc:515] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:13.892005 23192 leader_election.cc:290] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:13.896624 16297 leader_election.cc:336] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
W20260709 13:09:13.901121 16300 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:13.927567 16300 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:14.076507 14516 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15817)
W20260709 13:09:14.089604 16298 leader_election.cc:336] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.090266 16298 leader_election.cc:304] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
W20260709 13:09:14.091323 16298 leader_election.cc:336] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.091389 23192 raft_consensus.cc:2749] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:14.091907 16298 leader_election.cc:304] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:14.092787 23192 raft_consensus.cc:2749] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:14.096608 16298 leader_election.cc:336] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.097139 16298 leader_election.cc:304] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:14.097937 23192 raft_consensus.cc:2749] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:14.098621 16298 leader_election.cc:336] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.099102 16298 leader_election.cc:304] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:09:14.099869 23192 raft_consensus.cc:2749] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:14.100111 16298 leader_election.cc:336] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.100682 16298 leader_election.cc:304] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:09:14.101450 23192 raft_consensus.cc:2749] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:14.101627 16298 leader_election.cc:336] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.103039 16298 leader_election.cc:304] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:09:14.103788 23187 raft_consensus.cc:2749] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:14.104733 16298 leader_election.cc:336] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
I20260709 13:09:14.105160 16298 leader_election.cc:304] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, c1927141dc2540dab644a00fd6843fc6
I20260709 13:09:14.105917 23187 raft_consensus.cc:2749] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:14.123402 23187 raft_consensus.cc:493] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:14.124053 23187 raft_consensus.cc:515] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:14.126435 23187 leader_election.cc:290] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:14.131457 16297 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
W20260709 13:09:14.132037 16300 leader_election.cc:336] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:14.132454 16300 leader_election.cc:304] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:09:14.133229 23187 raft_consensus.cc:2749] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:14.154716 23187 raft_consensus.cc:493] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6a5ab086d47e5a79ef37ddead9f28)
I20260709 13:09:14.155357 23187 raft_consensus.cc:515] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "8ca6a5ab086d47e5a79ef37ddead9f28" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 40695 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:14.157632 23187 leader_election.cc:290] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695)
W20260709 13:09:14.162675 16298 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111)
W20260709 13:09:14.163230 16300 leader_election.cc:336] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:14.163657 16300 leader_election.cc:304] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: 8ca6a5ab086d47e5a79ef37ddead9f28, fec10611791a4ab384f86b212249410e
I20260709 13:09:14.164389 23187 raft_consensus.cc:2749] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:14.208505 16300 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:14.296856 16300 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:14.582749 16300 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:14.714700 16298 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:14.742411 16298 consensus_peers.cc:597] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:14.774233 16297 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:14.786094 16298 consensus_peers.cc:597] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:14.828102 16298 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:14.931456 16297 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:14.965004 16300 consensus_peers.cc:597] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:15.067497 16298 consensus_peers.cc:597] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:15.101014 16297 consensus_peers.cc:597] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:15.174176 16297 consensus_peers.cc:597] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:15.184098 16297 consensus_peers.cc:597] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:15.278955 16297 consensus_peers.cc:597] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:15.308106 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
W20260709 13:09:15.325721 16297 consensus_peers.cc:597] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:15.330941 16297 consensus_peers.cc:597] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:15.386324 16300 consensus_peers.cc:597] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:15.395205 23192 raft_consensus.cc:493] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c1927141dc2540dab644a00fd6843fc6)
I20260709 13:09:15.395994 23192 raft_consensus.cc:515] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fec10611791a4ab384f86b212249410e" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 46181 } } peers { permanent_uuid: "c1927141dc2540dab644a00fd6843fc6" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 35499 } } peers { permanent_uuid: "228b1ac5589e48af9bbf6caecd6aeaea" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 41485 } attrs { promote: false } }
I20260709 13:09:15.398824 23192 leader_election.cc:290] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fec10611791a4ab384f86b212249410e (127.14.45.1:46181), c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499)
W20260709 13:09:15.406212 16297 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111)
W20260709 13:09:15.406916 16300 leader_election.cc:336] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111)
I20260709 13:09:15.407421 16300 leader_election.cc:304] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 228b1ac5589e48af9bbf6caecd6aeaea; no voters: c1927141dc2540dab644a00fd6843fc6, fec10611791a4ab384f86b212249410e
I20260709 13:09:15.408308 23192 raft_consensus.cc:2749] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:15.415269 16300 consensus_peers.cc:597] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer fec10611791a4ab384f86b212249410e (127.14.45.1:46181): Couldn't send request to peer fec10611791a4ab384f86b212249410e. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:46181: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:15.423553 14516 tablet_server.cc:179] TabletServer@127.14.45.4:0 shutting down...
W20260709 13:09:15.472539 16297 consensus_peers.cc:597] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:15.479154 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:15.480051 14516 tablet_replica.cc:333] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.480993 14516 raft_consensus.cc:2243] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.482353 14516 raft_consensus.cc:2272] T 00f37d51951a494996e57f1247bd69ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.484936 14516 tablet_replica.cc:333] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.486013 14516 raft_consensus.cc:2243] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.487448 14516 raft_consensus.cc:2272] T 3d1a63ae20354b95b7bd0e7365b598f8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.490744 16297 consensus_peers.cc:597] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:15.490998 14516 tablet_replica.cc:333] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.491856 14516 raft_consensus.cc:2243] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.492385 14516 raft_consensus.cc:2272] T 356b3bbf62c44a84bc360356d580684d P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.494863 14516 tablet_replica.cc:333] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.495539 14516 raft_consensus.cc:2243] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.496287 14516 raft_consensus.cc:2272] T 0d5ce40a7af94aa0a543c078bc1fe630 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.499097 14516 tablet_replica.cc:333] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.500094 14516 raft_consensus.cc:2243] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.501368 14516 raft_consensus.cc:2272] T e9f64c9d13524994bf43ee72f72781ee P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.504225 14516 tablet_replica.cc:333] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.504873 14516 raft_consensus.cc:2243] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.505846 14516 raft_consensus.cc:2272] T 493304a609d247829052517242c00e96 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.508173 14516 tablet_replica.cc:333] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.508816 14516 raft_consensus.cc:2243] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.509876 14516 raft_consensus.cc:2272] T 2555c9ee274d4274a4cf64af7f5c3609 P 228b1ac5589e48af9bbf6caecd6aeaea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.512619 14516 tablet_replica.cc:333] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.513535 14516 raft_consensus.cc:2243] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.514225 14516 raft_consensus.cc:2272] T 5155e26439a345ae8f836c6cc4f0ab34 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.517427 16298 consensus_peers.cc:597] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer 8ca6a5ab086d47e5a79ef37ddead9f28 (127.14.45.2:40695): Couldn't send request to peer 8ca6a5ab086d47e5a79ef37ddead9f28. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:40695: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:15.517809 14516 tablet_replica.cc:333] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.518824 14516 raft_consensus.cc:2243] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.519761 14516 raft_consensus.cc:2272] T a9dc71c1b2c74ae3a9bd46fccb533628 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.522676 14516 tablet_replica.cc:333] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.523324 14516 raft_consensus.cc:2243] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.524170 14516 raft_consensus.cc:2272] T 931130cafbad4fe6ad371c4a32da2678 P 228b1ac5589e48af9bbf6caecd6aeaea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.526338 14516 tablet_replica.cc:333] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.526976 14516 raft_consensus.cc:2243] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.527587 14516 raft_consensus.cc:2272] T a8b1fac517a64a4e9eaa1931a61e14dd P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.529855 14516 tablet_replica.cc:333] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.530422 14516 raft_consensus.cc:2243] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.530897 14516 raft_consensus.cc:2272] T 95d881615f17486b87fb31ab586c91fd P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.532670 14516 tablet_replica.cc:333] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.533238 14516 raft_consensus.cc:2243] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.534251 14516 raft_consensus.cc:2272] T c36d0932529945e9a284405282d65321 P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.536708 14516 tablet_replica.cc:333] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.537329 14516 raft_consensus.cc:2243] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.538130 14516 raft_consensus.cc:2272] T 9c6e933897cb4278b93a8cca027153ac P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.540907 14516 tablet_replica.cc:333] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
W20260709 13:09:15.541015 16297 consensus_peers.cc:597] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea -> Peer c1927141dc2540dab644a00fd6843fc6 (127.14.45.3:35499): Couldn't send request to peer c1927141dc2540dab644a00fd6843fc6. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:35499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:15.541584 14516 raft_consensus.cc:2243] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.542514 14516 raft_consensus.cc:2272] T b106b4017dc84b21a7c6f58814593886 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.544855 14516 tablet_replica.cc:333] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.545428 14516 raft_consensus.cc:2243] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.546044 14516 raft_consensus.cc:2272] T 17db433a32844f26aa2fe7c2d4e4bf66 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.548995 14516 tablet_replica.cc:333] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.549960 14516 raft_consensus.cc:2243] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.550479 14516 raft_consensus.cc:2272] T 3cde3f8ed1454b789014048b7d1e4af8 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.552677 14516 tablet_replica.cc:333] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.553229 14516 raft_consensus.cc:2243] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.554191 14516 raft_consensus.cc:2272] T 1dabdbaded914a498e98f6a03182ab7e P 228b1ac5589e48af9bbf6caecd6aeaea [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.556257 14516 tablet_replica.cc:333] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.556810 14516 raft_consensus.cc:2243] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.557623 14516 raft_consensus.cc:2272] T 17999909d8e0416d88f73b762dbb4bd6 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.559828 14516 tablet_replica.cc:333] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.560374 14516 raft_consensus.cc:2243] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.560989 14516 raft_consensus.cc:2272] T dbf56bc1c60545828ec946a02bb6cf8b P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.563179 14516 tablet_replica.cc:333] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.563807 14516 raft_consensus.cc:2243] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.564992 14516 raft_consensus.cc:2272] T d084942b6c014c78b9a4ece4089fb430 P 228b1ac5589e48af9bbf6caecd6aeaea [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.567721 14516 tablet_replica.cc:333] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.568439 14516 raft_consensus.cc:2243] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.569001 14516 raft_consensus.cc:2272] T 000b7a022df94c229b7580329401d5f2 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.571058 14516 tablet_replica.cc:333] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.571573 14516 raft_consensus.cc:2243] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.572502 14516 raft_consensus.cc:2272] T 260cdec1e9ff4f2e92f7db3917710d4c P 228b1ac5589e48af9bbf6caecd6aeaea [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.574487 14516 tablet_replica.cc:333] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.575037 14516 raft_consensus.cc:2243] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.575647 14516 raft_consensus.cc:2272] T a8f5c34f652e44ef80105d4e8021a365 P 228b1ac5589e48af9bbf6caecd6aeaea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.577980 14516 tablet_replica.cc:333] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.578486 14516 raft_consensus.cc:2243] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.578945 14516 raft_consensus.cc:2272] T f3fb28c93eda43e09b6d9552f89d12ba P 228b1ac5589e48af9bbf6caecd6aeaea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.580806 14516 tablet_replica.cc:333] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.581455 14516 raft_consensus.cc:2243] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.582007 14516 raft_consensus.cc:2272] T 5622436c83fb41fa8923df2295b99818 P 228b1ac5589e48af9bbf6caecd6aeaea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.584172 14516 tablet_replica.cc:333] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.584674 14516 raft_consensus.cc:2243] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.585708 14516 raft_consensus.cc:2272] T 8d1d6e542161416d9033cefcbd0c06e3 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.587926 14516 tablet_replica.cc:333] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea: stopping tablet replica
I20260709 13:09:15.588399 14516 raft_consensus.cc:2243] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.589172 14516 raft_consensus.cc:2272] T 7d5a8a31a7e747c69abd21e5dbc2c1d9 P 228b1ac5589e48af9bbf6caecd6aeaea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.860150 14516 tablet_server.cc:196] TabletServer@127.14.45.4:0 shutdown complete.
I20260709 13:09:15.914849 14516 master.cc:562] Master@127.14.45.62:37417 shutting down...
W20260709 13:09:15.948200 15593 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:15.948524 15593 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:15.948760 15593 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:22.819932 15529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.4:41485: connect: Connection refused (error 111) [suppressed 470 similar messages]
W20260709 13:09:22.824132 15529 catalog_manager.cc:4755] TS 228b1ac5589e48af9bbf6caecd6aeaea (127.14.45.4:41485): ChangeConfig:REMOVE_PEER RPC failed for tablet 3d1a63ae20354b95b7bd0e7365b598f8: Network error: Client connection negotiation failed: client connection to 127.14.45.4:41485: connect: Connection refused (error 111)
I20260709 13:09:22.941471 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.942745 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.943161 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 309d6534a0164bf3ab5f6a8a7f6a5a65: stopping tablet replica
I20260709 13:09:23.172379 14516 master.cc:584] Master@127.14.45.62:37417 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (244841 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:23.290544 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:40477
I20260709 13:09:23.291764 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:23.298411 23198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.298434 23197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.299299 23200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.300395 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:23.303625 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:23.303833 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:23.303946 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602563303935 us; error 0 us; skew 500 ppm
I20260709 13:09:23.304420 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:23.307147 14516 webserver.cc:533] Webserver started at http://127.14.45.62:43219/ using document root <none> and password file <none>
I20260709 13:09:23.307626 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:23.307778 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:23.308002 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:23.309203 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "439eda8ff54f43dcb293d9a9d1d81d89"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.314110 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:09:23.318208 23205 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.319080 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:09:23.319461 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "439eda8ff54f43dcb293d9a9d1d81d89"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.319742 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:23.346562 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:23.347877 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:23.389695 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:40477
I20260709 13:09:23.389945 23256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:40477 every 8 connection(s)
I20260709 13:09:23.394018 23257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.406157 23257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89: Bootstrap starting.
I20260709 13:09:23.411280 23257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:23.415946 23257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89: No bootstrap required, opened a new log
I20260709 13:09:23.418291 23257 raft_consensus.cc:359] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" member_type: VOTER }
I20260709 13:09:23.418766 23257 raft_consensus.cc:385] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:23.419049 23257 raft_consensus.cc:740] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 439eda8ff54f43dcb293d9a9d1d81d89, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.419716 23257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" member_type: VOTER }
I20260709 13:09:23.420209 23257 raft_consensus.cc:399] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:23.420444 23257 raft_consensus.cc:493] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:23.420735 23257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:23.425797 23257 raft_consensus.cc:515] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" member_type: VOTER }
I20260709 13:09:23.426373 23257 leader_election.cc:304] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 439eda8ff54f43dcb293d9a9d1d81d89; no voters: 
I20260709 13:09:23.427624 23257 leader_election.cc:290] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:23.428032 23260 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:23.429458 23260 raft_consensus.cc:697] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 1 LEADER]: Becoming Leader. State: Replica: 439eda8ff54f43dcb293d9a9d1d81d89, State: Running, Role: LEADER
I20260709 13:09:23.430226 23260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" member_type: VOTER }
I20260709 13:09:23.430683 23257 sys_catalog.cc:565] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:23.437675 23262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 439eda8ff54f43dcb293d9a9d1d81d89. Latest consensus state: current_term: 1 leader_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" member_type: VOTER } }
I20260709 13:09:23.438766 23262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:23.437947 23261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "439eda8ff54f43dcb293d9a9d1d81d89" member_type: VOTER } }
I20260709 13:09:23.440207 23261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:23.441960 23270 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:23.450156 23270 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:23.451401 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:23.459823 23270 catalog_manager.cc:1383] Generated new cluster ID: 382150d73b81469e928857cc540953c1
I20260709 13:09:23.460134 23270 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:23.493360 23270 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:23.495319 23270 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:23.512996 23270 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89: Generated new TSK 0
I20260709 13:09:23.513585 23270 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:23.519011 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:23.528446 23278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.529361 23279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.534174 23281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.534471 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:23.537166 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:23.537434 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:23.537635 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602563537611 us; error 0 us; skew 500 ppm
I20260709 13:09:23.538302 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:23.540956 14516 webserver.cc:533] Webserver started at http://127.14.45.1:40459/ using document root <none> and password file <none>
I20260709 13:09:23.541460 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:23.541683 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:23.542061 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:23.543334 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "9dd2728dca8a44f79946d0da19b32c53"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.548251 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:23.552418 23286 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.553259 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:23.553587 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "9dd2728dca8a44f79946d0da19b32c53"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.553959 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:23.577374 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:23.578656 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:23.580310 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:23.583014 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:23.583281 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.583741 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:23.584017 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.633086 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:39473
I20260709 13:09:23.633206 23348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:39473 every 8 connection(s)
I20260709 13:09:23.638502 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:23.647212 23353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.648000 23354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.651014 23356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.653851 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:23.654680 23349 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40477
I20260709 13:09:23.655141 23349 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:23.656095 23349 heartbeater.cc:507] Master 127.14.45.62:40477 requested a full tablet report, sending...
I20260709 13:09:23.656513 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:23.656826 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:23.657037 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602563656999 us; error 0 us; skew 500 ppm
I20260709 13:09:23.657893 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:23.658753 23222 ts_manager.cc:194] Registered new tserver with Master: 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:23.660642 14516 webserver.cc:533] Webserver started at http://127.14.45.2:43351/ using document root <none> and password file <none>
I20260709 13:09:23.660997 23222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55834
I20260709 13:09:23.661140 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:23.661369 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:23.661605 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:23.663231 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "5227af10b4e44d23b9afdeff9f43a849"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.668404 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:23.672394 23361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.673273 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:09:23.673679 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "5227af10b4e44d23b9afdeff9f43a849"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.674105 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:23.688271 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:23.689581 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:23.691274 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:23.693562 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:23.693804 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.694013 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:23.694139 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.739176 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:34005
I20260709 13:09:23.739301 23423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:34005 every 8 connection(s)
I20260709 13:09:23.744400 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:23.752682 23427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.754905 23428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.756157 23430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.757927 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:23.759414 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:23.759719 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:23.759941 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602563759894 us; error 0 us; skew 500 ppm
I20260709 13:09:23.760494 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:23.760807 23424 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40477
I20260709 13:09:23.761291 23424 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:23.762293 23424 heartbeater.cc:507] Master 127.14.45.62:40477 requested a full tablet report, sending...
I20260709 13:09:23.763345 14516 webserver.cc:533] Webserver started at http://127.14.45.3:41473/ using document root <none> and password file <none>
I20260709 13:09:23.763970 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:23.764199 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:23.764458 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:23.764772 23222 ts_manager.cc:194] Registered new tserver with Master: 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:23.765664 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "83a33b9d895a442287d4b46856f57a60"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.766506 23222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55850
I20260709 13:09:23.770821 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:09:23.774575 23435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.775425 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:09:23.775749 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "83a33b9d895a442287d4b46856f57a60"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.776064 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:23.800480 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:23.801812 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:23.803318 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:23.805639 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:23.805943 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.806209 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:23.806396 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.851649 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:43233
I20260709 13:09:23.851763 23497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:43233 every 8 connection(s)
I20260709 13:09:23.857174 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:23.864677 23501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.867290 23502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.868187 14516 server_base.cc:1061] running on GCE node
W20260709 13:09:23.869587 23504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.870488 23498 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40477
I20260709 13:09:23.870802 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:23.870952 23498 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:23.871119 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:23.871359 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602563871342 us; error 0 us; skew 500 ppm
I20260709 13:09:23.871975 23498 heartbeater.cc:507] Master 127.14.45.62:40477 requested a full tablet report, sending...
I20260709 13:09:23.872236 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:23.874686 23222 ts_manager.cc:194] Registered new tserver with Master: 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:23.876312 23222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55866
I20260709 13:09:23.877458 14516 webserver.cc:533] Webserver started at http://127.14.45.4:44817/ using document root <none> and password file <none>
I20260709 13:09:23.878162 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:23.878365 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:23.878659 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:23.879868 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-3-root/instance:
uuid: "a1265f7d704d41df83adf9f1c74d3f03"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.884473 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:23.888392 23509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.889281 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:23.889613 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-3-root
uuid: "a1265f7d704d41df83adf9f1c74d3f03"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:23.890010 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:23.911342 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:23.912796 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:23.914592 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:23.916873 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:23.917114 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.917472 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:23.917677 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.965688 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.4:43503
I20260709 13:09:23.965863 23571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.4:43503 every 8 connection(s)
I20260709 13:09:23.983513 23572 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40477
I20260709 13:09:23.983976 23572 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:23.984740 23572 heartbeater.cc:507] Master 127.14.45.62:40477 requested a full tablet report, sending...
I20260709 13:09:23.987005 23222 ts_manager.cc:194] Registered new tserver with Master: a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:23.987789 14516 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018134771s
I20260709 13:09:23.988705 23222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55872
I20260709 13:09:24.021457 23222 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55886:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:24.262792 23313 tablet_service.cc:1511] Processing CreateTablet for tablet 589fc62a51cd40c78df360b93832f36a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:24.264361 23313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589fc62a51cd40c78df360b93832f36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.266896 23312 tablet_service.cc:1511] Processing CreateTablet for tablet ebdeb4d212974dcf9c19753ad30b5034 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:24.268366 23312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebdeb4d212974dcf9c19753ad30b5034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.271162 23311 tablet_service.cc:1511] Processing CreateTablet for tablet 4d423ffa47984e5e9d46f998841ff374 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:24.272572 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d423ffa47984e5e9d46f998841ff374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.275017 23314 tablet_service.cc:1511] Processing CreateTablet for tablet 4706da1890fc4ca585d0a3450848f462 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:24.277238 23310 tablet_service.cc:1511] Processing CreateTablet for tablet cbf2dfc5cf4b48f69167416ab3bf4cb1 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:24.278378 23314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4706da1890fc4ca585d0a3450848f462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.279603 23310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf2dfc5cf4b48f69167416ab3bf4cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.282080 23389 tablet_service.cc:1511] Processing CreateTablet for tablet 4706da1890fc4ca585d0a3450848f462 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:24.283671 23389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4706da1890fc4ca585d0a3450848f462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.284194 23385 tablet_service.cc:1511] Processing CreateTablet for tablet cbf2dfc5cf4b48f69167416ab3bf4cb1 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:24.285856 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf2dfc5cf4b48f69167416ab3bf4cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.286094 23537 tablet_service.cc:1511] Processing CreateTablet for tablet 4706da1890fc4ca585d0a3450848f462 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:24.287009 23388 tablet_service.cc:1511] Processing CreateTablet for tablet 589fc62a51cd40c78df360b93832f36a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:24.287714 23537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4706da1890fc4ca585d0a3450848f462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.288748 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589fc62a51cd40c78df360b93832f36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.291252 23387 tablet_service.cc:1511] Processing CreateTablet for tablet 47e39de0746842d2b01a51bd445a746b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:24.293012 23387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e39de0746842d2b01a51bd445a746b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.296310 23384 tablet_service.cc:1511] Processing CreateTablet for tablet cd4f6dbbb32a4bb29cae9c9baf87c65b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:24.299062 23309 tablet_service.cc:1511] Processing CreateTablet for tablet fa37604736d74fe9ab5b98ecb52b2d83 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:24.301142 23308 tablet_service.cc:1511] Processing CreateTablet for tablet fa22c116262947f39fbe06c006be0cf3 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:24.303386 23384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4f6dbbb32a4bb29cae9c9baf87c65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.294744 23386 tablet_service.cc:1511] Processing CreateTablet for tablet 4d423ffa47984e5e9d46f998841ff374 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:24.306067 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d423ffa47984e5e9d46f998841ff374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.308485 23536 tablet_service.cc:1511] Processing CreateTablet for tablet ebdeb4d212974dcf9c19753ad30b5034 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:24.309929 23536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebdeb4d212974dcf9c19753ad30b5034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.310300 23533 tablet_service.cc:1511] Processing CreateTablet for tablet fa37604736d74fe9ab5b98ecb52b2d83 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:24.311980 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa37604736d74fe9ab5b98ecb52b2d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.312162 23532 tablet_service.cc:1511] Processing CreateTablet for tablet cd4f6dbbb32a4bb29cae9c9baf87c65b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:24.313647 23532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4f6dbbb32a4bb29cae9c9baf87c65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.310302 23309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa37604736d74fe9ab5b98ecb52b2d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.315025 23535 tablet_service.cc:1511] Processing CreateTablet for tablet 47e39de0746842d2b01a51bd445a746b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:24.316164 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa22c116262947f39fbe06c006be0cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.316601 23535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e39de0746842d2b01a51bd445a746b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.319648 23534 tablet_service.cc:1511] Processing CreateTablet for tablet cbf2dfc5cf4b48f69167416ab3bf4cb1 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:24.321148 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf2dfc5cf4b48f69167416ab3bf4cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.324221 23383 tablet_service.cc:1511] Processing CreateTablet for tablet fa22c116262947f39fbe06c006be0cf3 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:24.324620 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 891d07a8dc184d778dc815912cccc1ca (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:24.326478 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891d07a8dc184d778dc815912cccc1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.327342 23463 tablet_service.cc:1511] Processing CreateTablet for tablet 589fc62a51cd40c78df360b93832f36a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:24.329432 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589fc62a51cd40c78df360b93832f36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.331552 23462 tablet_service.cc:1511] Processing CreateTablet for tablet ebdeb4d212974dcf9c19753ad30b5034 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:24.334981 23382 tablet_service.cc:1511] Processing CreateTablet for tablet 891d07a8dc184d778dc815912cccc1ca (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:24.340325 23307 tablet_service.cc:1511] Processing CreateTablet for tablet 891d07a8dc184d778dc815912cccc1ca (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:24.342324 23383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa22c116262947f39fbe06c006be0cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.344077 23307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891d07a8dc184d778dc815912cccc1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.345852 23382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891d07a8dc184d778dc815912cccc1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.348137 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebdeb4d212974dcf9c19753ad30b5034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.368695 23530 tablet_service.cc:1511] Processing CreateTablet for tablet 92aecea6ace44d388502b338a5f8bdea (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:24.370416 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aecea6ace44d388502b338a5f8bdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.387606 23461 tablet_service.cc:1511] Processing CreateTablet for tablet 47e39de0746842d2b01a51bd445a746b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:24.389145 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e39de0746842d2b01a51bd445a746b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.394642 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 92aecea6ace44d388502b338a5f8bdea (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:24.395593 23460 tablet_service.cc:1511] Processing CreateTablet for tablet 4d423ffa47984e5e9d46f998841ff374 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:24.396394 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aecea6ace44d388502b338a5f8bdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.397116 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d423ffa47984e5e9d46f998841ff374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.407677 23459 tablet_service.cc:1511] Processing CreateTablet for tablet fa37604736d74fe9ab5b98ecb52b2d83 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:24.409504 23459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa37604736d74fe9ab5b98ecb52b2d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.411098 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 0623e04a00fb4ef7bf47ed03410a5049 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:24.418706 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0623e04a00fb4ef7bf47ed03410a5049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.435047 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 0623e04a00fb4ef7bf47ed03410a5049 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:24.436080 23305 tablet_service.cc:1511] Processing CreateTablet for tablet f479efbeb6ad48938ed367d2bd50c494 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:24.436517 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0623e04a00fb4ef7bf47ed03410a5049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.437512 23305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479efbeb6ad48938ed367d2bd50c494. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:24.443908 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:24.457855 23385 tablet_service.cc:1511] Processing CreateTablet for tablet f479efbeb6ad48938ed367d2bd50c494 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:24.459267 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479efbeb6ad48938ed367d2bd50c494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.462510 23380 tablet_service.cc:1511] Processing CreateTablet for tablet 80dfcecaa22e4ea58c57fcee6c5ec966 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:24.463973 23380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dfcecaa22e4ea58c57fcee6c5ec966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.484766 23592 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:24.494599 23458 tablet_service.cc:1511] Processing CreateTablet for tablet cd4f6dbbb32a4bb29cae9c9baf87c65b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:24.496207 23458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4f6dbbb32a4bb29cae9c9baf87c65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.498901 23593 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:24.500837 23592 tablet_bootstrap.cc:654] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.521998 23530 tablet_service.cc:1511] Processing CreateTablet for tablet 80dfcecaa22e4ea58c57fcee6c5ec966 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:24.523469 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dfcecaa22e4ea58c57fcee6c5ec966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.530440 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 50034ac82496425fac0be0a983f3fdc9 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:24.532552 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50034ac82496425fac0be0a983f3fdc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.538950 23594 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:24.540185 23309 tablet_service.cc:1511] Processing CreateTablet for tablet 80dfcecaa22e4ea58c57fcee6c5ec966 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:24.541566 23309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dfcecaa22e4ea58c57fcee6c5ec966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.560194 23457 tablet_service.cc:1511] Processing CreateTablet for tablet 0623e04a00fb4ef7bf47ed03410a5049 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:24.560470 23308 tablet_service.cc:1511] Processing CreateTablet for tablet 50034ac82496425fac0be0a983f3fdc9 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:24.561064 23463 tablet_service.cc:1511] Processing CreateTablet for tablet fa22c116262947f39fbe06c006be0cf3 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:24.561731 23457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0623e04a00fb4ef7bf47ed03410a5049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.561900 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50034ac82496425fac0be0a983f3fdc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.566104 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa22c116262947f39fbe06c006be0cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.567308 23456 tablet_service.cc:1511] Processing CreateTablet for tablet f479efbeb6ad48938ed367d2bd50c494 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:24.569198 23456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479efbeb6ad48938ed367d2bd50c494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.571342 23455 tablet_service.cc:1511] Processing CreateTablet for tablet 50034ac82496425fac0be0a983f3fdc9 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:24.578755 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50034ac82496425fac0be0a983f3fdc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.579485 23593 tablet_bootstrap.cc:654] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.560096 23462 tablet_service.cc:1511] Processing CreateTablet for tablet 92aecea6ace44d388502b338a5f8bdea (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:24.586565 23533 tablet_service.cc:1511] Processing CreateTablet for tablet c85f3ba70a274480909cc569cf8886b2 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:24.589712 23461 tablet_service.cc:1511] Processing CreateTablet for tablet c85f3ba70a274480909cc569cf8886b2 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:24.592427 23388 tablet_service.cc:1511] Processing CreateTablet for tablet c85f3ba70a274480909cc569cf8886b2 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:24.602600 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3ba70a274480909cc569cf8886b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.602954 23385 tablet_service.cc:1511] Processing CreateTablet for tablet c1736a3967424f8982475f4c769a395d (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:24.604341 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1736a3967424f8982475f4c769a395d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.600767 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3ba70a274480909cc569cf8886b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.601555 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aecea6ace44d388502b338a5f8bdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.611866 23594 tablet_bootstrap.cc:654] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.614934 23306 tablet_service.cc:1511] Processing CreateTablet for tablet c1736a3967424f8982475f4c769a395d (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:24.616402 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1736a3967424f8982475f4c769a395d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.626066 23460 tablet_service.cc:1511] Processing CreateTablet for tablet c1736a3967424f8982475f4c769a395d (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:24.627669 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1736a3967424f8982475f4c769a395d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.629887 23530 tablet_service.cc:1511] Processing CreateTablet for tablet a3fb88e4ccef4a92b6d7370ff8456d98 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:24.631373 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fb88e4ccef4a92b6d7370ff8456d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.631510 23381 tablet_service.cc:1511] Processing CreateTablet for tablet a3fb88e4ccef4a92b6d7370ff8456d98 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:24.633158 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fb88e4ccef4a92b6d7370ff8456d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.632263 23311 tablet_service.cc:1511] Processing CreateTablet for tablet a3fb88e4ccef4a92b6d7370ff8456d98 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:24.641162 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fb88e4ccef4a92b6d7370ff8456d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.653474 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3ba70a274480909cc569cf8886b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.661669 23592 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:24.662420 23592 ts_tablet_manager.cc:1403] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.178s	user 0.007s	sys 0.014s
I20260709 13:09:24.664315 23349 heartbeater.cc:499] Master 127.14.45.62:40477 was elected leader, sending a full tablet report...
I20260709 13:09:24.666209 23592 raft_consensus.cc:359] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.667274 23592 raft_consensus.cc:385] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.682519 23592 raft_consensus.cc:740] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.671202 23595 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:24.655112 23463 tablet_service.cc:1511] Processing CreateTablet for tablet c94a184780fd46dbab2854fb725ca574 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:24.683255 23385 tablet_service.cc:1511] Processing CreateTablet for tablet 1d125c0c59b849edb09535466ab6ffba (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:24.683600 23592 consensus_queue.cc:260] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.680510 23308 tablet_service.cc:1511] Processing CreateTablet for tablet c94a184780fd46dbab2854fb725ca574 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:24.680580 23530 tablet_service.cc:1511] Processing CreateTablet for tablet c94a184780fd46dbab2854fb725ca574 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:24.684442 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94a184780fd46dbab2854fb725ca574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.675698 23455 tablet_service.cc:1511] Processing CreateTablet for tablet 1d125c0c59b849edb09535466ab6ffba (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:24.685019 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d125c0c59b849edb09535466ab6ffba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.701326 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94a184780fd46dbab2854fb725ca574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.702584 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d125c0c59b849edb09535466ab6ffba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.703336 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94a184780fd46dbab2854fb725ca574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.715780 23595 tablet_bootstrap.cc:654] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.720845 23594 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:24.729154 23594 ts_tablet_manager.cc:1403] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.191s	user 0.010s	sys 0.010s
I20260709 13:09:24.735019 23593 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:24.735571 23593 ts_tablet_manager.cc:1403] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.237s	user 0.022s	sys 0.011s
I20260709 13:09:24.739763 23593 raft_consensus.cc:359] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.740559 23593 raft_consensus.cc:385] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.740849 23593 raft_consensus.cc:740] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.743904 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 1d125c0c59b849edb09535466ab6ffba (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:24.745446 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d125c0c59b849edb09535466ab6ffba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.736809 23594 raft_consensus.cc:359] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:24.745911 23594 raft_consensus.cc:385] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.746236 23594 raft_consensus.cc:740] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.746996 23594 consensus_queue.cc:260] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:24.751700 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 52ab658aedf74a66805c779a3eb85bbc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:24.753111 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ab658aedf74a66805c779a3eb85bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.766417 23594 ts_tablet_manager.cc:1434] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.008s
I20260709 13:09:24.767673 23594 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:24.769389 23424 heartbeater.cc:499] Master 127.14.45.62:40477 was elected leader, sending a full tablet report...
I20260709 13:09:24.776157 23572 heartbeater.cc:499] Master 127.14.45.62:40477 was elected leader, sending a full tablet report...
I20260709 13:09:24.763198 23593 consensus_queue.cc:260] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.790340 23461 tablet_service.cc:1511] Processing CreateTablet for tablet 52ab658aedf74a66805c779a3eb85bbc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:24.792246 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ab658aedf74a66805c779a3eb85bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.794896 23595 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:24.795444 23595 ts_tablet_manager.cc:1403] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.125s	user 0.008s	sys 0.014s
I20260709 13:09:24.797411 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 52ab658aedf74a66805c779a3eb85bbc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:24.798836 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ab658aedf74a66805c779a3eb85bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.798300 23530 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5978f4bba84a18982e38633bc2b626 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:24.802390 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5978f4bba84a18982e38633bc2b626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.810667 23595 raft_consensus.cc:359] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:24.816033 23594 tablet_bootstrap.cc:654] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.818086 23595 raft_consensus.cc:385] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.818449 23595 raft_consensus.cc:740] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.819262 23592 ts_tablet_manager.cc:1434] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.156s	user 0.018s	sys 0.009s
I20260709 13:09:24.819463 23595 consensus_queue.cc:260] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:24.821209 23593 ts_tablet_manager.cc:1434] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.085s	user 0.012s	sys 0.008s
I20260709 13:09:24.823038 23593 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:24.823686 23592 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:24.827672 23311 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5978f4bba84a18982e38633bc2b626 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:24.830651 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5978f4bba84a18982e38633bc2b626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.836391 23592 tablet_bootstrap.cc:654] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.839620 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5978f4bba84a18982e38633bc2b626 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:24.843779 23455 tablet_service.cc:1511] Processing CreateTablet for tablet 69488a80b90e4fecb290b1a4249ea436 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:24.851542 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5978f4bba84a18982e38633bc2b626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.851992 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69488a80b90e4fecb290b1a4249ea436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.854036 23498 heartbeater.cc:499] Master 127.14.45.62:40477 was elected leader, sending a full tablet report...
I20260709 13:09:24.854238 23594 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:24.854952 23594 ts_tablet_manager.cc:1403] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.012s
W20260709 13:09:24.858021 23499 tablet.cc:2406] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:24.858095 23594 raft_consensus.cc:359] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:24.859061 23594 raft_consensus.cc:385] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.859447 23594 raft_consensus.cc:740] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.860422 23594 consensus_queue.cc:260] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:24.862993 23594 ts_tablet_manager.cc:1434] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:24.864149 23594 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:24.872767 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 69488a80b90e4fecb290b1a4249ea436 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:24.874240 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69488a80b90e4fecb290b1a4249ea436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.874344 23308 tablet_service.cc:1511] Processing CreateTablet for tablet 69488a80b90e4fecb290b1a4249ea436 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:24.875653 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69488a80b90e4fecb290b1a4249ea436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.854004 23595 ts_tablet_manager.cc:1434] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 13:09:24.878640 23594 tablet_bootstrap.cc:654] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.879022 23595 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:24.878665 23461 tablet_service.cc:1511] Processing CreateTablet for tablet ac392ac267824ea8acd63f7b708f1aea (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:24.881346 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac392ac267824ea8acd63f7b708f1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.883488 23385 tablet_service.cc:1511] Processing CreateTablet for tablet ac392ac267824ea8acd63f7b708f1aea (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:24.884812 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac392ac267824ea8acd63f7b708f1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.887463 23592 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:24.888099 23592 ts_tablet_manager.cc:1403] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.001s
I20260709 13:09:24.891490 23592 raft_consensus.cc:359] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.892671 23592 raft_consensus.cc:385] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.893035 23592 raft_consensus.cc:740] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.896773 23592 consensus_queue.cc:260] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.897855 23595 tablet_bootstrap.cc:654] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.899397 23592 ts_tablet_manager.cc:1434] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:24.910348 23530 tablet_service.cc:1511] Processing CreateTablet for tablet ac392ac267824ea8acd63f7b708f1aea (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:24.912846 23308 tablet_service.cc:1511] Processing CreateTablet for tablet c554bef114234298a189605cf26a64d1 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:24.913275 23592 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:24.911989 23381 tablet_service.cc:1511] Processing CreateTablet for tablet c554bef114234298a189605cf26a64d1 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:24.913333 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac392ac267824ea8acd63f7b708f1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.914366 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c554bef114234298a189605cf26a64d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.911162 23595 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:24.915023 23595 ts_tablet_manager.cc:1403] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.004s
I20260709 13:09:24.915467 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c554bef114234298a189605cf26a64d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.921599 23599 raft_consensus.cc:493] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.922325 23599 raft_consensus.cc:515] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.849294 23593 tablet_bootstrap.cc:654] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.936309 23595 raft_consensus.cc:359] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:24.937186 23595 raft_consensus.cc:385] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.937526 23595 raft_consensus.cc:740] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.938352 23595 consensus_queue.cc:260] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:24.940382 23460 tablet_service.cc:1511] Processing CreateTablet for tablet c554bef114234298a189605cf26a64d1 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:24.943397 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c554bef114234298a189605cf26a64d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.944365 23533 tablet_service.cc:1511] Processing CreateTablet for tablet c3539d30340348c89b32e10d26f060a7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:24.945067 23311 tablet_service.cc:1511] Processing CreateTablet for tablet c3539d30340348c89b32e10d26f060a7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:24.946376 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3539d30340348c89b32e10d26f060a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.950590 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3539d30340348c89b32e10d26f060a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.956848 23599 leader_election.cc:290] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:24.958796 23600 raft_consensus.cc:493] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.959355 23600 raft_consensus.cc:515] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:24.964278 23600 leader_election.cc:290] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:24.938095 23592 tablet_bootstrap.cc:654] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.982381 23388 tablet_service.cc:1511] Processing CreateTablet for tablet c3539d30340348c89b32e10d26f060a7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:24.984457 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3539d30340348c89b32e10d26f060a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.985654 23594 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:24.986307 23594 ts_tablet_manager.cc:1403] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.023s
I20260709 13:09:24.987689 23595 ts_tablet_manager.cc:1434] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.072s	user 0.011s	sys 0.003s
I20260709 13:09:24.988799 23595 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:24.989992 23594 raft_consensus.cc:359] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.990548 23599 raft_consensus.cc:493] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.990942 23594 raft_consensus.cc:385] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.991554 23594 raft_consensus.cc:740] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.991417 23599 raft_consensus.cc:515] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:24.998479 23455 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee83cf672964ae8875b8899f5c8a0b8 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:24.999881 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee83cf672964ae8875b8899f5c8a0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.000661 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee83cf672964ae8875b8899f5c8a0b8 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:25.001971 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee83cf672964ae8875b8899f5c8a0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.003011 23599 leader_election.cc:290] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.006013 23594 consensus_queue.cc:260] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.008481 23594 ts_tablet_manager.cc:1434] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:09:25.009519 23594 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:25.016511 23594 tablet_bootstrap.cc:654] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.026705 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee83cf672964ae8875b8899f5c8a0b8 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:25.033363 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee83cf672964ae8875b8899f5c8a0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.034364 23386 tablet_service.cc:1511] Processing CreateTablet for tablet 470aca24cb8b4480a3395752f86d1a92 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:25.036484 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470aca24cb8b4480a3395752f86d1a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.040315 23460 tablet_service.cc:1511] Processing CreateTablet for tablet 470aca24cb8b4480a3395752f86d1a92 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:25.041836 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470aca24cb8b4480a3395752f86d1a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.041714 23534 tablet_service.cc:1511] Processing CreateTablet for tablet 470aca24cb8b4480a3395752f86d1a92 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:25.043465 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470aca24cb8b4480a3395752f86d1a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.062110 23600 raft_consensus.cc:493] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.062770 23600 raft_consensus.cc:515] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:25.063138 23312 tablet_service.cc:1511] Processing CreateTablet for tablet 09c3dcd176fe419db880690b124927e7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:25.064666 23312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c3dcd176fe419db880690b124927e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.065004 23600 leader_election.cc:290] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:25.083173 23593 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:25.082959 23384 tablet_service.cc:1511] Processing CreateTablet for tablet 09c3dcd176fe419db880690b124927e7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:25.083993 23593 ts_tablet_manager.cc:1403] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.261s	user 0.010s	sys 0.016s
I20260709 13:09:25.084589 23384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c3dcd176fe419db880690b124927e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.086067 23603 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.086637 23603 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:25.099884 23600 raft_consensus.cc:493] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.100478 23600 raft_consensus.cc:515] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.100705 23461 tablet_service.cc:1511] Processing CreateTablet for tablet 09c3dcd176fe419db880690b124927e7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:25.101352 23603 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.102344 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c3dcd176fe419db880690b124927e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.102952 23600 leader_election.cc:290] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.102397 23593 raft_consensus.cc:359] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.106007 23593 raft_consensus.cc:385] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.129921 23593 raft_consensus.cc:740] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.130975 23593 consensus_queue.cc:260] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.120355 23533 tablet_service.cc:1511] Processing CreateTablet for tablet 70646f6eebd7451ab1f6c4030b732600 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:25.116652 23595 tablet_bootstrap.cc:654] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.153301 23593 ts_tablet_manager.cc:1434] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 13:09:25.154744 23603 raft_consensus.cc:493] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.162073 23603 raft_consensus.cc:515] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:25.166699 23308 tablet_service.cc:1511] Processing CreateTablet for tablet 70646f6eebd7451ab1f6c4030b732600 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:25.166936 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:25.168275 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70646f6eebd7451ab1f6c4030b732600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.176133 23386 tablet_service.cc:1511] Processing CreateTablet for tablet 70646f6eebd7451ab1f6c4030b732600 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:25.178730 23603 leader_election.cc:290] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:25.165305 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:25.182212 23602 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.182410 23290 leader_election.cc:343] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.167531 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70646f6eebd7451ab1f6c4030b732600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.182898 23602 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.184190 23455 tablet_service.cc:1511] Processing CreateTablet for tablet e5f5676b2fdd452da0db90b31878da8b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:25.185688 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f5676b2fdd452da0db90b31878da8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.196825 23463 tablet_service.cc:1511] Processing CreateTablet for tablet ae12c02cddd142b3b1a089058861d718 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:25.203243 23592 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:25.203871 23592 ts_tablet_manager.cc:1403] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.291s	user 0.025s	sys 0.012s
I20260709 13:09:25.203675 23531 tablet_service.cc:1511] Processing CreateTablet for tablet e5f5676b2fdd452da0db90b31878da8b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:25.205045 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f5676b2fdd452da0db90b31878da8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.212189 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12c02cddd142b3b1a089058861d718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.219239 23311 tablet_service.cc:1511] Processing CreateTablet for tablet e5f5676b2fdd452da0db90b31878da8b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:25.220654 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f5676b2fdd452da0db90b31878da8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.220332 23537 tablet_service.cc:1511] Processing CreateTablet for tablet ae12c02cddd142b3b1a089058861d718 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:25.220963 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:25.221611 23537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12c02cddd142b3b1a089058861d718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.222640 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:25.203868 23290 leader_election.cc:343] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:25.236128 23288 leader_election.cc:343] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.230026 23602 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:25.237959 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70646f6eebd7451ab1f6c4030b732600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.237560 23593 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
W20260709 13:09:25.242244 23288 leader_election.cc:343] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.243902 23288 leader_election.cc:304] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:25.244804 23592 raft_consensus.cc:359] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:25.245460 23600 raft_consensus.cc:2749] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.245826 23592 raft_consensus.cc:385] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.246331 23592 raft_consensus.cc:740] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.247310 23592 consensus_queue.cc:260] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:25.249558 23592 ts_tablet_manager.cc:1434] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:09:25.250702 23592 tablet_bootstrap.cc:492] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:25.250490 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891d07a8dc184d778dc815912cccc1ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:25.251646 23310 tablet_service.cc:1511] Processing CreateTablet for tablet 079d6319916749068ce3850998ab923a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:25.252969 23310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079d6319916749068ce3850998ab923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.253329 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:25.254796 23511 leader_election.cc:343] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.267089 23592 tablet_bootstrap.cc:654] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:25.274219 23511 leader_election.cc:343] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.281173 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdeb4d212974dcf9c19753ad30b5034" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:25.282575 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:25.284332 23437 leader_election.cc:343] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:25.285040 23437 leader_election.cc:343] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.292184 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891d07a8dc184d778dc815912cccc1ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:25.292546 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:25.292913 23399 raft_consensus.cc:2468] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
W20260709 13:09:25.293953 23511 leader_election.cc:343] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.294502 23511 leader_election.cc:304] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:25.296227 23511 leader_election.cc:304] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:25.299476 23594 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:25.297581 23599 raft_consensus.cc:2749] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.300171 23594 ts_tablet_manager.cc:1403] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.291s	user 0.019s	sys 0.036s
I20260709 13:09:25.300426 23599 raft_consensus.cc:2804] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:25.300951 23599 raft_consensus.cc:493] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.301335 23599 raft_consensus.cc:3060] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.303424 23594 raft_consensus.cc:359] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.304208 23594 raft_consensus.cc:385] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.304497 23594 raft_consensus.cc:740] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.305365 23594 consensus_queue.cc:260] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.307644 23594 ts_tablet_manager.cc:1434] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:25.308706 23594 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:25.318977 23209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 71400.8us
I20260709 13:09:25.330505 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:25.334336 23388 tablet_service.cc:1511] Processing CreateTablet for tablet ae12c02cddd142b3b1a089058861d718 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:25.334713 23461 tablet_service.cc:1511] Processing CreateTablet for tablet 079d6319916749068ce3850998ab923a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:25.335788 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12c02cddd142b3b1a089058861d718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.336697 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079d6319916749068ce3850998ab923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.352480 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 079d6319916749068ce3850998ab923a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:25.359963 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079d6319916749068ce3850998ab923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.360958 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 06c8577f61a841c0aa2491920a13d1af (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:25.360962 23534 tablet_service.cc:1511] Processing CreateTablet for tablet 06c8577f61a841c0aa2491920a13d1af (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:25.362679 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c8577f61a841c0aa2491920a13d1af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.362668 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c8577f61a841c0aa2491920a13d1af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.366045 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 69930.4us
I20260709 13:09:25.370962 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:25.372380 23437 leader_election.cc:343] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.372895 23437 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:25.372757 23599 raft_consensus.cc:515] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.374189 23603 raft_consensus.cc:2749] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.375814 23460 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad4e8b8f5534f638a4422cd5668b846 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:25.377444 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad4e8b8f5534f638a4422cd5668b846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.383656 23386 tablet_service.cc:1511] Processing CreateTablet for tablet 06c8577f61a841c0aa2491920a13d1af (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:25.385185 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c8577f61a841c0aa2491920a13d1af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.389089 23462 tablet_service.cc:1511] Processing CreateTablet for tablet aaeb4174b82c42e79bc78ce12a770d8e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:25.390676 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeb4174b82c42e79bc78ce12a770d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.391436 23595 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:25.391976 23595 ts_tablet_manager.cc:1403] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.403s	user 0.014s	sys 0.007s
W20260709 13:09:25.396975 23288 leader_election.cc:343] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.394066 23600 raft_consensus.cc:493] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.397981 23312 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad4e8b8f5534f638a4422cd5668b846 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:25.398496 23594 tablet_bootstrap.cc:654] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.398252 23600 raft_consensus.cc:515] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.399423 23312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad4e8b8f5534f638a4422cd5668b846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.395932 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:25.397531 23288 leader_election.cc:304] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:25.407727 23384 tablet_service.cc:1511] Processing CreateTablet for tablet aaeb4174b82c42e79bc78ce12a770d8e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:25.417598 23384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeb4174b82c42e79bc78ce12a770d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.400687 23600 leader_election.cc:290] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.417848 23537 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad4e8b8f5534f638a4422cd5668b846 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:25.418825 23600 raft_consensus.cc:2749] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.421553 23592 tablet_bootstrap.cc:492] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:25.422143 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:25.422344 23592 ts_tablet_manager.cc:1403] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.022s
W20260709 13:09:25.424350 23363 leader_election.cc:343] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.428282 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:25.431140 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdeb4d212974dcf9c19753ad30b5034" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:25.428421 23531 tablet_service.cc:1511] Processing CreateTablet for tablet aaeb4174b82c42e79bc78ce12a770d8e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:25.433485 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeb4174b82c42e79bc78ce12a770d8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.434049 23363 leader_election.cc:343] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.434549 23363 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:25.435395 23602 raft_consensus.cc:2749] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.436165 23599 leader_election.cc:290] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.437515 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891d07a8dc184d778dc815912cccc1ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:25.438166 23399 raft_consensus.cc:3060] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.438756 23537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad4e8b8f5534f638a4422cd5668b846. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.439675 23437 leader_election.cc:343] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.440207 23437 leader_election.cc:304] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:25.440816 23595 raft_consensus.cc:359] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.441339 23603 raft_consensus.cc:2749] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.441569 23595 raft_consensus.cc:385] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.442602 23592 raft_consensus.cc:359] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
W20260709 13:09:25.446731 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:25.448877 23399 raft_consensus.cc:2468] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:25.456544 23592 raft_consensus.cc:385] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.454283 23595 raft_consensus.cc:740] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.463761 23511 leader_election.cc:304] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:25.464214 23592 raft_consensus.cc:740] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.475134 23595 consensus_queue.cc:260] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.470211 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891d07a8dc184d778dc815912cccc1ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:25.476398 23599 raft_consensus.cc:2804] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:25.472297 23593 tablet_bootstrap.cc:654] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.476936 23599 raft_consensus.cc:697] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:25.475310 23592 consensus_queue.cc:260] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:25.467945 23308 tablet_service.cc:1511] Processing CreateTablet for tablet c16aa3c6fc924654b9a831ea21ada64d (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:25.478878 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16aa3c6fc924654b9a831ea21ada64d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.479564 23511 leader_election.cc:343] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.478488 23599 consensus_queue.cc:237] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.482713 23592 ts_tablet_manager.cc:1434] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 13:09:25.483973 23592 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:25.484704 23594 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:25.485210 23594 ts_tablet_manager.cc:1403] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.177s	user 0.008s	sys 0.004s
W20260709 13:09:25.458398 23288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 61465.8us
W20260709 13:09:25.495678 23288 leader_election.cc:343] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.496191 23288 leader_election.cc:304] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:25.496752 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:25.496949 23463 tablet_service.cc:1511] Processing CreateTablet for tablet c16aa3c6fc924654b9a831ea21ada64d (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:25.497831 23547 raft_consensus.cc:2468] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:25.499161 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16aa3c6fc924654b9a831ea21ada64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.502518 23632 raft_consensus.cc:2749] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.505191 23288 leader_election.cc:304] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:25.506115 23595 ts_tablet_manager.cc:1434] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:09:25.506543 23632 raft_consensus.cc:2804] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:25.507267 23595 tablet_bootstrap.cc:492] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:25.507184 23632 raft_consensus.cc:493] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.507841 23632 raft_consensus.cc:3060] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.512022 23594 raft_consensus.cc:359] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.512959 23594 raft_consensus.cc:385] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.513343 23594 raft_consensus.cc:740] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.514323 23594 consensus_queue.cc:260] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.522396 23594 ts_tablet_manager.cc:1434] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.003s
I20260709 13:09:25.523602 23594 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:25.527247 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef74de67fbd4b549e342a137de78861 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:25.528777 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef74de67fbd4b549e342a137de78861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.508126 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:25.532735 23595 tablet_bootstrap.cc:654] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:25.534073 23288 leader_election.cc:343] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.550422 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef74de67fbd4b549e342a137de78861 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:25.551002 23595 tablet_bootstrap.cc:492] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:25.551954 23595 ts_tablet_manager.cc:1403] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.005s
I20260709 13:09:25.552487 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef74de67fbd4b549e342a137de78861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.556010 23388 tablet_service.cc:1511] Processing CreateTablet for tablet c16aa3c6fc924654b9a831ea21ada64d (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:25.556988 23462 tablet_service.cc:1511] Processing CreateTablet for tablet 67ec9a7e5d824314a4743271735fab14 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:25.557495 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16aa3c6fc924654b9a831ea21ada64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.558413 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ec9a7e5d824314a4743271735fab14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.551031 23593 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:25.562120 23593 ts_tablet_manager.cc:1403] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.332s	user 0.008s	sys 0.010s
I20260709 13:09:25.564879 23632 raft_consensus.cc:515] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.565783 23592 tablet_bootstrap.cc:654] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.555601 23594 tablet_bootstrap.cc:654] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.568217 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:25.568818 23632 leader_election.cc:290] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.544538 23221 catalog_manager.cc:5697] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.568890 23547 raft_consensus.cc:3060] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.570204 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:25.555495 23595 raft_consensus.cc:359] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:25.565233 23593 raft_consensus.cc:359] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.575392 23593 raft_consensus.cc:385] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.575737 23593 raft_consensus.cc:740] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.576592 23593 consensus_queue.cc:260] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.577486 23399 raft_consensus.cc:3060] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.574883 23595 raft_consensus.cc:385] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.583598 23461 tablet_service.cc:1511] Processing CreateTablet for tablet 270bce0e96a24453b6b35f8451f5c7dc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:25.589877 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270bce0e96a24453b6b35f8451f5c7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.585656 23384 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef74de67fbd4b549e342a137de78861 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:25.594738 23308 tablet_service.cc:1511] Processing CreateTablet for tablet 67ec9a7e5d824314a4743271735fab14 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:25.587953 23547 raft_consensus.cc:2468] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:25.594641 23384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef74de67fbd4b549e342a137de78861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.588137 23399 raft_consensus.cc:2468] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:25.596925 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 67ec9a7e5d824314a4743271735fab14 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:25.598376 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ec9a7e5d824314a4743271735fab14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.600136 23462 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2dc354ec164815b07f203d5b6ddd16 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:25.601541 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2dc354ec164815b07f203d5b6ddd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.604212 23288 leader_election.cc:304] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:25.605257 23632 raft_consensus.cc:2804] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:25.605796 23632 raft_consensus.cc:697] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:25.606732 23593 ts_tablet_manager.cc:1434] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:09:25.606626 23632 consensus_queue.cc:237] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.588801 23595 raft_consensus.cc:740] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.613101 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 270bce0e96a24453b6b35f8451f5c7dc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:25.613888 23455 tablet_service.cc:1511] Processing CreateTablet for tablet 2db51fbc97d3442cba36156e9429af61 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:25.614421 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270bce0e96a24453b6b35f8451f5c7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.615332 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db51fbc97d3442cba36156e9429af61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.620471 23386 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2dc354ec164815b07f203d5b6ddd16 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:25.620805 23537 tablet_service.cc:1511] Processing CreateTablet for tablet 270bce0e96a24453b6b35f8451f5c7dc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:25.622216 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2dc354ec164815b07f203d5b6ddd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.622797 23537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270bce0e96a24453b6b35f8451f5c7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.625458 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ec9a7e5d824314a4743271735fab14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.631255 23599 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.633487 23311 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2dc354ec164815b07f203d5b6ddd16 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:25.634863 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2dc354ec164815b07f203d5b6ddd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.631799 23593 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:25.642055 23599 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:25.656320 23599 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:25.659099 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4a5edf9439448a85d0cf3f5d53996b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:25.659435 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:25.660440 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4a5edf9439448a85d0cf3f5d53996b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.664593 23511 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.673799 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4a5edf9439448a85d0cf3f5d53996b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:25.675397 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4a5edf9439448a85d0cf3f5d53996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.680259 23385 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4a5edf9439448a85d0cf3f5d53996b (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:25.682160 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4a5edf9439448a85d0cf3f5d53996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.684230 23534 tablet_service.cc:1511] Processing CreateTablet for tablet 2db51fbc97d3442cba36156e9429af61 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:25.687593 23312 tablet_service.cc:1511] Processing CreateTablet for tablet 2db51fbc97d3442cba36156e9429af61 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:25.688921 23312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db51fbc97d3442cba36156e9429af61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.690259 23533 tablet_service.cc:1511] Processing CreateTablet for tablet 0b429b743f704b32ab6f8ee57f5bd163 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:25.685695 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db51fbc97d3442cba36156e9429af61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.693465 23384 tablet_service.cc:1511] Processing CreateTablet for tablet 0b429b743f704b32ab6f8ee57f5bd163 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:25.694995 23384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b429b743f704b32ab6f8ee57f5bd163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.698117 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b429b743f704b32ab6f8ee57f5bd163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.703192 23593 tablet_bootstrap.cc:654] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.632269 23595 consensus_queue.cc:260] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:25.712536 23594 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:25.713155 23594 ts_tablet_manager.cc:1403] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.006s
I20260709 13:09:25.710615 23308 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2dd029e78d44d49664082ab994aec9 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:25.720196 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2dd029e78d44d49664082ab994aec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.717133 23592 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:25.720813 23592 ts_tablet_manager.cc:1403] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.237s	user 0.012s	sys 0.007s
I20260709 13:09:25.723613 23530 tablet_service.cc:1511] Processing CreateTablet for tablet 01f73d1ea60d4e67b869c7388c8b9df4 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:25.724279 23310 tablet_service.cc:1511] Processing CreateTablet for tablet 01f73d1ea60d4e67b869c7388c8b9df4 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:25.724974 23530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f73d1ea60d4e67b869c7388c8b9df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.725754 23310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f73d1ea60d4e67b869c7388c8b9df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.716745 23594 raft_consensus.cc:359] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.717057 23595 ts_tablet_manager.cc:1434] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.165s	user 0.006s	sys 0.002s
I20260709 13:09:25.724485 23592 raft_consensus.cc:359] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:25.731781 23603 raft_consensus.cc:493] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.731626 23592 raft_consensus.cc:385] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.732297 23603 raft_consensus.cc:515] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:25.732821 23595 tablet_bootstrap.cc:492] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:25.734589 23603 leader_election.cc:290] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:25.736936 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e39de0746842d2b01a51bd445a746b" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:25.737536 23592 raft_consensus.cc:740] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.738425 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e39de0746842d2b01a51bd445a746b" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:25.738657 23592 consensus_queue.cc:260] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:25.739929 23437 leader_election.cc:343] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:25.741391 23437 leader_election.cc:343] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.741534 23592 ts_tablet_manager.cc:1434] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:09:25.729775 23594 raft_consensus.cc:385] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.741999 23437 leader_election.cc:304] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:25.744187 23603 raft_consensus.cc:2749] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.743148 23594 raft_consensus.cc:740] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.747591 23388 tablet_service.cc:1511] Processing CreateTablet for tablet 01f73d1ea60d4e67b869c7388c8b9df4 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:25.746426 23594 consensus_queue.cc:260] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.749435 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f73d1ea60d4e67b869c7388c8b9df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.754735 23463 tablet_service.cc:1511] Processing CreateTablet for tablet 2385ef80a9064010a9965cd059570c71 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:25.755612 23535 tablet_service.cc:1511] Processing CreateTablet for tablet 2385ef80a9064010a9965cd059570c71 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:25.756176 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2385ef80a9064010a9965cd059570c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.756584 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2dd029e78d44d49664082ab994aec9 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:25.758363 23313 tablet_service.cc:1511] Processing CreateTablet for tablet 2385ef80a9064010a9965cd059570c71 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:25.759684 23313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2385ef80a9064010a9965cd059570c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.763228 23462 tablet_service.cc:1511] Processing CreateTablet for tablet 5f394ca7ac8e4fb0904b5c5129a503fc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:25.763477 23460 tablet_service.cc:1511] Processing CreateTablet for tablet 9afa3ae86d604ec2992da64a89540734 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:25.764761 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f394ca7ac8e4fb0904b5c5129a503fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.774104 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2dd029e78d44d49664082ab994aec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.751114 23594 ts_tablet_manager.cc:1434] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 13:09:25.778623 23535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2385ef80a9064010a9965cd059570c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.779943 23456 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa9aaf0293040738d08bf32226f26d7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:25.780514 23595 tablet_bootstrap.cc:654] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.781283 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afa3ae86d604ec2992da64a89540734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.781219 23632 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.782021 23632 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.784216 23632 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:25.782469 23594 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:25.792394 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:25.794920 23288 leader_election.cc:343] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.798621 23456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa9aaf0293040738d08bf32226f26d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.799845 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:25.800570 23473 raft_consensus.cc:2468] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:25.808779 23386 tablet_service.cc:1511] Processing CreateTablet for tablet 5f394ca7ac8e4fb0904b5c5129a503fc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:25.810400 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f394ca7ac8e4fb0904b5c5129a503fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.810693 23592 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:25.802109 23290 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:25.822067 23632 raft_consensus.cc:2804] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:25.822516 23632 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.822875 23632 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.832844 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:25.844228 23537 tablet_service.cc:1511] Processing CreateTablet for tablet 5f394ca7ac8e4fb0904b5c5129a503fc (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:25.845628 23537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f394ca7ac8e4fb0904b5c5129a503fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.846566 23513 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.847107 23513 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:25.848090 23599 raft_consensus.cc:2749] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.851553 23219 catalog_manager.cc:5697] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.858285 23313 tablet_service.cc:1511] Processing CreateTablet for tablet 9afa3ae86d604ec2992da64a89540734 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:25.865334 23313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afa3ae86d604ec2992da64a89540734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.861856 23593 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:25.861413 23455 tablet_service.cc:1511] Processing CreateTablet for tablet 0b429b743f704b32ab6f8ee57f5bd163 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:25.869657 23593 ts_tablet_manager.cc:1403] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.259s	user 0.015s	sys 0.026s
I20260709 13:09:25.863129 23592 tablet_bootstrap.cc:654] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.891127 23599 raft_consensus.cc:493] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.891896 23599 raft_consensus.cc:515] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:25.890218 23594 tablet_bootstrap.cc:654] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.908895 23455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b429b743f704b32ab6f8ee57f5bd163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.914110 23385 tablet_service.cc:1511] Processing CreateTablet for tablet 9afa3ae86d604ec2992da64a89540734 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:25.916007 23385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afa3ae86d604ec2992da64a89540734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.918332 23599 leader_election.cc:290] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:25.918705 23460 tablet_service.cc:1511] Processing CreateTablet for tablet 3c40a2a2441a4fb790b33bfcfd880413 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:25.919822 23632 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:25.916023 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:25.921905 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:25.922235 23460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c40a2a2441a4fb790b33bfcfd880413. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.925414 23511 leader_election.cc:343] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.914353 23533 tablet_service.cc:1511] Processing CreateTablet for tablet 57da1469aee244edbcec3c6c6b867007 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:09:25.930997 23513 leader_election.cc:343] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.931115 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:25.931559 23513 leader_election.cc:304] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:25.931836 23473 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.932773 23599 raft_consensus.cc:2749] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.927140 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:25.922770 23632 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
W20260709 13:09:25.936015 23288 leader_election.cc:343] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:25.900159 23461 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2dd029e78d44d49664082ab994aec9 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:25.946982 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2dd029e78d44d49664082ab994aec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.951623 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57da1469aee244edbcec3c6c6b867007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.952395 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 3c40a2a2441a4fb790b33bfcfd880413 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:25.954120 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 164c20e4fe9043b0ac2f2db5488e004e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:25.955238 23457 tablet_service.cc:1511] Processing CreateTablet for tablet 164c20e4fe9043b0ac2f2db5488e004e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:25.955622 23310 tablet_service.cc:1511] Processing CreateTablet for tablet 164c20e4fe9043b0ac2f2db5488e004e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:25.957825 23312 tablet_service.cc:1511] Processing CreateTablet for tablet 2845d7f0f10e4626832ab106dc1a747a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:25.957865 23532 tablet_service.cc:1511] Processing CreateTablet for tablet 2845d7f0f10e4626832ab106dc1a747a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:25.958205 23388 tablet_service.cc:1511] Processing CreateTablet for tablet 3c40a2a2441a4fb790b33bfcfd880413 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:25.954120 23311 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa9aaf0293040738d08bf32226f26d7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:25.966490 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164c20e4fe9043b0ac2f2db5488e004e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.962056 23458 tablet_service.cc:1511] Processing CreateTablet for tablet c7f771ca377747d1a9e0dbea4321b0ca (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:25.973074 23532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2845d7f0f10e4626832ab106dc1a747a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.973814 23595 tablet_bootstrap.cc:492] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:25.974433 23595 ts_tablet_manager.cc:1403] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.242s	user 0.021s	sys 0.033s
I20260709 13:09:25.977082 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c40a2a2441a4fb790b33bfcfd880413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.970479 23312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2845d7f0f10e4626832ab106dc1a747a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.985865 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa9aaf0293040738d08bf32226f26d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.987777 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c40a2a2441a4fb790b33bfcfd880413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.990303 23310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164c20e4fe9043b0ac2f2db5488e004e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.961680 23593 raft_consensus.cc:359] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:25.990386 23458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f771ca377747d1a9e0dbea4321b0ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.994613 23384 tablet_service.cc:1511] Processing CreateTablet for tablet 57da1469aee244edbcec3c6c6b867007 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:25.996325 23384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57da1469aee244edbcec3c6c6b867007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.985693 23534 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa9aaf0293040738d08bf32226f26d7 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:25.998114 23457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164c20e4fe9043b0ac2f2db5488e004e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.998664 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa9aaf0293040738d08bf32226f26d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.000178 23592 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:26.000697 23592 ts_tablet_manager.cc:1403] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.004s
I20260709 13:09:26.006417 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 57da1469aee244edbcec3c6c6b867007 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:26.007886 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57da1469aee244edbcec3c6c6b867007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.008879 23592 raft_consensus.cc:359] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.009793 23592 raft_consensus.cc:385] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.010116 23592 raft_consensus.cc:740] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.011053 23592 consensus_queue.cc:260] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.013916 23595 raft_consensus.cc:359] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.014739 23595 raft_consensus.cc:385] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.015074 23595 raft_consensus.cc:740] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.017525 23593 raft_consensus.cc:385] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.017987 23593 raft_consensus.cc:740] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.018774 23593 consensus_queue.cc:260] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.019490 23381 tablet_service.cc:1511] Processing CreateTablet for tablet 2845d7f0f10e4626832ab106dc1a747a (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:26.020746 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2845d7f0f10e4626832ab106dc1a747a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.021377 23632 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.022002 23632 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.022709 23473 raft_consensus.cc:2468] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:26.024039 23290 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:26.024911 23600 raft_consensus.cc:2804] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.025133 23632 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:26.025856 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.026041 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:26.026587 23399 raft_consensus.cc:2468] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
W20260709 13:09:26.027227 23288 leader_election.cc:343] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.028054 23288 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:26.031194 23632 raft_consensus.cc:2804] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.031616 23632 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.031968 23632 raft_consensus.cc:3060] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.033376 23599 consensus_queue.cc:1048] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:26.021543 23593 ts_tablet_manager.cc:1434] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.000s
I20260709 13:09:26.013564 23592 ts_tablet_manager.cc:1434] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:09:26.071303 23456 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb06ec9f38f44c28c9059cefb321a04 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:26.073235 23456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb06ec9f38f44c28c9059cefb321a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.078375 23592 tablet_bootstrap.cc:492] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:26.085645 23599 raft_consensus.cc:493] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.086306 23599 raft_consensus.cc:515] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.088953 23599 leader_election.cc:290] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:26.091475 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:26.093268 23513 leader_election.cc:343] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.054282 23595 consensus_queue.cc:260] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.098155 23595 ts_tablet_manager.cc:1434] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.003s
I20260709 13:09:26.099255 23595 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:26.106249 23593 tablet_bootstrap.cc:492] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
W20260709 13:09:26.118917 23207 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 59916.8us
I20260709 13:09:26.127067 23600 raft_consensus.cc:697] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:26.128168 23600 consensus_queue.cc:237] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:26.130059 23209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 57523.2us
I20260709 13:09:26.144292 23594 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:26.144838 23594 ts_tablet_manager.cc:1403] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.363s	user 0.035s	sys 0.039s
I20260709 13:09:26.150359 23593 tablet_bootstrap.cc:654] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.152982 23594 raft_consensus.cc:359] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.153836 23594 raft_consensus.cc:385] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.154155 23594 raft_consensus.cc:740] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.156143 23592 tablet_bootstrap.cc:654] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.155077 23594 consensus_queue.cc:260] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.158370 23462 tablet_service.cc:1511] Processing CreateTablet for tablet 26483779be92418ab5dc80b6e0228254 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:26.159744 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26483779be92418ab5dc80b6e0228254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.161654 23649 consensus_queue.cc:1048] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:26.163251 23632 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.174111 23595 tablet_bootstrap.cc:654] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.165365 23632 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:26.192796 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:26.194187 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:26.194821 23398 raft_consensus.cc:3060] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.209612 23652 raft_consensus.cc:493] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.210502 23652 raft_consensus.cc:515] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:26.194819 23288 leader_election.cc:343] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.217548 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:26.230706 23594 ts_tablet_manager.cc:1434] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.005s
I20260709 13:09:26.232069 23594 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:26.233417 23533 tablet_service.cc:1511] Processing CreateTablet for tablet c7f771ca377747d1a9e0dbea4321b0ca (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:26.234965 23600 consensus_queue.cc:1048] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:26.235301 23388 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb06ec9f38f44c28c9059cefb321a04 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:26.236670 23388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb06ec9f38f44c28c9059cefb321a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.224584 23324 raft_consensus.cc:2468] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:26.239843 23592 tablet_bootstrap.cc:492] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:26.239713 23534 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb06ec9f38f44c28c9059cefb321a04 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:26.240576 23592 ts_tablet_manager.cc:1403] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.007s
I20260709 13:09:26.242940 23386 tablet_service.cc:1511] Processing CreateTablet for tablet d0d0a0dbdf2f4194b4ba44d16193ee2e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:26.244969 23310 tablet_service.cc:1511] Processing CreateTablet for tablet d0d0a0dbdf2f4194b4ba44d16193ee2e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:26.246855 23310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d0a0dbdf2f4194b4ba44d16193ee2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.247532 23532 tablet_service.cc:1511] Processing CreateTablet for tablet cff5bda8d894486ca77e2e65f89c0494 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:26.248879 23311 tablet_service.cc:1511] Processing CreateTablet for tablet cff5bda8d894486ca77e2e65f89c0494 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:26.250273 23311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff5bda8d894486ca77e2e65f89c0494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.251639 23398 raft_consensus.cc:2468] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:26.254016 23312 tablet_service.cc:1511] Processing CreateTablet for tablet c7f771ca377747d1a9e0dbea4321b0ca (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:26.256264 23288 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:26.257474 23463 tablet_service.cc:1511] Processing CreateTablet for tablet d0d0a0dbdf2f4194b4ba44d16193ee2e (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:09:26.258400 23511 consensus_peers.cc:597] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.258879 23386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d0a0dbdf2f4194b4ba44d16193ee2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.259402 23511 leader_election.cc:304] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:26.261396 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d0a0dbdf2f4194b4ba44d16193ee2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.244964 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f771ca377747d1a9e0dbea4321b0ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.262064 23381 tablet_service.cc:1511] Processing CreateTablet for tablet cff5bda8d894486ca77e2e65f89c0494 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:26.263325 23381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff5bda8d894486ca77e2e65f89c0494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.261226 23600 raft_consensus.cc:2804] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.264855 23600 raft_consensus.cc:697] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:26.266079 23600 consensus_queue.cc:237] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.267176 23531 tablet_service.cc:1511] Processing CreateTablet for tablet 26483779be92418ab5dc80b6e0228254 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:26.268117 23312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f771ca377747d1a9e0dbea4321b0ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.269317 23306 tablet_service.cc:1511] Processing CreateTablet for tablet 26483779be92418ab5dc80b6e0228254 (DEFAULT_TABLE table=test-workload [id=7e8575e049c943fd911c5d556b6a41d0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:26.271373 23306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26483779be92418ab5dc80b6e0228254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.279034 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdeb4d212974dcf9c19753ad30b5034" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:26.280049 23473 raft_consensus.cc:2468] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:26.282006 23513 leader_election.cc:304] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.289465 23593 tablet_bootstrap.cc:492] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:26.292415 23593 ts_tablet_manager.cc:1403] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.186s	user 0.026s	sys 0.005s
I20260709 13:09:26.298463 23652 leader_election.cc:290] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:26.301076 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb06ec9f38f44c28c9059cefb321a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.293123 23592 raft_consensus.cc:359] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.329457 23594 tablet_bootstrap.cc:654] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.323657 23652 raft_consensus.cc:2804] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.325026 23592 raft_consensus.cc:385] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.330056 23595 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:26.336145 23599 raft_consensus.cc:2804] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.338219 23652 raft_consensus.cc:493] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.343194 23595 ts_tablet_manager.cc:1403] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.244s	user 0.008s	sys 0.017s
I20260709 13:09:26.339031 23592 raft_consensus.cc:740] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.348582 23599 raft_consensus.cc:493] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.358304 23599 raft_consensus.cc:3060] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.358987 23220 catalog_manager.cc:5697] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.353024 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26483779be92418ab5dc80b6e0228254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.357373 23595 raft_consensus.cc:359] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.350525 23652 raft_consensus.cc:3060] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.370496 23595 raft_consensus.cc:385] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:26.354349 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 95116.3us
I20260709 13:09:26.413303 23595 raft_consensus.cc:740] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.415171 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdeb4d212974dcf9c19753ad30b5034" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:26.417311 23511 leader_election.cc:343] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.344991 23593 raft_consensus.cc:359] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.418259 23593 raft_consensus.cc:385] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.381086 23532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff5bda8d894486ca77e2e65f89c0494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.418591 23593 raft_consensus.cc:740] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.419440 23593 consensus_queue.cc:260] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.419659 23595 consensus_queue.cc:260] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.400053 23592 consensus_queue.cc:260] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.430109 23592 ts_tablet_manager.cc:1434] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.003s
I20260709 13:09:26.410480 23221 catalog_manager.cc:5697] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:26.370774 23513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 88910.5us
I20260709 13:09:26.422719 23599 raft_consensus.cc:515] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.423074 23593 ts_tablet_manager.cc:1434] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.129s	user 0.005s	sys 0.003s
I20260709 13:09:26.435892 23593 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:26.439616 23652 raft_consensus.cc:515] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.441821 23599 leader_election.cc:290] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:26.442040 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdeb4d212974dcf9c19753ad30b5034" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:26.442375 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdeb4d212974dcf9c19753ad30b5034" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:26.443071 23473 raft_consensus.cc:3060] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:26.443437 23511 leader_election.cc:343] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.444054 23652 leader_election.cc:290] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:26.443940 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:26.444660 23324 raft_consensus.cc:3060] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.445273 23595 ts_tablet_manager.cc:1434] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:09:26.446476 23595 tablet_bootstrap.cc:492] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:26.447263 23593 tablet_bootstrap.cc:654] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.450425 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:26.451438 23472 raft_consensus.cc:3060] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.453999 23592 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:26.456974 23603 raft_consensus.cc:493] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.457651 23603 raft_consensus.cc:515] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.459900 23603 leader_election.cc:290] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:26.457039 23594 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:26.462795 23594 ts_tablet_manager.cc:1403] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.012s
I20260709 13:09:26.465107 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:26.465951 23547 raft_consensus.cc:2468] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:26.467499 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.469218 23437 leader_election.cc:304] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
W20260709 13:09:26.470669 23437 leader_election.cc:343] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.471697 23603 raft_consensus.cc:2804] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.472231 23603 raft_consensus.cc:493] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.472611 23603 raft_consensus.cc:3060] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:26.475731 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:26.476759 23472 raft_consensus.cc:2468] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:26.478569 23513 leader_election.cc:304] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.479526 23652 raft_consensus.cc:2804] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.480088 23652 raft_consensus.cc:697] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:26.481036 23652 consensus_queue.cc:237] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.463181 23324 raft_consensus.cc:2468] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:26.492695 23593 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:26.493391 23593 ts_tablet_manager.cc:1403] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.031s
I20260709 13:09:26.472496 23594 raft_consensus.cc:359] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.494024 23594 raft_consensus.cc:385] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.494361 23594 raft_consensus.cc:740] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.495189 23594 consensus_queue.cc:260] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.496673 23593 raft_consensus.cc:359] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.497462 23593 raft_consensus.cc:385] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.497759 23594 ts_tablet_manager.cc:1434] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:09:26.497802 23593 raft_consensus.cc:740] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.498636 23602 raft_consensus.cc:493] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.485589 23473 raft_consensus.cc:2468] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:26.498827 23593 consensus_queue.cc:260] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.499215 23602 raft_consensus.cc:515] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.500458 23513 leader_election.cc:304] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:26.501922 23599 raft_consensus.cc:2804] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.502573 23595 tablet_bootstrap.cc:654] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.502482 23599 raft_consensus.cc:697] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:26.498872 23594 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:26.502880 23592 tablet_bootstrap.cc:654] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.508620 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:26.509407 23324 raft_consensus.cc:2468] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:26.510190 23599 consensus_queue.cc:237] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.510914 23363 leader_election.cc:304] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:26.503166 23602 leader_election.cc:290] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:26.527614 23602 raft_consensus.cc:2804] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.528112 23602 raft_consensus.cc:493] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.528481 23602 raft_consensus.cc:3060] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.542244 23603 raft_consensus.cc:515] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.548427 23603 leader_election.cc:290] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:26.548807 23594 tablet_bootstrap.cc:654] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.549400 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:26.550006 23547 raft_consensus.cc:3060] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.556535 23547 raft_consensus.cc:2468] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:26.558030 23437 leader_election.cc:304] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.559183 23603 raft_consensus.cc:2804] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:26.570840 23363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 60065.6us
I20260709 13:09:26.576349 23593 ts_tablet_manager.cc:1434] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.083s	user 0.030s	sys 0.027s
I20260709 13:09:26.576557 23602 raft_consensus.cc:515] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.579069 23593 tablet_bootstrap.cc:492] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:26.581012 23595 tablet_bootstrap.cc:492] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:26.581589 23595 ts_tablet_manager.cc:1403] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.007s
I20260709 13:09:26.581346 23221 catalog_manager.cc:5697] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.584398 23632 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.584961 23632 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.586310 23593 tablet_bootstrap.cc:654] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.587793 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:26.589165 23365 leader_election.cc:343] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.584856 23595 raft_consensus.cc:359] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.589725 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:26.590868 23547 raft_consensus.cc:2468] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:26.590600 23595 raft_consensus.cc:385] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.591073 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:26.591590 23595 raft_consensus.cc:740] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.593024 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:26.590452 23632 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
W20260709 13:09:26.593027 23290 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.590545 23221 catalog_manager.cc:5697] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.598034 23594 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:26.598752 23594 ts_tablet_manager.cc:1403] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.004s
I20260709 13:09:26.599282 23592 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:26.600092 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:26.599778 23673 raft_consensus.cc:493] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.601059 23602 leader_election.cc:290] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
W20260709 13:09:26.601526 23365 leader_election.cc:343] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.606650 23437 leader_election.cc:343] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.607625 23593 tablet_bootstrap.cc:492] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:26.607523 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:26.608206 23593 ts_tablet_manager.cc:1403] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 13:09:26.608503 23324 raft_consensus.cc:3060] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.596128 23632 consensus_queue.cc:1048] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:26.600375 23592 ts_tablet_manager.cc:1403] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.007s
I20260709 13:09:26.610896 23593 raft_consensus.cc:359] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.611660 23593 raft_consensus.cc:385] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.611961 23593 raft_consensus.cc:740] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.614001 23592 raft_consensus.cc:359] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.603281 23673 raft_consensus.cc:515] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.615134 23592 raft_consensus.cc:385] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.602202 23594 raft_consensus.cc:359] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.615518 23592 raft_consensus.cc:740] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.615720 23594 raft_consensus.cc:385] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.616024 23594 raft_consensus.cc:740] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.614061 23593 consensus_queue.cc:260] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.618499 23673 leader_election.cc:290] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:26.618786 23593 ts_tablet_manager.cc:1434] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:09:26.615000 23288 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:26.623579 23632 raft_consensus.cc:2804] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.623994 23632 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.624339 23632 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.624449 23592 consensus_queue.cc:260] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.627295 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:26.637035 23632 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.639669 23594 consensus_queue.cc:260] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.634559 23592 ts_tablet_manager.cc:1434] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:09:26.641952 23592 tablet_bootstrap.cc:492] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:26.642270 23603 raft_consensus.cc:697] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:26.643600 23603 consensus_queue.cc:237] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
W20260709 13:09:26.647428 23363 leader_election.cc:343] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.647783 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:26.648509 23323 raft_consensus.cc:2468] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:26.649878 23363 leader_election.cc:304] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:26.649968 23324 raft_consensus.cc:2468] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:26.650915 23600 raft_consensus.cc:493] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.651597 23593 tablet_bootstrap.cc:492] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:26.651437 23600 raft_consensus.cc:515] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.653694 23600 leader_election.cc:290] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:26.622208 23595 consensus_queue.cc:260] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.655573 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891d07a8dc184d778dc815912cccc1ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:26.658181 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891d07a8dc184d778dc815912cccc1ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.664390 23594 ts_tablet_manager.cc:1434] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 13:09:26.660720 23602 raft_consensus.cc:2804] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.668517 23602 raft_consensus.cc:493] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.668951 23602 raft_consensus.cc:3060] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.672408 23593 tablet_bootstrap.cc:654] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.672823 23594 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:26.674015 23595 ts_tablet_manager.cc:1434] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.004s
I20260709 13:09:26.678057 23363 leader_election.cc:304] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:26.679167 23595 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:26.679032 23673 raft_consensus.cc:2804] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.679718 23288 leader_election.cc:304] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:26.679937 23673 raft_consensus.cc:697] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:26.680994 23600 raft_consensus.cc:2749] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.681394 23673 consensus_queue.cc:237] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.688997 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
W20260709 13:09:26.691581 23290 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.691852 23592 tablet_bootstrap.cc:654] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.693800 23324 raft_consensus.cc:3060] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.698721 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:26.699638 23547 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.706322 23594 tablet_bootstrap.cc:654] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.715137 23652 raft_consensus.cc:493] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.716013 23652 raft_consensus.cc:515] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.704378 23632 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:26.726455 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e39de0746842d2b01a51bd445a746b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.726341 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e39de0746842d2b01a51bd445a746b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:26.727142 23595 tablet_bootstrap.cc:654] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.727267 23472 raft_consensus.cc:2468] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:26.724380 23652 leader_election.cc:290] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:26.727241 23397 raft_consensus.cc:2468] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:26.729571 23513 leader_election.cc:304] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.732847 23652 raft_consensus.cc:2804] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.733379 23652 raft_consensus.cc:493] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.733798 23547 raft_consensus.cc:2468] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:26.733883 23652 raft_consensus.cc:3060] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.740029 23288 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:26.741616 23632 raft_consensus.cc:2804] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.740927 23222 catalog_manager.cc:5697] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.744597 23593 tablet_bootstrap.cc:492] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:26.745129 23593 ts_tablet_manager.cc:1403] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.020s
I20260709 13:09:26.748240 23602 raft_consensus.cc:515] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.751030 23652 raft_consensus.cc:515] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.754108 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:26.754134 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e39de0746842d2b01a51bd445a746b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:26.755844 23397 raft_consensus.cc:3060] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:26.760061 23363 leader_election.cc:343] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.762703 23288 consensus_peers.cc:597] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.763711 23600 consensus_queue.cc:1048] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:26.766252 23593 raft_consensus.cc:359] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.767030 23593 raft_consensus.cc:385] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.767320 23593 raft_consensus.cc:740] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.745838 23632 raft_consensus.cc:697] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:26.768898 23547 raft_consensus.cc:3060] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.769347 23602 leader_election.cc:290] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:26.773000 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:26.772809 23632 consensus_queue.cc:237] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.773980 23323 raft_consensus.cc:3060] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.770543 23593 consensus_queue.cc:260] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.784956 23595 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:26.785602 23595 ts_tablet_manager.cc:1403] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.002s
I20260709 13:09:26.789566 23595 raft_consensus.cc:359] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.790540 23595 raft_consensus.cc:385] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.790858 23595 raft_consensus.cc:740] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.791020 23222 catalog_manager.cc:5697] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.791785 23595 consensus_queue.cc:260] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.797888 23595 ts_tablet_manager.cc:1434] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:26.798954 23595 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:26.801450 23594 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:26.802253 23594 ts_tablet_manager.cc:1403] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.014s
I20260709 13:09:26.808241 23397 raft_consensus.cc:2468] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:26.809980 23511 leader_election.cc:304] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.811607 23664 raft_consensus.cc:2804] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.812202 23664 raft_consensus.cc:697] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:26.813120 23664 consensus_queue.cc:237] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.813551 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e39de0746842d2b01a51bd445a746b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:26.814752 23594 raft_consensus.cc:359] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.816696 23594 raft_consensus.cc:385] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.817147 23594 raft_consensus.cc:740] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.816066 23472 raft_consensus.cc:3060] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.818082 23594 consensus_queue.cc:260] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.821902 23594 ts_tablet_manager.cc:1434] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:09:26.824256 23592 tablet_bootstrap.cc:492] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:26.824841 23592 ts_tablet_manager.cc:1403] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.002s
I20260709 13:09:26.828883 23593 ts_tablet_manager.cc:1434] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.004s
I20260709 13:09:26.830128 23594 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:26.830428 23593 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:26.815652 23652 leader_election.cc:290] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:26.831775 23592 raft_consensus.cc:359] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.832791 23592 raft_consensus.cc:385] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.833109 23592 raft_consensus.cc:740] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.834056 23592 consensus_queue.cc:260] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.836400 23592 ts_tablet_manager.cc:1434] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:26.836836 23472 raft_consensus.cc:2468] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:26.837507 23592 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:26.844195 23594 tablet_bootstrap.cc:654] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.845031 23592 tablet_bootstrap.cc:654] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.846673 23595 tablet_bootstrap.cc:654] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.849682 23323 raft_consensus.cc:2468] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:26.856316 23222 catalog_manager.cc:5697] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.857494 23363 leader_election.cc:304] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:26.859853 23673 raft_consensus.cc:2804] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.860471 23673 raft_consensus.cc:697] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:26.861661 23673 consensus_queue.cc:237] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.861588 23220 catalog_manager.cc:5697] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.867105 23664 raft_consensus.cc:493] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.867921 23664 raft_consensus.cc:515] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.880597 23664 leader_election.cc:290] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:26.882272 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:26.883314 23472 raft_consensus.cc:2468] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:26.883997 23593 tablet_bootstrap.cc:654] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.882272 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.885831 23632 raft_consensus.cc:493] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.886061 23513 leader_election.cc:304] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.886332 23632 raft_consensus.cc:515] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.888653 23632 leader_election.cc:290] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:26.890002 23664 raft_consensus.cc:2804] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.890440 23664 raft_consensus.cc:493] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.890792 23664 raft_consensus.cc:3060] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.886351 23397 raft_consensus.cc:2468] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:26.892232 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479efbeb6ad48938ed367d2bd50c494" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:26.895080 23595 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:26.895754 23595 ts_tablet_manager.cc:1403] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.006s
I20260709 13:09:26.896540 23599 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.895262 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479efbeb6ad48938ed367d2bd50c494" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.896703 23632 consensus_queue.cc:1048] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:26.897321 23599 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:26.898168 23288 leader_election.cc:343] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.904485 23290 leader_election.cc:343] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.906153 23290 leader_election.cc:304] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:26.907027 23600 raft_consensus.cc:2749] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.910817 23595 raft_consensus.cc:359] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.911662 23595 raft_consensus.cc:385] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.911935 23595 raft_consensus.cc:740] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
W20260709 13:09:26.915068 23511 consensus_peers.cc:597] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.915249 23599 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:26.919283 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:26.922089 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:26.926021 23664 raft_consensus.cc:515] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:26.929524 23599 consensus_queue.cc:1048] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:26.929920 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:26.930558 23472 raft_consensus.cc:3060] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.932068 23511 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:26.937814 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:26.938802 23399 raft_consensus.cc:3060] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.928791 23664 leader_election.cc:290] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:26.956928 23594 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:26.957527 23593 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:26.958127 23593 ts_tablet_manager.cc:1403] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.007s
I20260709 13:09:26.917521 23595 consensus_queue.cc:260] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:26.961205 23593 raft_consensus.cc:359] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.957598 23594 ts_tablet_manager.cc:1403] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.027s
I20260709 13:09:26.962275 23593 raft_consensus.cc:385] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.962860 23593 raft_consensus.cc:740] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.963894 23593 consensus_queue.cc:260] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:26.965302 23594 raft_consensus.cc:359] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.966061 23594 raft_consensus.cc:385] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.966333 23594 raft_consensus.cc:740] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.966718 23593 ts_tablet_manager.cc:1434] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:26.967155 23594 consensus_queue.cc:260] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:26.967770 23593 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:26.969359 23594 ts_tablet_manager.cc:1434] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:26.970633 23594 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:26.972580 23472 raft_consensus.cc:2468] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:26.974479 23513 leader_election.cc:304] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:26.975802 23652 raft_consensus.cc:2804] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.976370 23595 ts_tablet_manager.cc:1434] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 13:09:26.976482 23652 raft_consensus.cc:697] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:26.977699 23595 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:26.957588 23222 catalog_manager.cc:5697] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.971596 23664 consensus_queue.cc:1048] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:26.977941 23652 consensus_queue.cc:237] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.006469 23399 raft_consensus.cc:2468] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:27.009560 23594 tablet_bootstrap.cc:654] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.010777 23593 tablet_bootstrap.cc:654] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.017853 23592 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.018592 23592 ts_tablet_manager.cc:1403] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.181s	user 0.005s	sys 0.013s
I20260709 13:09:27.019130 23673 raft_consensus.cc:493] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.019647 23673 raft_consensus.cc:515] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.022688 23592 raft_consensus.cc:359] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.023265 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.023723 23592 raft_consensus.cc:385] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.024091 23592 raft_consensus.cc:740] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.024792 23595 tablet_bootstrap.cc:654] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.028963 23673 leader_election.cc:290] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.026738 23592 consensus_queue.cc:260] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.034451 23599 raft_consensus.cc:2749] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:27.035046 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4f6dbbb32a4bb29cae9c9baf87c65b" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.035936 23546 raft_consensus.cc:2393] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:27.042476 23363 leader_election.cc:304] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:27.043859 23673 raft_consensus.cc:3060] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.058261 23673 raft_consensus.cc:2749] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.070976 23592 ts_tablet_manager.cc:1434] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 13:09:27.070318 23220 catalog_manager.cc:5697] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.072592 23592 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.080370 23593 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.080967 23593 ts_tablet_manager.cc:1403] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.012s
I20260709 13:09:27.082057 23595 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.082540 23595 ts_tablet_manager.cc:1403] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.007s
I20260709 13:09:27.083449 23592 tablet_bootstrap.cc:654] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.083757 23593 raft_consensus.cc:359] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.084534 23593 raft_consensus.cc:385] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.084841 23593 raft_consensus.cc:740] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.084803 23595 raft_consensus.cc:359] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.085669 23595 raft_consensus.cc:385] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.085804 23593 consensus_queue.cc:260] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.086599 23595 raft_consensus.cc:740] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.087468 23595 consensus_queue.cc:260] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.089681 23670 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.090369 23670 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.091861 23594 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:27.092540 23594 ts_tablet_manager.cc:1403] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.013s
I20260709 13:09:27.089913 23595 ts_tablet_manager.cc:1434] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:27.094449 23595 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.096249 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.094215 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.103555 23365 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.104497 23602 raft_consensus.cc:2749] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.105275 23594 raft_consensus.cc:359] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.106184 23594 raft_consensus.cc:385] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.106488 23594 raft_consensus.cc:740] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.107189 23593 ts_tablet_manager.cc:1434] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:09:27.107322 23594 consensus_queue.cc:260] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.109669 23654 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.108307 23595 tablet_bootstrap.cc:654] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.110359 23654 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.112871 23708 consensus_queue.cc:1048] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.115258 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:27.115418 23654 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.115581 23592 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.116219 23670 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:27.116521 23592 ts_tablet_manager.cc:1403] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.015s
W20260709 13:09:27.118891 23288 leader_election.cc:343] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.119663 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.120399 23473 raft_consensus.cc:2468] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:27.109673 23593 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.120574 23592 raft_consensus.cc:359] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.121819 23290 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:27.122272 23592 raft_consensus.cc:385] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.123067 23592 raft_consensus.cc:740] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.123301 23654 raft_consensus.cc:2804] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.123937 23654 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.124480 23654 raft_consensus.cc:3060] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.127557 23594 ts_tablet_manager.cc:1434] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:09:27.128643 23594 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:27.135174 23593 tablet_bootstrap.cc:654] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.136035 23592 consensus_queue.cc:260] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.140905 23654 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.142076 23592 ts_tablet_manager.cc:1434] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:27.143746 23592 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.147157 23603 raft_consensus.cc:493] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.147734 23603 raft_consensus.cc:515] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.148682 23595 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.149197 23595 ts_tablet_manager.cc:1403] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 13:09:27.150583 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:27.151278 23472 raft_consensus.cc:3060] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.151862 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.152060 23595 raft_consensus.cc:359] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.152773 23595 raft_consensus.cc:385] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.153101 23595 raft_consensus.cc:740] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.153496 23594 tablet_bootstrap.cc:654] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.145324 23654 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.144106 23599 raft_consensus.cc:493] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.162595 23599 raft_consensus.cc:515] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.164546 23599 leader_election.cc:290] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:27.153887 23595 consensus_queue.cc:260] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.166457 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:27.167618 23595 ts_tablet_manager.cc:1434] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:09:27.168177 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.168598 23595 tablet_bootstrap.cc:492] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.168948 23324 raft_consensus.cc:2393] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:27.171057 23511 leader_election.cc:304] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.172430 23599 raft_consensus.cc:3060] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.154098 23678 consensus_queue.cc:1048] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.152776 23323 raft_consensus.cc:2393] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:27.174913 23593 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.175487 23593 ts_tablet_manager.cc:1403] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.005s
I20260709 13:09:27.155333 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:27.156016 23603 leader_election.cc:290] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:27.158018 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:27.160050 23472 raft_consensus.cc:2468] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:27.177858 23290 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:27.178874 23654 raft_consensus.cc:2804] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.178722 23593 raft_consensus.cc:359] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.179585 23593 raft_consensus.cc:385] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.180083 23593 raft_consensus.cc:740] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.179620 23654 raft_consensus.cc:697] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:27.181027 23397 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.181144 23437 leader_election.cc:304] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.181595 23654 consensus_queue.cc:237] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.182597 23603 raft_consensus.cc:3060] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.180907 23593 consensus_queue.cc:260] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.183779 23399 raft_consensus.cc:3060] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.160745 23592 tablet_bootstrap.cc:654] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.188058 23698 raft_consensus.cc:493] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.188836 23698 raft_consensus.cc:515] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.191038 23593 ts_tablet_manager.cc:1434] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:09:27.191062 23678 consensus_queue.cc:1048] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.196513 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.197340 23472 raft_consensus.cc:2468] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:27.193377 23593 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.216689 23595 tablet_bootstrap.cc:654] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.198849 23290 leader_election.cc:304] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:27.203907 23599 raft_consensus.cc:2749] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.214339 23698 leader_election.cc:290] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.234870 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.233382 23649 raft_consensus.cc:2804] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:27.238530 23288 leader_election.cc:343] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.238943 23649 raft_consensus.cc:493] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.239300 23649 raft_consensus.cc:3060] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.244776 23399 raft_consensus.cc:2468] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:27.255302 23663 consensus_queue.cc:1048] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:27.260087 23473 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.260599 23603 raft_consensus.cc:2749] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.267052 23649 raft_consensus.cc:515] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.267834 23593 tablet_bootstrap.cc:654] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.270292 23649 leader_election.cc:290] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.274046 23594 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:27.274785 23594 ts_tablet_manager.cc:1403] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.018s
I20260709 13:09:27.276554 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:27.277420 23472 raft_consensus.cc:3060] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.278388 23673 consensus_queue.cc:1048] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.279999 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
W20260709 13:09:27.282830 23288 leader_election.cc:343] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.271557 23220 catalog_manager.cc:5697] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.299659 23649 consensus_queue.cc:1048] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.303844 23670 consensus_queue.cc:1048] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.305015 23592 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.305526 23592 ts_tablet_manager.cc:1403] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.029s
I20260709 13:09:27.308347 23592 raft_consensus.cc:359] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.309046 23592 raft_consensus.cc:385] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.309317 23592 raft_consensus.cc:740] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.315737 23595 tablet_bootstrap.cc:492] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.316707 23595 ts_tablet_manager.cc:1403] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.008s
I20260709 13:09:27.318254 23664 consensus_queue.cc:1048] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.319197 23472 raft_consensus.cc:2468] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:27.336164 23595 raft_consensus.cc:359] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.339063 23594 raft_consensus.cc:359] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.313658 23670 consensus_queue.cc:1048] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:27.340344 23593 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.340200 23594 raft_consensus.cc:385] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.341681 23593 ts_tablet_manager.cc:1403] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.021s
I20260709 13:09:27.342351 23594 raft_consensus.cc:740] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.343415 23594 consensus_queue.cc:260] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.346387 23594 ts_tablet_manager.cc:1434] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 13:09:27.346755 23593 raft_consensus.cc:359] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.347954 23594 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:27.348006 23593 raft_consensus.cc:385] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.348755 23593 raft_consensus.cc:740] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.339972 23595 raft_consensus.cc:385] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.349869 23595 raft_consensus.cc:740] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.350961 23595 consensus_queue.cc:260] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.351802 23681 raft_consensus.cc:493] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.352403 23681 raft_consensus.cc:515] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.353142 23593 consensus_queue.cc:260] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.354799 23681 leader_election.cc:290] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:27.354820 23593 ts_tablet_manager.cc:1434] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:27.356357 23595 ts_tablet_manager.cc:1434] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:09:27.356393 23593 tablet_bootstrap.cc:492] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.357105 23594 tablet_bootstrap.cc:654] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.357471 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479efbeb6ad48938ed367d2bd50c494" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:27.357565 23595 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.358287 23398 raft_consensus.cc:2468] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:27.327997 23592 consensus_queue.cc:260] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.339923 23324 raft_consensus.cc:3060] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.364622 23592 ts_tablet_manager.cc:1434] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:09:27.366335 23592 tablet_bootstrap.cc:492] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.363457 23663 raft_consensus.cc:493] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.370615 23663 raft_consensus.cc:515] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.373132 23663 leader_election.cc:290] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:27.340618 23290 leader_election.cc:304] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: a1265f7d704d41df83adf9f1c74d3f03
W20260709 13:09:27.374675 23290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 46899.1us
I20260709 13:09:27.376741 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.377791 23322 raft_consensus.cc:2393] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:27.378556 23649 raft_consensus.cc:2804] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.379105 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479efbeb6ad48938ed367d2bd50c494" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.379887 23321 raft_consensus.cc:2468] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:27.379154 23649 raft_consensus.cc:697] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:27.384090 23649 consensus_queue.cc:237] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.390692 23437 leader_election.cc:304] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:27.392109 23592 tablet_bootstrap.cc:654] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.404574 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.397222 23681 raft_consensus.cc:2804] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.410544 23681 raft_consensus.cc:493] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.411104 23681 raft_consensus.cc:3060] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.415140 23673 consensus_queue.cc:1048] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.422056 23470 raft_consensus.cc:2393] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:27.424683 23513 leader_election.cc:304] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.425987 23663 raft_consensus.cc:3060] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.456087 23595 tablet_bootstrap.cc:654] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.457319 23663 raft_consensus.cc:2749] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.466023 23593 tablet_bootstrap.cc:654] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.477218 23652 raft_consensus.cc:493] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.478119 23652 raft_consensus.cc:515] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.488722 23652 leader_election.cc:290] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:27.489001 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:27.490480 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:27.490818 23511 leader_election.cc:343] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:27.492031 23511 leader_election.cc:343] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.492501 23592 tablet_bootstrap.cc:492] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.492440 23511 leader_election.cc:304] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.493031 23592 ts_tablet_manager.cc:1403] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.020s
I20260709 13:09:27.493574 23652 raft_consensus.cc:2749] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.496120 23592 raft_consensus.cc:359] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.496769 23592 raft_consensus.cc:385] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.497025 23592 raft_consensus.cc:740] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.497678 23592 consensus_queue.cc:260] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.499810 23592 ts_tablet_manager.cc:1434] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:09:27.500734 23592 tablet_bootstrap.cc:492] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.445115 23681 raft_consensus.cc:515] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.504236 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479efbeb6ad48938ed367d2bd50c494" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:27.504865 23324 raft_consensus.cc:3060] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.508411 23649 consensus_queue.cc:1048] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.461516 23594 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:27.511757 23594 ts_tablet_manager.cc:1403] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.007s
I20260709 13:09:27.514389 23681 leader_election.cc:290] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:27.515661 23663 raft_consensus.cc:493] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.517611 23663 raft_consensus.cc:515] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.519223 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479efbeb6ad48938ed367d2bd50c494" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:27.519887 23399 raft_consensus.cc:3060] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.521425 23324 raft_consensus.cc:2468] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:27.522802 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3ba70a274480909cc569cf8886b2" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.523571 23470 raft_consensus.cc:2468] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:27.523608 23437 leader_election.cc:304] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:27.522944 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3ba70a274480909cc569cf8886b2" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:27.525274 23513 leader_election.cc:304] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:27.526278 23652 raft_consensus.cc:2804] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.526651 23652 raft_consensus.cc:493] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.527004 23652 raft_consensus.cc:3060] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.527877 23399 raft_consensus.cc:2468] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
W20260709 13:09:27.528460 23511 leader_election.cc:343] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.529210 23681 raft_consensus.cc:2804] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.529949 23681 raft_consensus.cc:697] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:27.530158 23663 leader_election.cc:290] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.530844 23681 consensus_queue.cc:237] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.536343 23673 raft_consensus.cc:493] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.536904 23673 raft_consensus.cc:515] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.539078 23673 leader_election.cc:290] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.542589 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:27.544385 23365 leader_election.cc:343] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.545225 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.545957 23324 raft_consensus.cc:2468] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.547108 23363 leader_election.cc:304] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:27.548503 23673 raft_consensus.cc:2804] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.548892 23673 raft_consensus.cc:493] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.549220 23673 raft_consensus.cc:3060] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.551302 23663 consensus_queue.cc:1048] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.554483 23220 catalog_manager.cc:5697] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.560585 23673 raft_consensus.cc:515] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.564172 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:27.564761 23324 raft_consensus.cc:3060] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.565114 23594 raft_consensus.cc:359] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.565831 23594 raft_consensus.cc:385] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.565948 23664 consensus_queue.cc:1048] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.566109 23594 raft_consensus.cc:740] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.567504 23652 raft_consensus.cc:515] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.577688 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3ba70a274480909cc569cf8886b2" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:27.561645 23592 tablet_bootstrap.cc:654] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.579181 23594 consensus_queue.cc:260] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:27.580644 23511 leader_election.cc:343] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.581513 23594 ts_tablet_manager.cc:1434] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:09:27.596472 23593 tablet_bootstrap.cc:492] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.597337 23593 ts_tablet_manager.cc:1403] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.241s	user 0.037s	sys 0.053s
I20260709 13:09:27.597573 23594 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:27.600247 23595 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.601054 23595 ts_tablet_manager.cc:1403] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.003s
W20260709 13:09:27.602831 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:27.603889 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3ba70a274480909cc569cf8886b2" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:27.604321 23673 leader_election.cc:290] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.604586 23469 raft_consensus.cc:3060] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.604449 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:27.585829 23324 raft_consensus.cc:2468] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:27.599656 23652 leader_election.cc:290] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
W20260709 13:09:27.611927 23365 leader_election.cc:343] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.612726 23594 tablet_bootstrap.cc:654] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.612442 23595 raft_consensus.cc:359] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.617990 23595 raft_consensus.cc:385] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.615167 23592 tablet_bootstrap.cc:492] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.618886 23592 ts_tablet_manager.cc:1403] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.118s	user 0.006s	sys 0.006s
I20260709 13:09:27.621925 23363 leader_election.cc:304] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:27.625653 23592 raft_consensus.cc:359] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.626435 23592 raft_consensus.cc:385] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.626706 23592 raft_consensus.cc:740] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.618336 23595 raft_consensus.cc:740] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.627117 23593 raft_consensus.cc:359] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.627907 23593 raft_consensus.cc:385] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.627990 23595 consensus_queue.cc:260] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.630303 23673 raft_consensus.cc:2804] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.631121 23673 raft_consensus.cc:697] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:27.632061 23673 consensus_queue.cc:237] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.627157 23222 catalog_manager.cc:5697] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.632768 23592 consensus_queue.cc:260] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.633450 23469 raft_consensus.cc:2468] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:27.634776 23513 leader_election.cc:304] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:27.635610 23599 raft_consensus.cc:2804] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.628211 23593 raft_consensus.cc:740] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.630306 23595 ts_tablet_manager.cc:1434] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:09:27.636899 23592 ts_tablet_manager.cc:1434] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:09:27.641769 23595 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.642046 23592 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.646654 23599 raft_consensus.cc:697] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:27.648767 23599 consensus_queue.cc:237] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.653533 23593 consensus_queue.cc:260] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.654672 23731 consensus_queue.cc:1048] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.656414 23593 ts_tablet_manager.cc:1434] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:09:27.656970 23592 tablet_bootstrap.cc:654] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.657454 23593 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.658373 23594 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:27.658842 23594 ts_tablet_manager.cc:1403] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.006s
I20260709 13:09:27.664903 23593 tablet_bootstrap.cc:654] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.666713 23594 raft_consensus.cc:359] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.667505 23594 raft_consensus.cc:385] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.667826 23594 raft_consensus.cc:740] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.668506 23594 consensus_queue.cc:260] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.676061 23649 consensus_queue.cc:1048] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.679044 23595 tablet_bootstrap.cc:654] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.682670 23594 ts_tablet_manager.cc:1434] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:09:27.684121 23594 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:27.692096 23222 catalog_manager.cc:5697] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.700261 23220 catalog_manager.cc:5697] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.712245 23599 raft_consensus.cc:493] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.713039 23599 raft_consensus.cc:515] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.716706 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:27.718801 23511 leader_election.cc:343] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.720494 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:27.722101 23513 leader_election.cc:343] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.722569 23513 leader_election.cc:304] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:27.723454 23663 raft_consensus.cc:2749] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.715979 23599 leader_election.cc:290] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.730623 23595 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.731201 23595 ts_tablet_manager.cc:1403] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.034s
I20260709 13:09:27.732713 23593 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.732967 23592 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.733220 23593 ts_tablet_manager.cc:1403] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.005s
I20260709 13:09:27.733445 23592 ts_tablet_manager.cc:1403] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.092s	user 0.001s	sys 0.010s
I20260709 13:09:27.733953 23595 raft_consensus.cc:359] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.734701 23595 raft_consensus.cc:385] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.734964 23595 raft_consensus.cc:740] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.736775 23592 raft_consensus.cc:359] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.737479 23592 raft_consensus.cc:385] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.737721 23592 raft_consensus.cc:740] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.738490 23594 tablet_bootstrap.cc:654] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.738586 23592 consensus_queue.cc:260] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.741123 23592 ts_tablet_manager.cc:1434] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:09:27.741163 23595 consensus_queue.cc:260] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.742262 23592 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.745498 23593 raft_consensus.cc:359] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.746552 23593 raft_consensus.cc:385] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.746907 23593 raft_consensus.cc:740] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.748847 23592 tablet_bootstrap.cc:654] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.751928 23593 consensus_queue.cc:260] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.755028 23593 ts_tablet_manager.cc:1434] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:09:27.756325 23593 tablet_bootstrap.cc:492] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.765770 23593 tablet_bootstrap.cc:654] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.770303 23594 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:27.770838 23594 ts_tablet_manager.cc:1403] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.003s
I20260709 13:09:27.772790 23595 ts_tablet_manager.cc:1434] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:09:27.773897 23595 tablet_bootstrap.cc:492] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.773660 23594 raft_consensus.cc:359] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.779846 23594 raft_consensus.cc:385] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.780189 23594 raft_consensus.cc:740] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.780927 23594 consensus_queue.cc:260] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.784652 23595 tablet_bootstrap.cc:654] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.786602 23594 ts_tablet_manager.cc:1434] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:27.787644 23594 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:27.791013 23592 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.791550 23592 ts_tablet_manager.cc:1403] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.020s
I20260709 13:09:27.792114 23595 tablet_bootstrap.cc:492] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.792594 23595 ts_tablet_manager.cc:1403] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:09:27.795578 23594 tablet_bootstrap.cc:654] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.795311 23595 raft_consensus.cc:359] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.796128 23595 raft_consensus.cc:385] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.796422 23595 raft_consensus.cc:740] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.796612 23593 tablet_bootstrap.cc:492] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.797080 23593 ts_tablet_manager.cc:1403] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 13:09:27.797231 23595 consensus_queue.cc:260] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.799912 23593 raft_consensus.cc:359] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.800679 23593 raft_consensus.cc:385] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.800948 23593 raft_consensus.cc:740] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.801792 23593 consensus_queue.cc:260] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.802526 23595 ts_tablet_manager.cc:1434] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:27.804464 23593 ts_tablet_manager.cc:1434] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:09:27.805487 23592 raft_consensus.cc:359] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.807080 23595 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.807241 23592 raft_consensus.cc:385] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.807550 23592 raft_consensus.cc:740] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.808193 23592 consensus_queue.cc:260] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.807080 23593 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.814256 23595 tablet_bootstrap.cc:654] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.816154 23592 ts_tablet_manager.cc:1434] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:27.816473 23599 raft_consensus.cc:493] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.817006 23599 raft_consensus.cc:515] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.816210 23698 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.818616 23592 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.818399 23698 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.817878 23593 tablet_bootstrap.cc:654] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.821975 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.818449 23681 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.822685 23547 raft_consensus.cc:2468] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:27.822925 23681 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.823673 23649 consensus_queue.cc:1048] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.825088 23681 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:27.825357 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.826239 23470 raft_consensus.cc:2468] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:27.827929 23288 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:27.828900 23649 raft_consensus.cc:2804] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.829329 23649 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.829695 23649 raft_consensus.cc:3060] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.830219 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.830866 23547 raft_consensus.cc:2468] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:27.832187 23599 leader_election.cc:290] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:27.833559 23437 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:27.833912 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.837412 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5978f4bba84a18982e38633bc2b626" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.833932 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5978f4bba84a18982e38633bc2b626" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:27.838735 23511 leader_election.cc:343] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:27.839494 23511 leader_election.cc:343] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.839864 23681 raft_consensus.cc:2804] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.840405 23681 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.840963 23681 raft_consensus.cc:3060] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.839892 23511 leader_election.cc:304] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.841858 23698 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.828881 23592 tablet_bootstrap.cc:654] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.842971 23599 raft_consensus.cc:2749] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.848349 23593 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.848976 23593 ts_tablet_manager.cc:1403] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 13:09:27.851701 23595 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:27.852218 23595 ts_tablet_manager.cc:1403] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.007s
I20260709 13:09:27.851910 23593 raft_consensus.cc:359] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.852624 23593 raft_consensus.cc:385] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.852950 23593 raft_consensus.cc:740] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.853462 23698 consensus_queue.cc:1048] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.854017 23593 consensus_queue.cc:260] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.841708 23649 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.855021 23595 raft_consensus.cc:359] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.856805 23324 raft_consensus.cc:2393] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:27.858894 23593 ts_tablet_manager.cc:1434] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:09:27.859906 23593 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.859799 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:27.864446 23594 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:27.865119 23594 ts_tablet_manager.cc:1403] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.006s
I20260709 13:09:27.866374 23593 tablet_bootstrap.cc:654] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.870841 23649 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.871071 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:27.871724 23546 raft_consensus.cc:3060] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.874096 23593 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:27.874622 23593 ts_tablet_manager.cc:1403] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:09:27.875173 23681 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.878165 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:27.878189 23593 raft_consensus.cc:359] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.879005 23593 raft_consensus.cc:385] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.879271 23593 raft_consensus.cc:740] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.878535 23469 raft_consensus.cc:2393] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 1: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:27.879942 23594 raft_consensus.cc:359] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.880072 23593 consensus_queue.cc:260] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.880703 23594 raft_consensus.cc:385] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.881029 23594 raft_consensus.cc:740] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.881671 23594 consensus_queue.cc:260] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.883023 23681 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:27.884204 23593 ts_tablet_manager.cc:1434] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:27.884617 23546 raft_consensus.cc:2468] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:27.888619 23673 raft_consensus.cc:493] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.889155 23673 raft_consensus.cc:515] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.855661 23595 raft_consensus.cc:385] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.890169 23595 raft_consensus.cc:740] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.890820 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:27.891347 23673 leader_election.cc:290] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.891347 23595 consensus_queue.cc:260] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.884968 23594 ts_tablet_manager.cc:1434] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:09:27.892891 23592 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:27.891633 23324 raft_consensus.cc:2393] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:27.893416 23592 ts_tablet_manager.cc:1403] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.004s
I20260709 13:09:27.885241 23593 tablet_bootstrap.cc:492] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:27.894354 23594 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:27.895282 23595 ts_tablet_manager.cc:1434] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:09:27.896293 23595 tablet_bootstrap.cc:492] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:27.896669 23592 raft_consensus.cc:359] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.897099 23437 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:27.897367 23592 raft_consensus.cc:385] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.898264 23681 raft_consensus.cc:2749] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.898514 23288 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:27.900043 23673 raft_consensus.cc:493] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.900369 23649 raft_consensus.cc:2804] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.900902 23649 raft_consensus.cc:697] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:27.900573 23673 raft_consensus.cc:515] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.901305 23670 raft_consensus.cc:493] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.901787 23670 raft_consensus.cc:515] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.903816 23670 leader_election.cc:290] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:27.903550 23649 consensus_queue.cc:237] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.904026 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab658aedf74a66805c779a3eb85bbc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.904719 23324 raft_consensus.cc:2468] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.905200 23594 tablet_bootstrap.cc:654] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.905956 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.906051 23363 leader_election.cc:304] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:27.906669 23546 raft_consensus.cc:2468] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.907960 23602 raft_consensus.cc:2804] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.907943 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab658aedf74a66805c779a3eb85bbc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.908521 23602 raft_consensus.cc:493] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.908783 23469 raft_consensus.cc:2468] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.908921 23602 raft_consensus.cc:3060] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.910274 23670 raft_consensus.cc:493] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.911391 23670 raft_consensus.cc:515] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:27.897675 23592 raft_consensus.cc:740] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.921430 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3ba70a274480909cc569cf8886b2" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.922307 23471 raft_consensus.cc:2393] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:27.920818 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.923498 23469 raft_consensus.cc:2468] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.919166 23592 consensus_queue.cc:260] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.924381 23363 leader_election.cc:304] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:27.925141 23593 tablet_bootstrap.cc:654] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.926599 23670 leader_election.cc:290] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.927875 23670 raft_consensus.cc:493] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.930154 23673 leader_election.cc:290] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:27.930714 23673 raft_consensus.cc:2804] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.930780 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.931155 23673 raft_consensus.cc:493] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.931568 23673 raft_consensus.cc:3060] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.931599 23321 raft_consensus.cc:2468] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.928532 23592 ts_tablet_manager.cc:1434] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:09:27.936628 23592 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:27.928325 23670 raft_consensus.cc:515] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:27.945459 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.947189 23546 raft_consensus.cc:2468] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.948293 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3ba70a274480909cc569cf8886b2" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.954209 23595 tablet_bootstrap.cc:654] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.954082 23363 leader_election.cc:304] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:27.957257 23602 raft_consensus.cc:515] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:27.963205 23670 leader_election.cc:290] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:27.967681 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5978f4bba84a18982e38633bc2b626" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.968321 23321 raft_consensus.cc:2468] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.970778 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5978f4bba84a18982e38633bc2b626" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:27.971578 23602 leader_election.cc:290] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:27.971763 23545 raft_consensus.cc:2468] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:27.972339 23599 raft_consensus.cc:493] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.972856 23599 raft_consensus.cc:515] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:27.976989 23592 tablet_bootstrap.cc:654] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.963496 23763 raft_consensus.cc:2804] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.983605 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69488a80b90e4fecb290b1a4249ea436" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:27.980211 23763 raft_consensus.cc:493] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.992146 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69488a80b90e4fecb290b1a4249ea436" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:27.986430 23363 leader_election.cc:304] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
W20260709 13:09:27.993659 23511 leader_election.cc:343] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.994426 23602 raft_consensus.cc:3060] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.986088 23599 leader_election.cc:290] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:27.995437 23513 leader_election.cc:343] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.995946 23513 leader_election.cc:304] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:27.998700 23599 raft_consensus.cc:2749] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.998903 23222 catalog_manager.cc:5697] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.990727 23763 raft_consensus.cc:3060] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:28.004793 23365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 44117.9us
I20260709 13:09:27.990128 23673 raft_consensus.cc:515] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.016064 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab658aedf74a66805c779a3eb85bbc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:28.016673 23469 raft_consensus.cc:3060] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.018965 23673 leader_election.cc:290] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:28.023675 23469 raft_consensus.cc:2468] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.001641 23363 leader_election.cc:304] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:28.025341 23365 leader_election.cc:304] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:28.026407 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab658aedf74a66805c779a3eb85bbc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:28.027513 23321 raft_consensus.cc:3060] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.029309 23592 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:28.029955 23592 ts_tablet_manager.cc:1403] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.017s
I20260709 13:09:28.032112 23670 raft_consensus.cc:2804] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.032725 23670 raft_consensus.cc:697] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:28.033622 23670 consensus_queue.cc:237] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.037602 23673 raft_consensus.cc:2804] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.039835 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:28.038089 23673 raft_consensus.cc:493] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.043692 23545 raft_consensus.cc:3060] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.039831 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:28.023703 23763 raft_consensus.cc:515] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.049046 23322 raft_consensus.cc:3060] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.056176 23592 raft_consensus.cc:359] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.059396 23592 raft_consensus.cc:385] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.060233 23592 raft_consensus.cc:740] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.063256 23602 raft_consensus.cc:2749] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.064311 23321 raft_consensus.cc:2468] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.046504 23673 raft_consensus.cc:3060] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.064340 23595 tablet_bootstrap.cc:492] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:28.067235 23595 ts_tablet_manager.cc:1403] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.005s
I20260709 13:09:28.066485 23592 consensus_queue.cc:260] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.066954 23322 raft_consensus.cc:2468] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.072407 23592 ts_tablet_manager.cc:1434] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:09:28.074383 23599 consensus_queue.cc:1048] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.074932 23592 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:28.076313 23595 raft_consensus.cc:359] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.077092 23595 raft_consensus.cc:385] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.077109 23681 consensus_queue.cc:1048] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.078454 23595 raft_consensus.cc:740] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.079237 23595 consensus_queue.cc:260] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.083911 23594 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:28.084769 23594 ts_tablet_manager.cc:1403] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.191s	user 0.015s	sys 0.016s
I20260709 13:09:28.088024 23681 raft_consensus.cc:493] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.088503 23681 raft_consensus.cc:515] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.090716 23681 leader_election.cc:290] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:28.092350 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
W20260709 13:09:28.093973 23437 leader_election.cc:343] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.096138 23594 raft_consensus.cc:359] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.096940 23594 raft_consensus.cc:385] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.097249 23594 raft_consensus.cc:740] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.097976 23594 consensus_queue.cc:260] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.107894 23363 leader_election.cc:304] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:28.109161 23602 raft_consensus.cc:2804] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.108883 23220 catalog_manager.cc:5697] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.109763 23602 raft_consensus.cc:697] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:28.110762 23594 ts_tablet_manager.cc:1434] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:09:28.111866 23602 consensus_queue.cc:237] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.112926 23594 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:28.114528 23763 leader_election.cc:290] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:28.118618 23593 tablet_bootstrap.cc:492] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:28.119197 23593 ts_tablet_manager.cc:1403] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.234s	user 0.015s	sys 0.017s
I20260709 13:09:28.119743 23595 ts_tablet_manager.cc:1434] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:09:28.121327 23595 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:28.133116 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:28.134233 23469 raft_consensus.cc:3060] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.115381 23673 raft_consensus.cc:515] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.136075 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:28.136794 23547 raft_consensus.cc:3060] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.138638 23545 raft_consensus.cc:2468] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.140208 23681 raft_consensus.cc:493] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.146062 23681 raft_consensus.cc:515] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.142030 23599 consensus_queue.cc:1048] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.130505 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.141652 23593 raft_consensus.cc:359] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.138672 23592 tablet_bootstrap.cc:654] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.148144 23593 raft_consensus.cc:385] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.148481 23593 raft_consensus.cc:740] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.149930 23547 raft_consensus.cc:2468] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.149827 23593 consensus_queue.cc:260] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
W20260709 13:09:28.150828 23437 leader_election.cc:343] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.151288 23437 leader_election.cc:304] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:28.152000 23593 ts_tablet_manager.cc:1434] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:09:28.152139 23681 leader_election.cc:290] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:28.152717 23681 raft_consensus.cc:2749] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.153106 23593 tablet_bootstrap.cc:492] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:28.160759 23673 leader_election.cc:290] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:28.161679 23595 tablet_bootstrap.cc:654] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.182487 23363 leader_election.cc:304] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:28.185411 23673 raft_consensus.cc:2804] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.186169 23673 raft_consensus.cc:697] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:28.186825 23469 raft_consensus.cc:2468] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.188596 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5978f4bba84a18982e38633bc2b626" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:28.189520 23322 raft_consensus.cc:3060] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:28.192833 23772 log.cc:927] Time spent T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:28.203490 23763 consensus_queue.cc:1048] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.204479 23593 tablet_bootstrap.cc:654] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.187361 23673 consensus_queue.cc:237] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.207484 23594 tablet_bootstrap.cc:654] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.210242 23595 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:28.210798 23595 ts_tablet_manager.cc:1403] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.004s
I20260709 13:09:28.213694 23595 raft_consensus.cc:359] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.214438 23595 raft_consensus.cc:385] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.214705 23595 raft_consensus.cc:740] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.224481 23592 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:28.225075 23592 ts_tablet_manager.cc:1403] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.004s
W20260709 13:09:28.225646 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 74849.6us
I20260709 13:09:28.226830 23471 raft_consensus.cc:3060] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.227980 23592 raft_consensus.cc:359] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.228219 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:28.227749 23219 catalog_manager.cc:5697] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.229081 23321 raft_consensus.cc:2393] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:28.229445 23592 raft_consensus.cc:385] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.229815 23592 raft_consensus.cc:740] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.259737 23602 consensus_queue.cc:1048] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.278865 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5978f4bba84a18982e38633bc2b626" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:28.279601 23547 raft_consensus.cc:3060] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.288365 23547 raft_consensus.cc:2468] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.295780 23595 consensus_queue.cc:260] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.296546 23592 consensus_queue.cc:260] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.289652 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.309115 23592 ts_tablet_manager.cc:1434] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 13:09:28.298086 23774 raft_consensus.cc:493] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.320587 23774 raft_consensus.cc:515] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.301370 23363 leader_election.cc:304] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:28.297586 23322 raft_consensus.cc:2468] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.327143 23763 raft_consensus.cc:2804] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.327690 23763 raft_consensus.cc:697] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:28.330305 23595 ts_tablet_manager.cc:1434] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:09:28.334488 23437 leader_election.cc:304] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:28.331736 23595 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:28.336340 23763 consensus_queue.cc:237] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.338848 23774 leader_election.cc:290] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:28.342445 23594 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:28.347536 23594 ts_tablet_manager.cc:1403] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.235s	user 0.008s	sys 0.007s
I20260709 13:09:28.343683 23775 consensus_queue.cc:1048] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.345445 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69488a80b90e4fecb290b1a4249ea436" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:28.348731 23547 raft_consensus.cc:2468] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:28.350103 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69488a80b90e4fecb290b1a4249ea436" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:28.350809 23321 raft_consensus.cc:2468] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:28.352005 23437 leader_election.cc:304] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:28.351858 23594 raft_consensus.cc:359] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.353520 23774 raft_consensus.cc:2804] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.353801 23594 raft_consensus.cc:385] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.353972 23774 raft_consensus.cc:493] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.354131 23594 raft_consensus.cc:740] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.354382 23774 raft_consensus.cc:3060] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.359747 23592 tablet_bootstrap.cc:492] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:28.354892 23594 consensus_queue.cc:260] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.369161 23594 ts_tablet_manager.cc:1434] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:09:28.370273 23594 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:28.372108 23681 raft_consensus.cc:2749] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.377830 23774 raft_consensus.cc:515] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.383694 23602 raft_consensus.cc:493] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.410395 23595 tablet_bootstrap.cc:654] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.396579 23602 raft_consensus.cc:515] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.417101 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69488a80b90e4fecb290b1a4249ea436" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:28.418660 23547 raft_consensus.cc:3060] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.419692 23774 leader_election.cc:290] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:28.424594 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69488a80b90e4fecb290b1a4249ea436" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:28.425299 23602 leader_election.cc:290] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:28.425433 23322 raft_consensus.cc:3060] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.426396 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:28.427726 23544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
W20260709 13:09:28.427893 23365 leader_election.cc:343] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:28.429613 23363 leader_election.cc:343] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.430342 23363 leader_election.cc:304] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:28.435999 23594 tablet_bootstrap.cc:654] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.433291 23763 raft_consensus.cc:2749] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.440070 23593 tablet_bootstrap.cc:492] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:28.440828 23593 ts_tablet_manager.cc:1403] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.288s	user 0.014s	sys 0.008s
I20260709 13:09:28.440614 23220 catalog_manager.cc:5697] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.447178 23592 tablet_bootstrap.cc:654] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.447676 23593 raft_consensus.cc:359] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.448486 23593 raft_consensus.cc:385] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.448750 23593 raft_consensus.cc:740] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.449540 23593 consensus_queue.cc:260] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.452412 23593 ts_tablet_manager.cc:1434] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:28.453388 23593 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:28.455255 23547 raft_consensus.cc:2468] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:28.456521 23437 leader_election.cc:304] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:28.457099 23600 consensus_queue.cc:1048] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.458631 23774 raft_consensus.cc:2804] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.459390 23774 raft_consensus.cc:697] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:28.460553 23774 consensus_queue.cc:237] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.469820 23649 consensus_queue.cc:1048] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.485244 23594 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:28.485244 23595 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:28.485951 23595 ts_tablet_manager.cc:1403] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.003s
I20260709 13:09:28.487433 23322 raft_consensus.cc:2468] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:28.488227 23595 raft_consensus.cc:359] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.488926 23595 raft_consensus.cc:385] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.489147 23595 raft_consensus.cc:740] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.485951 23594 ts_tablet_manager.cc:1403] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.003s
I20260709 13:09:28.489874 23595 consensus_queue.cc:260] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.502516 23595 ts_tablet_manager.cc:1434] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:28.503897 23595 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:28.507443 23593 tablet_bootstrap.cc:654] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.505358 23594 raft_consensus.cc:359] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.509353 23594 raft_consensus.cc:385] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.509690 23594 raft_consensus.cc:740] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.510291 23592 tablet_bootstrap.cc:492] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:28.510608 23733 raft_consensus.cc:493] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.510872 23592 ts_tablet_manager.cc:1403] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.003s
I20260709 13:09:28.510483 23594 consensus_queue.cc:260] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.511191 23733 raft_consensus.cc:515] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.515048 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.515205 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:28.522189 23594 ts_tablet_manager.cc:1434] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:09:28.524784 23471 raft_consensus.cc:2468] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:28.515534 23733 leader_election.cc:290] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
W20260709 13:09:28.524983 23288 leader_election.cc:343] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.527328 23290 leader_election.cc:304] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:28.528719 23733 raft_consensus.cc:2804] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.529158 23733 raft_consensus.cc:493] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.529552 23733 raft_consensus.cc:3060] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:28.530479 23794 log.cc:927] Time spent T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:09:28.531741 23595 tablet_bootstrap.cc:654] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.538085 23599 raft_consensus.cc:493] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.530359 23592 raft_consensus.cc:359] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.538627 23599 raft_consensus.cc:515] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.539011 23592 raft_consensus.cc:385] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.539374 23592 raft_consensus.cc:740] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.539978 23733 raft_consensus.cc:515] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.540187 23592 consensus_queue.cc:260] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.540721 23599 leader_election.cc:290] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:28.524744 23594 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:28.542631 23592 ts_tablet_manager.cc:1434] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:09:28.543056 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:28.543644 23592 tablet_bootstrap.cc:492] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:28.544653 23673 consensus_queue.cc:1048] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.532948 23222 catalog_manager.cc:5697] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.546914 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:28.548856 23594 tablet_bootstrap.cc:654] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:28.548975 23793 log.cc:927] Time spent T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:09:28.550838 23592 tablet_bootstrap.cc:654] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:28.551169 23288 leader_election.cc:343] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.554709 23593 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:28.555217 23593 ts_tablet_manager.cc:1403] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.004s
I20260709 13:09:28.552369 23733 leader_election.cc:290] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:28.560636 23763 consensus_queue.cc:1048] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.560995 23593 raft_consensus.cc:359] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.561573 23594 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:28.561786 23593 raft_consensus.cc:385] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.562130 23593 raft_consensus.cc:740] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.563536 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:28.565706 23511 leader_election.cc:343] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:28.566444 23513 leader_election.cc:343] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.567049 23513 leader_election.cc:304] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:28.567461 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:28.568184 23473 raft_consensus.cc:3060] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.570062 23763 raft_consensus.cc:493] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.570603 23652 raft_consensus.cc:2749] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.562152 23594 ts_tablet_manager.cc:1403] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.038s	user 0.003s	sys 0.008s
I20260709 13:09:28.571727 23593 consensus_queue.cc:260] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.570597 23763 raft_consensus.cc:515] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.575450 23594 raft_consensus.cc:359] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.576187 23594 raft_consensus.cc:385] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.576474 23594 raft_consensus.cc:740] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.577505 23763 leader_election.cc:290] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:28.577164 23594 consensus_queue.cc:260] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.577209 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:28.577098 23652 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.578594 23220 catalog_manager.cc:5697] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.594290 23594 ts_tablet_manager.cc:1434] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:28.596040 23594 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:28.603243 23593 ts_tablet_manager.cc:1434] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:09:28.591745 23652 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.579273 23471 raft_consensus.cc:2468] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:28.611438 23593 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:28.615391 23763 consensus_queue.cc:1048] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.618800 23592 tablet_bootstrap.cc:492] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:28.613438 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:28.619465 23592 ts_tablet_manager.cc:1403] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.004s
I20260709 13:09:28.619544 23733 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.619808 23547 raft_consensus.cc:2468] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:28.620213 23733 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.620966 23365 leader_election.cc:304] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:28.627442 23592 raft_consensus.cc:359] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.630242 23592 raft_consensus.cc:385] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.633680 23733 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:28.634316 23473 raft_consensus.cc:2468] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:28.630575 23592 raft_consensus.cc:740] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.641010 23592 consensus_queue.cc:260] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.643250 23673 raft_consensus.cc:2804] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.648659 23673 raft_consensus.cc:493] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.649078 23673 raft_consensus.cc:3060] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.646449 23290 leader_election.cc:304] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:28.652477 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:28.652841 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.653247 23322 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:28.654170 23594 tablet_bootstrap.cc:654] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.654682 23649 raft_consensus.cc:2804] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.655323 23649 raft_consensus.cc:697] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:28.656267 23649 consensus_queue.cc:237] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.656642 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:28.657418 23547 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:28.658753 23288 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
W20260709 13:09:28.659214 23511 leader_election.cc:343] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.659651 23733 raft_consensus.cc:2804] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.660035 23511 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:28.660837 23592 ts_tablet_manager.cc:1434] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:09:28.661906 23592 tablet_bootstrap.cc:492] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:28.661645 23673 raft_consensus.cc:515] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.662133 23663 raft_consensus.cc:2804] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.648633 23652 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:28.657305 23670 consensus_queue.cc:1048] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.662671 23663 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.667770 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.669480 23663 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.660040 23733 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.671885 23599 raft_consensus.cc:493] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.682502 23599 raft_consensus.cc:515] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.682787 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:28.683490 23473 raft_consensus.cc:3060] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.684692 23599 leader_election.cc:290] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:28.685366 23593 tablet_bootstrap.cc:654] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.688180 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.688923 23399 raft_consensus.cc:2468] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:28.690074 23511 leader_election.cc:304] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
W20260709 13:09:28.679190 23288 leader_election.cc:343] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.694921 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:28.680891 23733 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:28.703104 23513 leader_election.cc:343] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.704674 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:28.705567 23547 raft_consensus.cc:3060] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.698235 23599 raft_consensus.cc:2804] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.718673 23599 raft_consensus.cc:493] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.719194 23599 raft_consensus.cc:3060] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.725778 23595 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:28.726338 23595 ts_tablet_manager.cc:1403] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.016s
I20260709 13:09:28.729652 23663 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.732885 23670 consensus_queue.cc:1048] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.734477 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:28.739573 23473 raft_consensus.cc:2468] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.740765 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:28.741158 23365 leader_election.cc:304] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
W20260709 13:09:28.743017 23511 leader_election.cc:343] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.741595 23733 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.743119 23670 raft_consensus.cc:2804] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.744163 23324 raft_consensus.cc:2393] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:28.743676 23663 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:28.672369 23673 leader_election.cc:290] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:28.729099 23595 raft_consensus.cc:359] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.751317 23594 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:28.752799 23511 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:28.754241 23592 tablet_bootstrap.cc:654] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.754763 23595 raft_consensus.cc:385] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.755442 23594 ts_tablet_manager.cc:1403] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.002s
I20260709 13:09:28.755475 23595 raft_consensus.cc:740] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.756455 23595 consensus_queue.cc:260] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.744213 23670 raft_consensus.cc:697] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:28.737564 23547 raft_consensus.cc:2468] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:28.769994 23595 ts_tablet_manager.cc:1434] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:09:28.770865 23595 tablet_bootstrap.cc:492] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:28.772820 23670 consensus_queue.cc:237] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.776276 23673 consensus_queue.cc:1048] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.762172 23663 raft_consensus.cc:2749] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.783475 23599 raft_consensus.cc:515] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.786525 23599 leader_election.cc:290] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:28.788338 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:28.789497 23399 raft_consensus.cc:3060] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.790719 23733 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:28.791862 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:28.800937 23593 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:28.801493 23593 ts_tablet_manager.cc:1403] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.029s
W20260709 13:09:28.802052 23288 leader_election.cc:343] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.793077 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:28.799513 23594 raft_consensus.cc:359] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:28.803697 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:28.803694 23513 leader_election.cc:343] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.804127 23594 raft_consensus.cc:385] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.804805 23594 raft_consensus.cc:740] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.805501 23594 consensus_queue.cc:260] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.806478 23593 raft_consensus.cc:359] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.807009 23595 tablet_bootstrap.cc:654] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.807202 23593 raft_consensus.cc:385] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.807562 23593 raft_consensus.cc:740] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.807575 23594 ts_tablet_manager.cc:1434] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:09:28.808874 23594 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:28.810734 23733 raft_consensus.cc:493] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.811937 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:28.811317 23733 raft_consensus.cc:515] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.814183 23592 tablet_bootstrap.cc:492] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:28.814894 23592 ts_tablet_manager.cc:1403] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.153s	user 0.009s	sys 0.003s
I20260709 13:09:28.814733 23593 consensus_queue.cc:260] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:28.813915 23547 raft_consensus.cc:2393] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:28.815817 23222 catalog_manager.cc:5697] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.819168 23593 ts_tablet_manager.cc:1434] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:09:28.819299 23288 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:28.821027 23792 raft_consensus.cc:2749] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.823127 23592 raft_consensus.cc:359] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.824075 23592 raft_consensus.cc:385] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.824435 23592 raft_consensus.cc:740] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.825953 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6319916749068ce3850998ab923a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:28.829049 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6319916749068ce3850998ab923a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:28.825273 23592 consensus_queue.cc:260] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
W20260709 13:09:28.831267 23288 leader_election.cc:343] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.832075 23733 leader_election.cc:290] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
W20260709 13:09:28.832849 23290 leader_election.cc:343] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.834451 23592 ts_tablet_manager.cc:1434] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:09:28.837374 23592 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:28.834640 23602 raft_consensus.cc:493] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.838821 23290 leader_election.cc:304] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:28.840098 23594 tablet_bootstrap.cc:654] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.840344 23792 raft_consensus.cc:2749] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.835994 23593 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:28.841125 23602 raft_consensus.cc:515] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.847945 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:28.851965 23363 leader_election.cc:343] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.847935 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:28.854286 23365 leader_election.cc:343] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.848004 23602 leader_election.cc:290] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:28.854765 23365 leader_election.cc:304] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:28.859716 23765 consensus_queue.cc:1048] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.881680 23592 tablet_bootstrap.cc:654] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.866267 23602 raft_consensus.cc:2749] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.912911 23595 tablet_bootstrap.cc:492] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:28.913458 23595 ts_tablet_manager.cc:1403] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.143s	user 0.019s	sys 0.009s
I20260709 13:09:28.916400 23595 raft_consensus.cc:359] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.917080 23595 raft_consensus.cc:385] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.917368 23595 raft_consensus.cc:740] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.918061 23595 consensus_queue.cc:260] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.913467 23399 raft_consensus.cc:2468] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:28.920269 23595 ts_tablet_manager.cc:1434] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:28.922401 23595 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:28.921701 23511 leader_election.cc:304] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:28.924597 23652 raft_consensus.cc:2804] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.925081 23652 raft_consensus.cc:697] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:28.925948 23652 consensus_queue.cc:237] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:28.928762 23593 tablet_bootstrap.cc:654] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.928931 23595 tablet_bootstrap.cc:654] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.925037 23594 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:28.931228 23594 ts_tablet_manager.cc:1403] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.006s
I20260709 13:09:28.941785 23602 consensus_queue.cc:1048] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:28.947068 23594 raft_consensus.cc:359] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.947938 23594 raft_consensus.cc:385] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.948263 23594 raft_consensus.cc:740] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.957193 23775 raft_consensus.cc:493] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.959889 23775 raft_consensus.cc:515] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.963631 23775 leader_election.cc:290] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:28.963464 23774 consensus_queue.cc:1048] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.978996 23593 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:28.979768 23593 ts_tablet_manager.cc:1403] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.012s
I20260709 13:09:28.979038 23592 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:28.982738 23592 ts_tablet_manager.cc:1403] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.146s	user 0.024s	sys 0.000s
I20260709 13:09:28.986759 23592 raft_consensus.cc:359] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:28.990662 23592 raft_consensus.cc:385] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.991201 23592 raft_consensus.cc:740] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.989461 23593 raft_consensus.cc:359] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.993083 23593 raft_consensus.cc:385] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.993688 23593 raft_consensus.cc:740] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.994724 23593 consensus_queue.cc:260] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:28.998430 23595 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:28.968981 23594 consensus_queue.cc:260] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.002676 23595 ts_tablet_manager.cc:1403] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.046s
I20260709 13:09:28.992164 23592 consensus_queue.cc:260] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.007556 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:29.017714 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.018884 23321 raft_consensus.cc:2468] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:29.020362 23592 ts_tablet_manager.cc:1434] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:09:29.023622 23592 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.023993 23437 leader_election.cc:304] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:29.021252 23547 raft_consensus.cc:2468] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:29.028090 23594 ts_tablet_manager.cc:1434] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.003s
I20260709 13:09:29.038553 23592 tablet_bootstrap.cc:654] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.039443 23594 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:29.029361 23593 ts_tablet_manager.cc:1434] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:09:29.044343 23593 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:29.048616 23775 consensus_queue.cc:1048] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.025058 23774 raft_consensus.cc:2804] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.032338 23595 raft_consensus.cc:359] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.050962 23595 raft_consensus.cc:385] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.053198 23595 raft_consensus.cc:740] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.050585 23774 raft_consensus.cc:493] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.054534 23774 raft_consensus.cc:3060] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.054111 23595 consensus_queue.cc:260] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.059509 23595 ts_tablet_manager.cc:1434] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:09:29.059881 23594 tablet_bootstrap.cc:654] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.024528 23222 catalog_manager.cc:5697] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.067240 23592 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.067932 23592 ts_tablet_manager.cc:1403] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.005s
I20260709 13:09:29.068473 23595 tablet_bootstrap.cc:492] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:29.071069 23592 raft_consensus.cc:359] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.071791 23592 raft_consensus.cc:385] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.072096 23592 raft_consensus.cc:740] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.071875 23593 tablet_bootstrap.cc:654] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.072906 23592 consensus_queue.cc:260] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.076835 23592 ts_tablet_manager.cc:1434] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:29.077838 23592 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.083876 23220 catalog_manager.cc:5697] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.085981 23592 tablet_bootstrap.cc:654] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.100196 23593 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:29.111531 23593 ts_tablet_manager.cc:1403] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 13:09:29.097522 23595 tablet_bootstrap.cc:654] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.122711 23593 raft_consensus.cc:359] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.125226 23593 raft_consensus.cc:385] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.126549 23593 raft_consensus.cc:740] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.128510 23593 consensus_queue.cc:260] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.106592 23774 raft_consensus.cc:515] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.103986 23594 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.130743 23594 ts_tablet_manager.cc:1403] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.004s
I20260709 13:09:29.133260 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:29.133916 23546 raft_consensus.cc:3060] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.134142 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:29.133599 23594 raft_consensus.cc:359] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.134728 23594 raft_consensus.cc:385] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.134780 23324 raft_consensus.cc:3060] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.135104 23594 raft_consensus.cc:740] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.135928 23594 consensus_queue.cc:260] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.141906 23594 ts_tablet_manager.cc:1434] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:09:29.146339 23594 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:29.151641 23593 ts_tablet_manager.cc:1434] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:09:29.131995 23774 leader_election.cc:290] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.153632 23324 raft_consensus.cc:2468] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:29.155160 23546 raft_consensus.cc:2468] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:29.156344 23437 leader_election.cc:304] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:29.157415 23594 tablet_bootstrap.cc:654] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.157913 23774 raft_consensus.cc:2804] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.158493 23774 raft_consensus.cc:697] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:29.159282 23774 consensus_queue.cc:237] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.162089 23593 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:29.161505 23652 raft_consensus.cc:493] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.162868 23652 raft_consensus.cc:515] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.164426 23592 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.164999 23592 ts_tablet_manager.cc:1403] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.027s
I20260709 13:09:29.165050 23652 leader_election.cc:290] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:29.167968 23592 raft_consensus.cc:359] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.168210 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:29.170258 23592 raft_consensus.cc:385] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.169036 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.170897 23595 tablet_bootstrap.cc:492] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:29.171101 23592 raft_consensus.cc:740] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.171439 23595 ts_tablet_manager.cc:1403] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.000s
W20260709 13:09:29.170552 23511 leader_election.cc:343] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.172573 23592 consensus_queue.cc:260] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:29.173133 23513 leader_election.cc:343] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.176848 23592 ts_tablet_manager.cc:1434] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:09:29.176901 23513 leader_election.cc:304] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:29.179263 23663 raft_consensus.cc:2749] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.177155 23595 raft_consensus.cc:359] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.180231 23595 raft_consensus.cc:385] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.180534 23595 raft_consensus.cc:740] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.181635 23592 tablet_bootstrap.cc:492] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.181371 23595 consensus_queue.cc:260] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.186097 23595 ts_tablet_manager.cc:1434] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:29.187146 23595 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:29.168504 23593 tablet_bootstrap.cc:654] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.189622 23592 tablet_bootstrap.cc:654] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.195299 23593 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:29.195771 23593 ts_tablet_manager.cc:1403] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:09:29.195899 23592 tablet_bootstrap.cc:492] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.196389 23592 ts_tablet_manager.cc:1403] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:09:29.196687 23219 catalog_manager.cc:5697] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.198873 23592 raft_consensus.cc:359] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.199506 23592 raft_consensus.cc:385] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.199761 23592 raft_consensus.cc:740] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.200585 23592 consensus_queue.cc:260] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.202984 23592 ts_tablet_manager.cc:1434] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:29.205153 23595 tablet_bootstrap.cc:654] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.198683 23593 raft_consensus.cc:359] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.207572 23594 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.208076 23592 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.208287 23594 ts_tablet_manager.cc:1403] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 13:09:29.207860 23593 raft_consensus.cc:385] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.210919 23594 raft_consensus.cc:359] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.211923 23593 raft_consensus.cc:740] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.212271 23594 raft_consensus.cc:385] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.212622 23594 raft_consensus.cc:740] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.213023 23593 consensus_queue.cc:260] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.213272 23594 consensus_queue.cc:260] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.215397 23593 ts_tablet_manager.cc:1434] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:09:29.216208 23602 raft_consensus.cc:493] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.216776 23593 tablet_bootstrap.cc:492] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:29.216713 23602 raft_consensus.cc:515] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.220289 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.220942 23324 raft_consensus.cc:2468] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:29.222523 23363 leader_election.cc:304] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:29.221148 23602 leader_election.cc:290] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.223352 23763 raft_consensus.cc:2804] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.223793 23763 raft_consensus.cc:493] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.224114 23763 raft_consensus.cc:3060] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.224917 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:29.225577 23546 raft_consensus.cc:2468] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:29.226100 23593 tablet_bootstrap.cc:654] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.229856 23602 consensus_queue.cc:1048] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.235483 23592 tablet_bootstrap.cc:654] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.237730 23399 raft_consensus.cc:3060] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.243266 23594 ts_tablet_manager.cc:1434] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:09:29.270735 23774 raft_consensus.cc:493] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.271394 23774 raft_consensus.cc:515] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.250609 23594 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:29.273612 23592 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.274212 23592 ts_tablet_manager.cc:1403] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.011s
I20260709 13:09:29.275009 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:29.276726 23437 leader_election.cc:343] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.277114 23592 raft_consensus.cc:359] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.277936 23592 raft_consensus.cc:385] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.277678 23670 consensus_queue.cc:1048] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.278455 23592 raft_consensus.cc:740] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.279268 23592 consensus_queue.cc:260] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.283113 23774 leader_election.cc:290] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:29.284204 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:29.284849 23547 raft_consensus.cc:2468] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:29.285028 23592 ts_tablet_manager.cc:1434] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:29.286082 23592 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.286288 23437 leader_election.cc:304] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:29.291266 23774 raft_consensus.cc:2804] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.291779 23774 raft_consensus.cc:493] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.292042 23592 tablet_bootstrap.cc:654] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.292327 23774 raft_consensus.cc:3060] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.295208 23594 tablet_bootstrap.cc:654] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.308336 23594 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.308939 23594 ts_tablet_manager.cc:1403] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.001s
I20260709 13:09:29.310388 23733 consensus_queue.cc:1048] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.317830 23602 raft_consensus.cc:493] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.318454 23602 raft_consensus.cc:515] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.320996 23469 raft_consensus.cc:3060] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.322213 23592 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.322728 23592 ts_tablet_manager.cc:1403] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.006s
I20260709 13:09:29.324756 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.325518 23592 raft_consensus.cc:359] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.326411 23592 raft_consensus.cc:385] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.326467 23733 raft_consensus.cc:493] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.327350 23733 raft_consensus.cc:515] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.326781 23592 raft_consensus.cc:740] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.332566 23592 consensus_queue.cc:260] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.312083 23594 raft_consensus.cc:359] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.335847 23594 raft_consensus.cc:385] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.336151 23594 raft_consensus.cc:740] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.345669 23663 raft_consensus.cc:493] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.346310 23663 raft_consensus.cc:515] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.346967 23592 ts_tablet_manager.cc:1434] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:09:29.347931 23592 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.348381 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.350021 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad4e8b8f5534f638a4422cd5668b846" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.351832 23652 raft_consensus.cc:493] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.352372 23652 raft_consensus.cc:515] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.352798 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad4e8b8f5534f638a4422cd5668b846" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.353515 23324 raft_consensus.cc:2468] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:29.341279 23602 leader_election.cc:290] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:29.351269 23594 consensus_queue.cc:260] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.355801 23663 leader_election.cc:290] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.356448 23594 ts_tablet_manager.cc:1434] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:09:29.356945 23733 leader_election.cc:290] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:29.357473 23594 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:29.357857 23513 leader_election.cc:343] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.358587 23592 tablet_bootstrap.cc:654] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.358856 23511 leader_election.cc:304] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:29.359017 23365 leader_election.cc:304] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:29.360793 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:29.361626 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.362434 23472 raft_consensus.cc:2468] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:29.362401 23673 raft_consensus.cc:2749] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:29.364748 23290 leader_election.cc:304] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:29.366025 23792 raft_consensus.cc:2804] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.366457 23792 raft_consensus.cc:493] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.366793 23792 raft_consensus.cc:3060] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.371224 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f5676b2fdd452da0db90b31878da8b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.371488 23599 raft_consensus.cc:2804] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.371991 23599 raft_consensus.cc:493] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.372365 23599 raft_consensus.cc:3060] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:29.372828 23513 leader_election.cc:343] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.374269 23763 raft_consensus.cc:515] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.366031 23594 tablet_bootstrap.cc:654] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.377144 23652 leader_election.cc:290] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.378384 23663 consensus_queue.cc:1048] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.379154 23792 raft_consensus.cc:515] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.380270 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f5676b2fdd452da0db90b31878da8b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.381091 23324 raft_consensus.cc:2468] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:29.381965 23792 leader_election.cc:290] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:29.361722 23398 raft_consensus.cc:2468] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:29.385885 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:29.386610 23398 raft_consensus.cc:3060] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.379879 23774 raft_consensus.cc:515] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.391320 23511 leader_election.cc:304] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:29.392370 23652 raft_consensus.cc:2804] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.392875 23652 raft_consensus.cc:493] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.393293 23652 raft_consensus.cc:3060] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.393728 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
W20260709 13:09:29.395239 23437 leader_election.cc:343] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.397997 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:29.398613 23469 raft_consensus.cc:3060] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.408224 23595 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:29.408962 23595 ts_tablet_manager.cc:1403] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.001s
I20260709 13:09:29.405946 23774 leader_election.cc:290] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:29.405411 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:29.404620 23733 consensus_queue.cc:1048] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:29.417681 23546 raft_consensus.cc:3060] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.422883 23469 raft_consensus.cc:2468] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:29.414954 23663 raft_consensus.cc:493] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.424353 23290 leader_election.cc:304] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:29.424216 23663 raft_consensus.cc:515] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.425892 23649 raft_consensus.cc:2804] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.427205 23546 raft_consensus.cc:2468] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:29.428870 23663 leader_election.cc:290] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:29.428882 23437 leader_election.cc:304] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:29.430301 23652 raft_consensus.cc:515] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.430532 23599 raft_consensus.cc:515] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.432674 23652 leader_election.cc:290] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.433807 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f5676b2fdd452da0db90b31878da8b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:29.434130 23599 leader_election.cc:290] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.435963 23649 raft_consensus.cc:697] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:29.434984 23774 raft_consensus.cc:2804] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:29.444895 23513 leader_election.cc:343] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.444005 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad4e8b8f5534f638a4422cd5668b846" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:29.446422 23602 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.452069 23602 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.453029 23398 raft_consensus.cc:2468] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
W20260709 13:09:29.448509 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 57028us
I20260709 13:09:29.454533 23592 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.455047 23592 ts_tablet_manager.cc:1403] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.000s
I20260709 13:09:29.456022 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c8577f61a841c0aa2491920a13d1af" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:29.456662 23397 raft_consensus.cc:2468] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:29.456918 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f5676b2fdd452da0db90b31878da8b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:29.456956 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c8577f61a841c0aa2491920a13d1af" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.457571 23322 raft_consensus.cc:3060] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.457679 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad4e8b8f5534f638a4422cd5668b846" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:29.458377 23321 raft_consensus.cc:3060] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.462147 23649 consensus_queue.cc:237] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.463951 23322 raft_consensus.cc:2468] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:29.468684 23602 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.470574 23594 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.471325 23594 ts_tablet_manager.cc:1403] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.002s
I20260709 13:09:29.471904 23593 tablet_bootstrap.cc:492] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:29.472463 23593 ts_tablet_manager.cc:1403] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.256s	user 0.033s	sys 0.055s
I20260709 13:09:29.468982 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:29.450682 23774 raft_consensus.cc:697] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:29.477415 23774 consensus_queue.cc:237] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.478510 23546 raft_consensus.cc:3060] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.466349 23763 leader_election.cc:290] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:29.485441 23592 raft_consensus.cc:359] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.486241 23592 raft_consensus.cc:385] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.486763 23592 raft_consensus.cc:740] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.487511 23592 consensus_queue.cc:260] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.489614 23592 ts_tablet_manager.cc:1434] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:09:29.490860 23592 tablet_bootstrap.cc:492] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.487517 23593 raft_consensus.cc:359] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.491592 23593 raft_consensus.cc:385] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.491861 23593 raft_consensus.cc:740] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.496456 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.494760 23593 consensus_queue.cc:260] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.499681 23324 raft_consensus.cc:2393] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:29.496452 23595 raft_consensus.cc:359] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.502252 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:29.505780 23595 raft_consensus.cc:385] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.506768 23595 raft_consensus.cc:740] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.508673 23595 consensus_queue.cc:260] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.512223 23593 ts_tablet_manager.cc:1434] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 13:09:29.514006 23472 raft_consensus.cc:3060] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.516683 23593 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:29.518728 23547 raft_consensus.cc:2393] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:29.524278 23593 tablet_bootstrap.cc:654] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.505410 23321 raft_consensus.cc:2468] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:29.515027 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:29.553416 23472 raft_consensus.cc:2468] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:29.514762 23511 leader_election.cc:304] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
W20260709 13:09:29.556255 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 50464.7us
I20260709 13:09:29.556344 23841 raft_consensus.cc:2804] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.556911 23841 raft_consensus.cc:493] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.557271 23841 raft_consensus.cc:3060] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.557289 23652 consensus_queue.cc:1048] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:29.558125 23511 leader_election.cc:343] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.558350 23595 ts_tablet_manager.cc:1434] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.149s	user 0.007s	sys 0.004s
I20260709 13:09:29.559367 23595 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:29.559183 23511 leader_election.cc:304] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:29.560093 23652 raft_consensus.cc:2804] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.560477 23511 leader_election.cc:304] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:29.560621 23652 raft_consensus.cc:697] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:29.561664 23652 consensus_queue.cc:237] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.563479 23363 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:29.564532 23673 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.564927 23663 raft_consensus.cc:2804] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.565654 23663 raft_consensus.cc:697] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:29.567054 23663 consensus_queue.cc:237] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.565237 23841 raft_consensus.cc:515] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.576277 23546 raft_consensus.cc:2468] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:29.549612 23322 raft_consensus.cc:3060] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.579341 23841 leader_election.cc:290] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:29.584177 23673 raft_consensus.cc:2749] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.594715 23593 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:29.600173 23593 ts_tablet_manager.cc:1403] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.015s
I20260709 13:09:29.601950 23841 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.589716 23763 raft_consensus.cc:493] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.597433 23592 tablet_bootstrap.cc:654] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.605866 23594 raft_consensus.cc:359] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.606480 23594 raft_consensus.cc:385] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.606730 23594 raft_consensus.cc:740] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.607352 23594 consensus_queue.cc:260] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.608225 23763 raft_consensus.cc:515] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.616648 23821 consensus_queue.cc:1048] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.618018 23763 leader_election.cc:290] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:29.604019 23841 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.618827 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.620347 23841 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:29.613075 23593 raft_consensus.cc:359] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.621197 23593 raft_consensus.cc:385] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.621636 23593 raft_consensus.cc:740] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.630453 23594 ts_tablet_manager.cc:1434] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.000s
I20260709 13:09:29.640931 23593 consensus_queue.cc:260] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.590274 23218 catalog_manager.cc:5697] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.633069 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c8577f61a841c0aa2491920a13d1af" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:29.642477 23321 raft_consensus.cc:3060] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.643723 23593 ts_tablet_manager.cc:1434] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:09:29.641775 23594 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:29.648926 23595 tablet_bootstrap.cc:654] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.651909 23593 tablet_bootstrap.cc:492] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:29.633541 23652 raft_consensus.cc:493] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.633945 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c8577f61a841c0aa2491920a13d1af" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:29.654176 23399 raft_consensus.cc:3060] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.661696 23652 raft_consensus.cc:515] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.664309 23652 leader_election.cc:290] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:29.635233 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.635995 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:29.670107 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb4174b82c42e79bc78ce12a770d8e" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:29.671190 23511 leader_election.cc:343] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.638797 23322 raft_consensus.cc:2468] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:29.666396 23594 tablet_bootstrap.cc:654] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:29.672168 23511 leader_election.cc:343] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.672693 23511 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:29.633756 23220 catalog_manager.cc:5697] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.673080 23363 leader_election.cc:304] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:29.667918 23399 raft_consensus.cc:2468] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:29.674232 23763 raft_consensus.cc:2804] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.674784 23763 raft_consensus.cc:697] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:29.667737 23592 tablet_bootstrap.cc:492] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.676101 23321 raft_consensus.cc:2468] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:29.680945 23592 ts_tablet_manager.cc:1403] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.191s	user 0.004s	sys 0.009s
I20260709 13:09:29.675673 23763 consensus_queue.cc:237] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.682063 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb4174b82c42e79bc78ce12a770d8e" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:29.687495 23593 tablet_bootstrap.cc:654] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.681571 23652 raft_consensus.cc:2749] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:29.691483 23511 leader_election.cc:343] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.692195 23511 leader_election.cc:304] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:29.692235 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12c02cddd142b3b1a089058861d718" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:29.693184 23546 raft_consensus.cc:2393] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:29.693121 23652 raft_consensus.cc:2804] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.693718 23652 raft_consensus.cc:697] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:29.694710 23652 consensus_queue.cc:237] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:29.698654 23513 leader_election.cc:343] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.706207 23513 leader_election.cc:304] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:29.707123 23851 raft_consensus.cc:2749] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.708606 23592 raft_consensus.cc:359] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.709719 23592 raft_consensus.cc:385] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.710274 23592 raft_consensus.cc:740] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.723240 23363 leader_election.cc:304] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:29.724385 23855 consensus_queue.cc:1048] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.726193 23673 raft_consensus.cc:3060] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.722021 23592 consensus_queue.cc:260] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.737432 23673 raft_consensus.cc:2749] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.748106 23592 ts_tablet_manager.cc:1434] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:09:29.754225 23595 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:29.761986 23595 ts_tablet_manager.cc:1403] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.018s
I20260709 13:09:29.762014 23593 tablet_bootstrap.cc:492] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:29.762581 23593 ts_tablet_manager.cc:1403] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.000s
I20260709 13:09:29.764839 23595 raft_consensus.cc:359] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.765566 23595 raft_consensus.cc:385] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.765424 23593 raft_consensus.cc:359] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.766108 23595 raft_consensus.cc:740] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.766346 23593 raft_consensus.cc:385] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.766655 23593 raft_consensus.cc:740] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.766816 23595 consensus_queue.cc:260] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.767341 23593 consensus_queue.cc:260] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.769111 23595 ts_tablet_manager.cc:1434] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:29.758181 23220 catalog_manager.cc:5697] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.769903 23593 ts_tablet_manager.cc:1434] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:29.770882 23593 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:29.770282 23220 catalog_manager.cc:5697] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.771819 23220 catalog_manager.cc:5697] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.759325 23594 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.775519 23594 ts_tablet_manager.cc:1403] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.007s
I20260709 13:09:29.777781 23595 tablet_bootstrap.cc:492] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:29.778652 23594 raft_consensus.cc:359] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.779445 23594 raft_consensus.cc:385] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.779762 23594 raft_consensus.cc:740] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.780536 23594 consensus_queue.cc:260] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.781535 23593 tablet_bootstrap.cc:654] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.782891 23594 ts_tablet_manager.cc:1434] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:29.784305 23592 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.784087 23218 catalog_manager.cc:5697] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.793243 23592 tablet_bootstrap.cc:654] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.797398 23594 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:29.800294 23595 tablet_bootstrap.cc:654] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.806396 23594 tablet_bootstrap.cc:654] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.816573 23592 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.817339 23592 ts_tablet_manager.cc:1403] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.001s
I20260709 13:09:29.821467 23592 raft_consensus.cc:359] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.822777 23592 raft_consensus.cc:385] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.823175 23592 raft_consensus.cc:740] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.824820 23592 consensus_queue.cc:260] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.825665 23595 tablet_bootstrap.cc:492] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:29.827782 23592 ts_tablet_manager.cc:1434] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:09:29.828778 23595 ts_tablet_manager.cc:1403] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.021s
I20260709 13:09:29.831741 23594 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.832830 23594 ts_tablet_manager.cc:1403] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 13:09:29.835983 23594 raft_consensus.cc:359] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.836840 23594 raft_consensus.cc:385] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.837220 23594 raft_consensus.cc:740] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.828925 23592 tablet_bootstrap.cc:492] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.838150 23595 raft_consensus.cc:359] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.838989 23595 raft_consensus.cc:385] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.839345 23595 raft_consensus.cc:740] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.840282 23595 consensus_queue.cc:260] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.843070 23595 ts_tablet_manager.cc:1434] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:29.842969 23594 consensus_queue.cc:260] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.844345 23595 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:29.849009 23592 tablet_bootstrap.cc:654] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.851904 23595 tablet_bootstrap.cc:654] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.852195 23594 ts_tablet_manager.cc:1434] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:29.853483 23652 raft_consensus.cc:493] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.862262 23652 raft_consensus.cc:515] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.864619 23592 tablet_bootstrap.cc:492] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:29.864759 23652 leader_election.cc:290] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:29.865406 23592 ts_tablet_manager.cc:1403] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.008s
I20260709 13:09:29.867478 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:29.853502 23594 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:29.869585 23511 leader_election.cc:343] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.870748 23844 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.871130 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.871340 23844 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:29.875734 23511 leader_election.cc:343] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.876399 23511 leader_election.cc:304] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:29.877030 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:29.877878 23547 raft_consensus.cc:2468] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:29.879289 23851 raft_consensus.cc:2749] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.879837 23594 tablet_bootstrap.cc:654] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.885579 23844 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:29.886137 23774 consensus_queue.cc:1048] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.887161 23288 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:29.888126 23844 raft_consensus.cc:2804] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.888550 23844 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.888935 23844 raft_consensus.cc:3060] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.889411 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:29.890961 23288 leader_election.cc:343] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.897070 23595 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:29.897778 23595 ts_tablet_manager.cc:1403] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.002s
I20260709 13:09:29.906522 23821 consensus_queue.cc:1048] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.910203 23592 raft_consensus.cc:359] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.911058 23592 raft_consensus.cc:385] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.911434 23592 raft_consensus.cc:740] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.914027 23592 consensus_queue.cc:260] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:29.917855 23844 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.906548 23594 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:29.920689 23594 ts_tablet_manager.cc:1403] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 13:09:29.924717 23592 ts_tablet_manager.cc:1434] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 13:09:29.927233 23592 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:29.930614 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:29.928555 23844 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:29.931519 23546 raft_consensus.cc:3060] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.932094 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:29.935851 23592 tablet_bootstrap.cc:654] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:29.942924 23288 leader_election.cc:343] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.945086 23546 raft_consensus.cc:2468] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:29.951188 23288 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:29.952553 23844 raft_consensus.cc:2804] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.953249 23844 raft_consensus.cc:697] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:29.954365 23844 consensus_queue.cc:237] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:29.962177 23595 raft_consensus.cc:359] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.966689 23595 raft_consensus.cc:385] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.967034 23595 raft_consensus.cc:740] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.971261 23594 raft_consensus.cc:359] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.971992 23594 raft_consensus.cc:385] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.972244 23594 raft_consensus.cc:740] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.968400 23652 consensus_queue.cc:1048] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:29.972893 23594 consensus_queue.cc:260] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.978528 23663 raft_consensus.cc:493] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.979074 23663 raft_consensus.cc:515] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:29.981211 23663 leader_election.cc:290] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:29.983951 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:29.985808 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ec9a7e5d824314a4743271735fab14" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:29.989341 23322 raft_consensus.cc:2468] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:29.988679 23594 ts_tablet_manager.cc:1434] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:09:29.967675 23595 consensus_queue.cc:260] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:29.990962 23594 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:29.992740 23595 ts_tablet_manager.cc:1434] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 13:09:29.993813 23595 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:30.001286 23511 leader_election.cc:304] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:30.002955 23843 consensus_queue.cc:1048] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.006336 23595 tablet_bootstrap.cc:654] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.008028 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ec9a7e5d824314a4743271735fab14" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.010401 23663 consensus_queue.cc:1048] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.010877 23652 raft_consensus.cc:2804] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.011291 23652 raft_consensus.cc:493] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.011615 23652 raft_consensus.cc:3060] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.012480 23513 leader_election.cc:343] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.017609 23593 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:30.018200 23593 ts_tablet_manager.cc:1403] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.248s	user 0.029s	sys 0.085s
I20260709 13:09:30.020841 23592 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:30.021428 23592 ts_tablet_manager.cc:1403] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.021s
I20260709 13:09:30.024902 23592 raft_consensus.cc:359] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.025902 23592 raft_consensus.cc:385] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.026314 23592 raft_consensus.cc:740] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.027228 23592 consensus_queue.cc:260] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.030002 23592 ts_tablet_manager.cc:1434] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:30.031447 23592 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:30.037166 23843 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.020938 23593 raft_consensus.cc:359] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.038120 23843 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.037320 23469 raft_consensus.cc:3060] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.041241 23843 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.041972 23593 raft_consensus.cc:385] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.042645 23593 raft_consensus.cc:740] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.042771 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.043390 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.043795 23593 consensus_queue.cc:260] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:30.044615 23290 leader_election.cc:343] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.047740 23593 ts_tablet_manager.cc:1434] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 13:09:30.048805 23593 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:30.049403 23843 consensus_queue.cc:1048] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.049993 23673 raft_consensus.cc:493] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.050793 23673 raft_consensus.cc:515] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.052739 23399 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:30.055316 23288 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:30.056623 23792 raft_consensus.cc:2804] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.057101 23792 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.057507 23792 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.061918 23652 raft_consensus.cc:515] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.062923 23763 raft_consensus.cc:493] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.063434 23763 raft_consensus.cc:515] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.063869 23592 tablet_bootstrap.cc:654] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.064782 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ec9a7e5d824314a4743271735fab14" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:30.066813 23594 tablet_bootstrap.cc:654] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.067219 23673 leader_election.cc:290] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.068113 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb4174b82c42e79bc78ce12a770d8e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.068900 23473 raft_consensus.cc:2468] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:30.068948 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6319916749068ce3850998ab923a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.073242 23472 raft_consensus.cc:2468] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:30.073475 23593 tablet_bootstrap.cc:654] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.073268 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ec9a7e5d824314a4743271735fab14" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:30.069535 23763 leader_election.cc:290] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:30.071127 23595 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:30.074940 23595 ts_tablet_manager.cc:1403] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.008s
I20260709 13:09:30.075760 23365 leader_election.cc:304] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:30.076798 23365 leader_election.cc:304] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:30.074337 23321 raft_consensus.cc:3060] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.077665 23602 raft_consensus.cc:2804] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.078034 23652 leader_election.cc:290] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:30.078120 23602 raft_consensus.cc:493] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.079052 23602 raft_consensus.cc:3060] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.081200 23763 raft_consensus.cc:2804] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.081717 23595 raft_consensus.cc:359] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.082715 23595 raft_consensus.cc:385] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.083014 23595 raft_consensus.cc:740] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
W20260709 13:09:30.083688 23513 leader_election.cc:343] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.083642 23595 consensus_queue.cc:260] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.086539 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb4174b82c42e79bc78ce12a770d8e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:30.087231 23546 raft_consensus.cc:2468] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:30.087451 23595 ts_tablet_manager.cc:1434] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:30.095038 23595 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:30.096122 23792 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.082612 23763 raft_consensus.cc:493] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.103430 23763 raft_consensus.cc:3060] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.114167 23673 consensus_queue.cc:1048] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.113586 23652 raft_consensus.cc:493] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.122570 23792 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.128863 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:30.129463 23399 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.129580 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:30.091444 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6319916749068ce3850998ab923a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:30.132877 23322 raft_consensus.cc:2468] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:30.133060 23602 raft_consensus.cc:515] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.127722 23217 catalog_manager.cc:5697] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.136272 23763 raft_consensus.cc:515] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.139880 23399 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:30.141110 23288 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:30.142159 23841 consensus_queue.cc:1048] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.144081 23851 consensus_queue.cc:1048] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.146667 23843 raft_consensus.cc:2804] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:30.147019 23290 leader_election.cc:343] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.147243 23843 raft_consensus.cc:697] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:30.148295 23843 consensus_queue.cc:237] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.123095 23652 raft_consensus.cc:515] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.159148 23593 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:30.159701 23593 ts_tablet_manager.cc:1403] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.111s	user 0.007s	sys 0.004s
I20260709 13:09:30.165175 23673 consensus_queue.cc:1048] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.171156 23652 leader_election.cc:290] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.177616 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.178344 23602 leader_election.cc:290] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.177846 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb4174b82c42e79bc78ce12a770d8e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:30.180001 23472 raft_consensus.cc:3060] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.180101 23593 raft_consensus.cc:359] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.180869 23593 raft_consensus.cc:385] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.181182 23593 raft_consensus.cc:740] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.181874 23593 consensus_queue.cc:260] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.180883 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6319916749068ce3850998ab923a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:30.183911 23593 ts_tablet_manager.cc:1434] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:30.183959 23470 raft_consensus.cc:3060] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.184906 23595 tablet_bootstrap.cc:654] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.184917 23593 tablet_bootstrap.cc:492] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:30.190173 23763 leader_election.cc:290] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:30.167013 23321 raft_consensus.cc:2468] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
W20260709 13:09:30.192265 23513 leader_election.cc:343] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.189358 23472 raft_consensus.cc:2468] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:30.196511 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb4174b82c42e79bc78ce12a770d8e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:30.198611 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.196511 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6319916749068ce3850998ab923a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:30.198235 23547 raft_consensus.cc:3060] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.200476 23320 raft_consensus.cc:3060] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.200922 23511 leader_election.cc:343] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.201522 23511 leader_election.cc:304] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:30.203088 23851 raft_consensus.cc:2749] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.204819 23592 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:30.205889 23592 ts_tablet_manager.cc:1403] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.175s	user 0.041s	sys 0.031s
I20260709 13:09:30.209021 23547 raft_consensus.cc:2468] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:30.211944 23511 leader_election.cc:304] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:30.213130 23592 raft_consensus.cc:359] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.216218 23592 raft_consensus.cc:385] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.214043 23652 raft_consensus.cc:2804] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.218039 23652 raft_consensus.cc:697] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:30.216708 23592 raft_consensus.cc:740] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.220322 23593 tablet_bootstrap.cc:654] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.223214 23363 leader_election.cc:304] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:30.224406 23602 raft_consensus.cc:2804] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.224943 23602 raft_consensus.cc:697] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:30.225812 23602 consensus_queue.cc:237] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.218932 23652 consensus_queue.cc:237] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.227873 23592 consensus_queue.cc:260] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.214658 23320 raft_consensus.cc:2468] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:30.233422 23595 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:30.234241 23595 ts_tablet_manager.cc:1403] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.005s
I20260709 13:09:30.239185 23594 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:30.239712 23594 ts_tablet_manager.cc:1403] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.249s	user 0.009s	sys 0.010s
I20260709 13:09:30.242448 23594 raft_consensus.cc:359] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.243247 23594 raft_consensus.cc:385] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.243505 23594 raft_consensus.cc:740] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.247179 23841 raft_consensus.cc:493] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.244158 23594 consensus_queue.cc:260] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.247761 23841 raft_consensus.cc:515] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.255204 23592 ts_tablet_manager.cc:1434] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.005s
I20260709 13:09:30.262145 23363 leader_election.cc:304] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:30.268632 23763 raft_consensus.cc:2804] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.275841 23599 consensus_queue.cc:1048] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.285243 23470 raft_consensus.cc:2468] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:30.291924 23841 leader_election.cc:290] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.296435 23595 raft_consensus.cc:359] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.303188 23592 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:30.303778 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.305557 23841 consensus_queue.cc:1048] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:30.297487 23595 raft_consensus.cc:385] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.319051 23595 raft_consensus.cc:740] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.307308 23855 raft_consensus.cc:493] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.320039 23595 consensus_queue.cc:260] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.320343 23855 raft_consensus.cc:515] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.321463 23599 raft_consensus.cc:493] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.322027 23599 raft_consensus.cc:515] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.325095 23851 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.326052 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ec9a7e5d824314a4743271735fab14" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:30.330164 23513 leader_election.cc:343] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.330978 23322 raft_consensus.cc:2393] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:30.297179 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:30.333132 23511 leader_election.cc:343] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.333513 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db51fbc97d3442cba36156e9429af61" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.333725 23511 leader_election.cc:304] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:30.300630 23594 ts_tablet_manager.cc:1434] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:09:30.335294 23841 raft_consensus.cc:2749] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.328440 23595 ts_tablet_manager.cc:1434] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 13:09:30.328711 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db51fbc97d3442cba36156e9429af61" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:30.336220 23594 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:30.326776 23599 leader_election.cc:290] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:30.325670 23851 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.337617 23595 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:30.338965 23851 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:30.340104 23511 leader_election.cc:343] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.341777 23855 leader_election.cc:290] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:30.343032 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ec9a7e5d824314a4743271735fab14" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:30.343818 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:30.347052 23511 leader_election.cc:343] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.347074 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.347251 23437 leader_election.cc:304] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
W20260709 13:09:30.348802 23513 leader_election.cc:343] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.362462 23513 leader_election.cc:304] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:30.374267 23763 raft_consensus.cc:697] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:30.388916 23592 tablet_bootstrap.cc:654] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:30.361097 23363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 92884.2us
I20260709 13:09:30.366273 23851 raft_consensus.cc:2749] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:30.390719 23513 leader_election.cc:343] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.393667 23513 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:30.395792 23599 raft_consensus.cc:2749] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.375748 23855 raft_consensus.cc:3060] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.407285 23763 consensus_queue.cc:237] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:30.393069 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 44460.6us
I20260709 13:09:30.440447 23855 raft_consensus.cc:2749] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:30.429536 23365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 140621us
I20260709 13:09:30.446341 23594 tablet_bootstrap.cc:654] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.459508 23595 tablet_bootstrap.cc:654] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.464933 23215 catalog_manager.cc:5697] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.489535 23593 tablet_bootstrap.cc:492] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:30.491464 23593 ts_tablet_manager.cc:1403] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.307s	user 0.013s	sys 0.019s
I20260709 13:09:30.496244 23844 consensus_queue.cc:1048] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.504537 23593 raft_consensus.cc:359] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.505244 23593 raft_consensus.cc:385] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.505530 23593 raft_consensus.cc:740] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.511121 23593 consensus_queue.cc:260] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.514640 23595 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:30.515240 23595 ts_tablet_manager.cc:1403] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.000s
I20260709 13:09:30.520498 23593 ts_tablet_manager.cc:1434] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:09:30.523430 23595 raft_consensus.cc:359] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.523777 23396 raft_consensus.cc:3060] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.524223 23595 raft_consensus.cc:385] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.524570 23595 raft_consensus.cc:740] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.525261 23595 consensus_queue.cc:260] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.527403 23595 ts_tablet_manager.cc:1434] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:30.528359 23595 tablet_bootstrap.cc:492] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:30.531643 23593 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:30.536695 23892 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.537225 23892 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.541208 23595 tablet_bootstrap.cc:654] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.544431 23892 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:30.544879 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:30.545070 23593 tablet_bootstrap.cc:654] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.544993 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:30.545555 23652 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.546083 23652 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.547991 23652 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:30.549858 23843 consensus_queue.cc:1048] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.550582 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.560137 23592 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:30.560621 23592 ts_tablet_manager.cc:1403] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.304s	user 0.009s	sys 0.008s
I20260709 13:09:30.554265 23397 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:30.563282 23511 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:30.563862 23595 tablet_bootstrap.cc:492] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:30.564369 23595 ts_tablet_manager.cc:1403] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.006s
I20260709 13:09:30.564169 23363 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:30.563442 23216 catalog_manager.cc:5697] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.564680 23841 raft_consensus.cc:2804] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:30.565119 23841 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.565465 23841 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.581024 23892 raft_consensus.cc:2749] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:30.583853 23592 raft_consensus.cc:359] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.584610 23592 raft_consensus.cc:385] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.584924 23592 raft_consensus.cc:740] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.585793 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:30.590489 23595 raft_consensus.cc:359] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.591570 23595 raft_consensus.cc:385] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.591928 23595 raft_consensus.cc:740] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.585572 23592 consensus_queue.cc:260] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.593544 23595 consensus_queue.cc:260] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.602645 23592 ts_tablet_manager.cc:1434] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 13:09:30.603973 23592 tablet_bootstrap.cc:492] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:30.586181 23896 raft_consensus.cc:493] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.604990 23841 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.615566 23595 ts_tablet_manager.cc:1434] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:09:30.587419 23320 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:30.614893 23221 catalog_manager.cc:5697] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.616591 23595 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:30.617002 23221 catalog_manager.cc:5697] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.614888 23855 raft_consensus.cc:493] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.621517 23855 raft_consensus.cc:515] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.623538 23855 leader_election.cc:290] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:30.623692 23841 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:30.629647 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:30.630313 23321 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.614282 23896 raft_consensus.cc:515] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.632481 23896 leader_election.cc:290] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:30.633164 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.633879 23471 raft_consensus.cc:2468] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:30.635394 23365 leader_election.cc:304] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:30.636400 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.637001 23399 raft_consensus.cc:2468] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:30.639549 23593 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:30.639279 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:30.639261 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:30.641889 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:30.643658 23437 leader_election.cc:304] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:30.644394 23398 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.645593 23592 tablet_bootstrap.cc:654] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.645877 23774 raft_consensus.cc:2804] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.646276 23774 raft_consensus.cc:493] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.646632 23774 raft_consensus.cc:3060] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.640089 23593 ts_tablet_manager.cc:1403] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.007s
I20260709 13:09:30.650797 23896 raft_consensus.cc:2804] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.651242 23896 raft_consensus.cc:493] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.651572 23896 raft_consensus.cc:3060] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.640173 23547 raft_consensus.cc:2468] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:30.660391 23321 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:30.660225 23593 raft_consensus.cc:359] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.661110 23593 raft_consensus.cc:385] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.657275 23594 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:30.661386 23593 raft_consensus.cc:740] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.662005 23594 ts_tablet_manager.cc:1403] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.326s	user 0.024s	sys 0.019s
I20260709 13:09:30.662228 23593 consensus_queue.cc:260] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.664796 23593 ts_tablet_manager.cc:1434] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.008s
I20260709 13:09:30.666043 23593 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:30.669538 23595 tablet_bootstrap.cc:654] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.664767 23774 raft_consensus.cc:515] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.673177 23843 raft_consensus.cc:493] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.673651 23843 raft_consensus.cc:515] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.674244 23511 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:30.676046 23843 leader_election.cc:290] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.676990 23851 raft_consensus.cc:2804] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.677138 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:30.677573 23851 raft_consensus.cc:697] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:30.678231 23593 tablet_bootstrap.cc:654] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.678432 23851 consensus_queue.cc:237] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:30.682945 23290 leader_election.cc:343] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.685628 23774 leader_election.cc:290] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:30.685401 23896 raft_consensus.cc:515] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.687891 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:30.688540 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:30.695327 23547 raft_consensus.cc:3060] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.688482 23594 raft_consensus.cc:359] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.689455 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.690336 23471 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.690819 23592 tablet_bootstrap.cc:492] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:30.699796 23592 ts_tablet_manager.cc:1403] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.096s	user 0.004s	sys 0.010s
I20260709 13:09:30.696899 23594 raft_consensus.cc:385] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.703540 23594 raft_consensus.cc:740] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.706966 23399 raft_consensus.cc:2393] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:30.705482 23594 consensus_queue.cc:260] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.711129 23652 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.711809 23652 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.713776 23594 ts_tablet_manager.cc:1434] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:09:30.715142 23594 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:30.718582 23547 raft_consensus.cc:2468] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:30.722337 23437 leader_election.cc:304] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:30.723676 23774 raft_consensus.cc:2804] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.724184 23774 raft_consensus.cc:697] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:30.725015 23774 consensus_queue.cc:237] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.731196 23896 leader_election.cc:290] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:30.732167 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:30.729182 23592 raft_consensus.cc:359] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.733091 23592 raft_consensus.cc:385] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:30.732888 23288 leader_election.cc:343] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.732278 23398 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:30.733623 23288 leader_election.cc:304] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:30.735555 23792 raft_consensus.cc:2749] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.738977 23592 raft_consensus.cc:740] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.744938 23652 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:30.746726 23592 consensus_queue.cc:260] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.751370 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:30.751698 23592 ts_tablet_manager.cc:1434] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.003s
I20260709 13:09:30.752170 23547 raft_consensus.cc:2393] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:30.752722 23592 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:30.750928 23844 consensus_queue.cc:1048] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:30.758667 23595 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:30.759861 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.760628 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:30.764525 23511 leader_election.cc:343] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:30.765518 23511 leader_election.cc:343] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.766062 23511 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:30.767627 23652 raft_consensus.cc:2749] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.768643 23595 ts_tablet_manager.cc:1403] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.017s
I20260709 13:09:30.768949 23593 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:30.769903 23593 ts_tablet_manager.cc:1403] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.104s	user 0.030s	sys 0.025s
I20260709 13:09:30.772099 23844 consensus_queue.cc:1048] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.779389 23821 raft_consensus.cc:493] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.779940 23821 raft_consensus.cc:515] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.782207 23821 leader_election.cc:290] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:30.783543 23363 leader_election.cc:304] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:30.785450 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.786273 23396 raft_consensus.cc:2468] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:30.786481 23896 raft_consensus.cc:2749] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.785351 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:30.788106 23437 leader_election.cc:343] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.789422 23437 leader_election.cc:304] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:30.798581 23821 raft_consensus.cc:2804] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.800464 23821 raft_consensus.cc:493] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.800815 23821 raft_consensus.cc:3060] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.801560 23593 raft_consensus.cc:359] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.802398 23593 raft_consensus.cc:385] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.802763 23593 raft_consensus.cc:740] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.803776 23593 consensus_queue.cc:260] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:30.820863 23595 raft_consensus.cc:359] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.821233 23599 consensus_queue.cc:1048] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.822162 23595 raft_consensus.cc:385] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.832122 23594 tablet_bootstrap.cc:654] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.836494 23592 tablet_bootstrap.cc:654] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.836874 23763 consensus_queue.cc:1048] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.845074 23593 ts_tablet_manager.cc:1434] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 13:09:30.822512 23595 raft_consensus.cc:740] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.848671 23593 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:30.847069 23595 consensus_queue.cc:260] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.855720 23821 raft_consensus.cc:515] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:30.857967 23513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 51989us
I20260709 13:09:30.860972 23893 consensus_queue.cc:1048] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:30.861467 23855 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:30.862056 23855 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:30.864532 23595 ts_tablet_manager.cc:1434] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:09:30.865607 23595 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:30.870685 23593 tablet_bootstrap.cc:654] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.871419 23652 consensus_queue.cc:1048] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.876230 23821 leader_election.cc:290] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:30.882509 23595 tablet_bootstrap.cc:654] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.885214 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:30.889957 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:30.890669 23398 raft_consensus.cc:3060] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.891501 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
W20260709 13:09:30.894160 23437 leader_election.cc:343] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.897908 23855 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:30.899128 23594 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:30.900393 23594 ts_tablet_manager.cc:1403] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.185s	user 0.009s	sys 0.015s
I20260709 13:09:30.899061 23215 catalog_manager.cc:5697] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 2, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.908529 23594 raft_consensus.cc:359] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.892809 23217 catalog_manager.cc:5697] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.912632 23594 raft_consensus.cc:385] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.914134 23594 raft_consensus.cc:740] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.923333 23594 consensus_queue.cc:260] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.926342 23594 ts_tablet_manager.cc:1434] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:09:30.927973 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.925081 23855 raft_consensus.cc:493] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.930765 23855 raft_consensus.cc:515] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.933403 23855 leader_election.cc:290] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:30.935729 23437 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:30.944286 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db51fbc97d3442cba36156e9429af61" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:30.945140 23321 raft_consensus.cc:2468] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:30.948336 23594 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:30.954488 23437 leader_election.cc:304] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:30.956168 23821 raft_consensus.cc:2804] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.956714 23821 raft_consensus.cc:493] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.957159 23821 raft_consensus.cc:3060] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.964107 23594 tablet_bootstrap.cc:654] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.976732 23851 raft_consensus.cc:493] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.977281 23851 raft_consensus.cc:515] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:30.977845 23592 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:30.978564 23592 ts_tablet_manager.cc:1403] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.226s	user 0.009s	sys 0.014s
I20260709 13:09:30.979305 23851 leader_election.cc:290] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:30.988585 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:30.989275 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db51fbc97d3442cba36156e9429af61" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:30.990195 23547 raft_consensus.cc:2468] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:30.986279 23889 consensus_queue.cc:1048] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:09:30.991060 23511 leader_election.cc:343] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.982225 23821 raft_consensus.cc:515] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:30.969656 23855 raft_consensus.cc:2749] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:31.013589 23593 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:31.014269 23593 ts_tablet_manager.cc:1403] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.168s	user 0.023s	sys 0.005s
I20260709 13:09:31.021872 23593 raft_consensus.cc:359] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.022668 23593 raft_consensus.cc:385] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.985695 23592 raft_consensus.cc:359] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.022960 23593 raft_consensus.cc:740] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.028262 23821 leader_election.cc:290] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:31.040531 23594 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:31.114949 23594 ts_tablet_manager.cc:1403] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.011s
I20260709 13:09:31.117815 23594 raft_consensus.cc:359] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.118530 23594 raft_consensus.cc:385] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.118814 23594 raft_consensus.cc:740] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.119479 23594 consensus_queue.cc:260] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.024919 23595 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:31.121531 23595 ts_tablet_manager.cc:1403] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.256s	user 0.025s	sys 0.035s
I20260709 13:09:31.122524 23594 ts_tablet_manager.cc:1434] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:31.123508 23594 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:31.124338 23595 raft_consensus.cc:359] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.125051 23595 raft_consensus.cc:385] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.125337 23595 raft_consensus.cc:740] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.025070 23592 raft_consensus.cc:385] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.126601 23592 raft_consensus.cc:740] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.127400 23592 consensus_queue.cc:260] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.129154 23592 ts_tablet_manager.cc:1434] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.004s
I20260709 13:09:31.047564 23398 raft_consensus.cc:2468] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:31.048913 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:31.063511 23843 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.130750 23843 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.131184 23437 leader_election.cc:304] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:31.131696 23398 raft_consensus.cc:1275] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:09:31.132804 23513 leader_election.cc:343] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.133064 23843 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:31.105068 23896 consensus_queue.cc:1048] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.133832 23663 consensus_queue.cc:1048] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.036921 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db51fbc97d3442cba36156e9429af61" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:31.134655 23321 raft_consensus.cc:3060] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.135226 23513 leader_election.cc:304] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:31.136519 23851 raft_consensus.cc:2749] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.139055 23821 raft_consensus.cc:2804] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.126044 23595 consensus_queue.cc:260] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.139652 23821 raft_consensus.cc:697] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
W20260709 13:09:31.110690 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:31.038826 23544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db51fbc97d3442cba36156e9429af61" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:31.139950 23320 raft_consensus.cc:1275] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:31.140439 23544 raft_consensus.cc:3060] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.140704 23821 consensus_queue.cc:237] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.141916 23663 consensus_queue.cc:1048] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.113400 23593 consensus_queue.cc:260] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.146309 23594 tablet_bootstrap.cc:654] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.147107 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:31.149185 23593 ts_tablet_manager.cc:1434] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 13:09:31.151196 23593 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
W20260709 13:09:31.151870 23290 leader_election.cc:343] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.133256 23592 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:31.166963 23595 ts_tablet_manager.cc:1434] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:09:31.168061 23595 tablet_bootstrap.cc:492] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:31.171077 23544 raft_consensus.cc:2468] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:31.175623 23592 tablet_bootstrap.cc:654] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.176146 23437 leader_election.cc:304] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:31.179991 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:31.180365 23774 raft_consensus.cc:2804] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.180936 23774 raft_consensus.cc:697] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:31.180847 23547 raft_consensus.cc:2468] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:31.181893 23774 consensus_queue.cc:237] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.189898 23288 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:31.197834 23844 raft_consensus.cc:2804] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.198313 23844 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.198704 23844 raft_consensus.cc:3060] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.202452 23595 tablet_bootstrap.cc:654] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.211230 23912 consensus_queue.cc:1048] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:31.220690 23594 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:31.221251 23594 ts_tablet_manager.cc:1403] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.017s
I20260709 13:09:31.224159 23594 raft_consensus.cc:359] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.224875 23594 raft_consensus.cc:385] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.225145 23594 raft_consensus.cc:740] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.232335 23595 tablet_bootstrap.cc:492] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:31.232947 23595 ts_tablet_manager.cc:1403] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:09:31.237097 23594 consensus_queue.cc:260] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.241122 23321 raft_consensus.cc:2468] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:31.241446 23594 ts_tablet_manager.cc:1434] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:09:31.254344 23594 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:31.255450 23592 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:31.251346 23844 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.244287 23855 consensus_queue.cc:1048] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.258777 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:31.245056 23595 raft_consensus.cc:359] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:31.259542 23595 raft_consensus.cc:385] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.259868 23595 raft_consensus.cc:740] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
W20260709 13:09:31.260237 23290 leader_election.cc:343] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.261718 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:31.262300 23547 raft_consensus.cc:3060] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.262650 23592 ts_tablet_manager.cc:1403] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.126s	user 0.008s	sys 0.006s
I20260709 13:09:31.260603 23595 consensus_queue.cc:260] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:31.266808 23595 ts_tablet_manager.cc:1434] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:31.267756 23595 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:31.270632 23593 tablet_bootstrap.cc:654] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.272298 23821 raft_consensus.cc:493] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.272106 23592 raft_consensus.cc:359] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.273178 23592 raft_consensus.cc:385] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.272939 23821 raft_consensus.cc:515] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.275298 23821 leader_election.cc:290] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:31.275008 23219 catalog_manager.cc:5697] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.280676 23594 tablet_bootstrap.cc:654] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.273603 23592 raft_consensus.cc:740] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.283416 23592 consensus_queue.cc:260] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.260366 23844 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:31.294539 23547 raft_consensus.cc:2468] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:31.295288 23763 raft_consensus.cc:493] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.298503 23763 raft_consensus.cc:515] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.300642 23763 leader_election.cc:290] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:31.307495 23592 ts_tablet_manager.cc:1434] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:09:31.306986 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:31.309602 23547 raft_consensus.cc:2468] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:31.311365 23363 leader_election.cc:304] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:31.313742 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:31.312507 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:31.314664 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:31.315039 23321 raft_consensus.cc:2468] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:31.315649 23595 tablet_bootstrap.cc:654] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.316080 23763 raft_consensus.cc:2804] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.316533 23763 raft_consensus.cc:493] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.316946 23763 raft_consensus.cc:3060] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:31.320158 23437 leader_election.cc:343] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.324247 23896 raft_consensus.cc:493] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.324819 23896 raft_consensus.cc:515] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.327219 23896 leader_election.cc:290] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:31.328575 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:31.330094 23365 leader_election.cc:343] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:31.332510 23437 leader_election.cc:343] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.332605 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:31.333045 23437 leader_election.cc:304] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:31.333534 23321 raft_consensus.cc:2468] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:31.338444 23363 leader_election.cc:304] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:31.339185 23896 raft_consensus.cc:2804] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.339577 23896 raft_consensus.cc:493] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.339931 23896 raft_consensus.cc:3060] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.340929 23821 raft_consensus.cc:493] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.341420 23821 raft_consensus.cc:515] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:31.343510 23821 leader_election.cc:290] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:31.339949 23774 raft_consensus.cc:2749] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.350710 23288 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:31.354732 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:31.355332 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:31.356757 23593 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:31.357117 23594 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:31.357261 23593 ts_tablet_manager.cc:1403] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.206s	user 0.015s	sys 0.008s
I20260709 13:09:31.357570 23594 ts_tablet_manager.cc:1403] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.020s
I20260709 13:09:31.360234 23593 raft_consensus.cc:359] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.360435 23896 raft_consensus.cc:515] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.344056 23763 raft_consensus.cc:515] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.363731 23599 raft_consensus.cc:493] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.360435 23594 raft_consensus.cc:359] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.364244 23599 raft_consensus.cc:515] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.365015 23763 leader_election.cc:290] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:31.364272 23594 raft_consensus.cc:385] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.365865 23594 raft_consensus.cc:740] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.366220 23599 leader_election.cc:290] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:31.366781 23843 raft_consensus.cc:2804] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.366523 23594 consensus_queue.cc:260] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.367309 23843 raft_consensus.cc:697] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:31.367796 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2845d7f0f10e4626832ab106dc1a747a" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:31.368502 23843 consensus_queue.cc:237] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.369787 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2845d7f0f10e4626832ab106dc1a747a" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:31.369277 23511 leader_election.cc:343] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.370993 23594 ts_tablet_manager.cc:1434] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
W20260709 13:09:31.371480 23511 leader_election.cc:343] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.362651 23593 raft_consensus.cc:385] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.371871 23511 leader_election.cc:304] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:31.372247 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:31.372850 23547 raft_consensus.cc:3060] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.372992 23599 raft_consensus.cc:2749] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:31.373270 23437 leader_election.cc:343] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.374308 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:31.375002 23323 raft_consensus.cc:3060] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.372180 23593 raft_consensus.cc:740] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.378628 23593 consensus_queue.cc:260] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.380057 23547 raft_consensus.cc:2468] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:31.381080 23593 ts_tablet_manager.cc:1434] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:09:31.382815 23363 leader_election.cc:304] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:31.383569 23594 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:31.383915 23889 raft_consensus.cc:2804] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.384948 23593 tablet_bootstrap.cc:492] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:31.385660 23889 raft_consensus.cc:697] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:31.386624 23889 consensus_queue.cc:237] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:31.390269 23437 leader_election.cc:343] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.390731 23437 leader_election.cc:304] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:31.391412 23774 raft_consensus.cc:2749] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.393468 23593 tablet_bootstrap.cc:654] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.397814 23844 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.402424 23844 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.404445 23844 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:31.389555 23323 raft_consensus.cc:2468] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:31.409771 23217 catalog_manager.cc:5697] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.417114 23592 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:31.419175 23595 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:31.420923 23595 ts_tablet_manager.cc:1403] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.153s	user 0.006s	sys 0.015s
I20260709 13:09:31.424669 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:31.425376 23398 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:31.427567 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:31.428160 23547 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:31.429112 23288 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:31.431417 23896 leader_election.cc:290] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:31.434798 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:31.438123 23594 tablet_bootstrap.cc:654] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.439059 23649 raft_consensus.cc:2804] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.443615 23649 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.443964 23649 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.450296 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:31.451200 23321 raft_consensus.cc:3060] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:31.447510 23365 leader_election.cc:343] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.447733 23595 raft_consensus.cc:359] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.454052 23595 raft_consensus.cc:385] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.454433 23595 raft_consensus.cc:740] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.461530 23649 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.467847 23595 consensus_queue.cc:260] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.471851 23649 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:31.472311 23594 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:31.472940 23594 ts_tablet_manager.cc:1403] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.014s
I20260709 13:09:31.473420 23593 tablet_bootstrap.cc:492] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:31.473927 23593 ts_tablet_manager.cc:1403] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.091s	user 0.038s	sys 0.009s
I20260709 13:09:31.475257 23595 ts_tablet_manager.cc:1434] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 13:09:31.476333 23595 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:31.476596 23593 raft_consensus.cc:359] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:31.477301 23593 raft_consensus.cc:385] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.477591 23593 raft_consensus.cc:740] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.476251 23594 raft_consensus.cc:359] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.478109 23594 raft_consensus.cc:385] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.478430 23594 raft_consensus.cc:740] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.478331 23593 consensus_queue.cc:260] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:31.479327 23594 consensus_queue.cc:260] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.480585 23593 ts_tablet_manager.cc:1434] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:31.481001 23592 tablet_bootstrap.cc:654] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.482018 23593 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:31.482024 23594 ts_tablet_manager.cc:1434] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:09:31.542402 23544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:31.551367 23544 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.560257 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:31.561180 23399 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.573827 23595 tablet_bootstrap.cc:654] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.580075 23594 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:31.589181 23399 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:31.607873 23855 consensus_queue.cc:1048] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.611053 23322 raft_consensus.cc:3060] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.616603 23594 tablet_bootstrap.cc:654] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.625712 23913 raft_consensus.cc:493] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.626570 23913 raft_consensus.cc:515] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.626586 23288 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:31.638136 23855 raft_consensus.cc:493] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.639272 23844 raft_consensus.cc:2804] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.638959 23855 raft_consensus.cc:515] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.639906 23844 raft_consensus.cc:697] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:31.641702 23844 consensus_queue.cc:237] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.644994 23855 leader_election.cc:290] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:31.647459 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:31.650132 23437 leader_election.cc:343] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.651239 23913 leader_election.cc:290] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:31.654274 23544 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:31.654387 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:31.659672 23511 leader_election.cc:343] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.663508 23593 tablet_bootstrap.cc:654] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.667405 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:31.668390 23471 raft_consensus.cc:2468] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:31.673429 23649 raft_consensus.cc:493] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.673782 23321 raft_consensus.cc:2468] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:31.674202 23649 raft_consensus.cc:515] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.681933 23595 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:31.684392 23513 leader_election.cc:304] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:31.700937 23595 ts_tablet_manager.cc:1403] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.225s	user 0.015s	sys 0.014s
I20260709 13:09:31.714289 23595 raft_consensus.cc:359] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.689778 23855 consensus_queue.cc:1048] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:09:31.719055 23595 raft_consensus.cc:385] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.721866 23652 raft_consensus.cc:2804] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.722541 23652 raft_consensus.cc:493] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.722981 23652 raft_consensus.cc:3060] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.721935 23544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:31.726675 23649 leader_election.cc:290] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:31.727130 23595 raft_consensus.cc:740] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.727564 23363 leader_election.cc:304] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:31.728758 23896 raft_consensus.cc:2804] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.729434 23896 raft_consensus.cc:697] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:31.731098 23896 consensus_queue.cc:237] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.728081 23595 consensus_queue.cc:260] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.741261 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:31.768126 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:31.773170 23594 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:31.773772 23594 ts_tablet_manager.cc:1403] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.219s	user 0.025s	sys 0.023s
I20260709 13:09:31.777827 23594 raft_consensus.cc:359] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.778736 23594 raft_consensus.cc:385] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.777877 23855 consensus_queue.cc:1048] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.779063 23594 raft_consensus.cc:740] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.780043 23594 consensus_queue.cc:260] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.782109 23594 ts_tablet_manager.cc:1434] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:09:31.783424 23594 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:31.783375 23288 leader_election.cc:304] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:31.785224 23821 consensus_queue.cc:1048] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.790098 23592 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:31.790846 23592 ts_tablet_manager.cc:1403] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.374s	user 0.020s	sys 0.003s
I20260709 13:09:31.792225 23593 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:31.793702 23594 tablet_bootstrap.cc:654] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.798592 23595 ts_tablet_manager.cc:1434] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.097s	user 0.004s	sys 0.006s
I20260709 13:09:31.791180 23652 raft_consensus.cc:515] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.799798 23544 raft_consensus.cc:2393] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:31.800856 23652 leader_election.cc:290] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:31.802860 23595 tablet_bootstrap.cc:492] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:31.804345 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:31.796154 23592 raft_consensus.cc:359] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.807539 23593 ts_tablet_manager.cc:1403] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.326s	user 0.025s	sys 0.009s
I20260709 13:09:31.807269 23437 leader_election.cc:304] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:31.808291 23592 raft_consensus.cc:385] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.812404 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:31.812733 23592 raft_consensus.cc:740] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.816532 23593 raft_consensus.cc:359] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.817405 23593 raft_consensus.cc:385] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.817677 23593 raft_consensus.cc:740] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
W20260709 13:09:31.820858 23511 leader_election.cc:343] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.837440 23595 tablet_bootstrap.cc:654] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.822031 23592 consensus_queue.cc:260] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:31.805184 23469 raft_consensus.cc:3060] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.853066 23593 consensus_queue.cc:260] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.877038 23792 raft_consensus.cc:2749] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:31.884449 23594 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:31.884981 23594 ts_tablet_manager.cc:1403] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.006s
I20260709 13:09:31.919561 23592 ts_tablet_manager.cc:1434] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.005s
I20260709 13:09:31.892252 23215 catalog_manager.cc:5697] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.932752 23889 consensus_queue.cc:1048] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:09:31.957661 23843 raft_consensus.cc:493] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.958283 23843 raft_consensus.cc:515] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:31.960419 23843 leader_election.cc:290] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:31.966853 23594 raft_consensus.cc:359] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.967593 23594 raft_consensus.cc:385] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.967867 23594 raft_consensus.cc:740] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.968461 23593 ts_tablet_manager.cc:1434] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.159s	user 0.010s	sys 0.001s
I20260709 13:09:31.968619 23594 consensus_queue.cc:260] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:31.969820 23593 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:31.976209 23217 catalog_manager.cc:5697] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.978051 23593 tablet_bootstrap.cc:654] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.011292 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:32.013087 23288 leader_election.cc:343] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.021752 23594 ts_tablet_manager.cc:1434] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.136s	user 0.004s	sys 0.006s
I20260709 13:09:32.031620 23592 tablet_bootstrap.cc:492] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:32.041817 23471 raft_consensus.cc:3060] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.047173 23594 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:32.055269 23959 raft_consensus.cc:493] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.076053 23959 raft_consensus.cc:515] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.078896 23959 leader_election.cc:290] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:32.083772 23649 consensus_queue.cc:1048] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.087906 23763 consensus_queue.cc:1048] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:32.091050 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:32.046399 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:32.093489 23470 raft_consensus.cc:2468] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:32.096365 23290 leader_election.cc:304] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:32.051285 23844 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.102504 23844 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.100618 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:32.083603 23469 raft_consensus.cc:2468] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
W20260709 13:09:32.098261 23365 leader_election.cc:343] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.112914 23599 raft_consensus.cc:493] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.113519 23599 raft_consensus.cc:515] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.121834 23513 leader_election.cc:304] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:32.123291 23652 raft_consensus.cc:2804] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.128648 23652 raft_consensus.cc:697] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:32.120077 23649 raft_consensus.cc:2804] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.120730 23545 raft_consensus.cc:2468] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:32.148662 23594 tablet_bootstrap.cc:654] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.150091 23964 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.122651 23843 consensus_queue.cc:1048] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:09:32.134835 23649 raft_consensus.cc:493] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.161681 23652 consensus_queue.cc:237] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:32.153929 23959 raft_consensus.cc:493] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.171454 23595 tablet_bootstrap.cc:492] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:32.172045 23595 ts_tablet_manager.cc:1403] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.372s	user 0.027s	sys 0.017s
I20260709 13:09:32.172657 23663 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.173233 23663 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.163648 23649 raft_consensus.cc:3060] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:32.137151 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 77500.1us
I20260709 13:09:32.177367 23363 leader_election.cc:304] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:32.186976 23592 tablet_bootstrap.cc:654] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.184783 23774 raft_consensus.cc:2749] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.159690 23964 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:32.188846 23599 leader_election.cc:290] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:32.173966 23959 raft_consensus.cc:515] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:32.180580 23889 raft_consensus.cc:2804] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.212299 23844 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:32.204293 23889 raft_consensus.cc:493] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.213999 23663 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
W20260709 13:09:32.234441 23971 log.cc:927] Time spent T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:32.235940 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:32.226539 23889 raft_consensus.cc:3060] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.239218 23595 raft_consensus.cc:359] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.244437 23593 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:32.245227 23593 ts_tablet_manager.cc:1403] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.276s	user 0.009s	sys 0.013s
I20260709 13:09:32.241894 23595 raft_consensus.cc:385] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:32.221437 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 107059us
I20260709 13:09:32.246397 23595 raft_consensus.cc:740] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.250924 23544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:32.252548 23544 raft_consensus.cc:2468] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:32.256111 23288 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:32.250425 23595 consensus_queue.cc:260] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.261971 23792 raft_consensus.cc:2804] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.262396 23792 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.262769 23792 raft_consensus.cc:3060] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.276180 23959 leader_election.cc:290] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
W20260709 13:09:32.281757 23513 leader_election.cc:343] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.282266 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:32.290246 23978 raft_consensus.cc:493] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.291050 23978 raft_consensus.cc:515] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:32.296891 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:32.299331 23964 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:32.311388 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:32.315006 23365 leader_election.cc:343] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.322419 23288 leader_election.cc:343] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.347294 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:32.350646 23649 raft_consensus.cc:515] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:32.351622 23792 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.352945 23649 leader_election.cc:290] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:32.354383 23978 leader_election.cc:290] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
W20260709 13:09:32.354787 23365 consensus_peers.cc:597] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.354352 23792 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:32.361779 23595 ts_tablet_manager.cc:1434] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.189s	user 0.010s	sys 0.000s
I20260709 13:09:32.363349 23595 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:32.376603 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:32.387367 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
W20260709 13:09:32.404603 23363 leader_election.cc:343] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.408833 23363 leader_election.cc:304] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:32.415475 23951 consensus_queue.cc:1048] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:32.419844 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:32.360049 23889 raft_consensus.cc:515] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
W20260709 13:09:32.402436 23288 leader_election.cc:343] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.433473 23288 leader_election.cc:343] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.443925 23593 raft_consensus.cc:359] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.451475 23593 raft_consensus.cc:385] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.453930 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:32.455088 23399 raft_consensus.cc:2393] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:32.457363 23892 consensus_queue.cc:1048] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:09:32.457392 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:32.461207 23592 tablet_bootstrap.cc:492] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:32.461790 23592 ts_tablet_manager.cc:1403] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.445s	user 0.017s	sys 0.014s
I20260709 13:09:32.463972 23594 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:32.464143 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:32.464576 23594 ts_tablet_manager.cc:1403] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.430s	user 0.012s	sys 0.025s
I20260709 13:09:32.464742 23547 raft_consensus.cc:3060] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.465459 23592 raft_consensus.cc:359] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.466375 23592 raft_consensus.cc:385] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.466691 23592 raft_consensus.cc:740] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.467455 23592 consensus_queue.cc:260] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.470764 23592 ts_tablet_manager.cc:1434] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:32.472148 23592 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:32.451788 23593 raft_consensus.cc:740] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.477514 23547 raft_consensus.cc:2468] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:32.469542 23959 raft_consensus.cc:2749] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.520423 23592 tablet_bootstrap.cc:654] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.521235 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:32.522156 23473 raft_consensus.cc:3060] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.524189 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa9aaf0293040738d08bf32226f26d7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:32.525017 23470 raft_consensus.cc:2393] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:32.533895 23889 leader_election.cc:290] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:32.534273 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:32.535144 23321 raft_consensus.cc:2393] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:32.537151 23473 raft_consensus.cc:2468] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:32.543263 23594 raft_consensus.cc:359] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.544037 23594 raft_consensus.cc:385] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.544346 23594 raft_consensus.cc:740] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.544961 23594 consensus_queue.cc:260] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.547508 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:32.515127 23593 consensus_queue.cc:260] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.521961 23980 consensus_queue.cc:1048] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:09:32.566255 23288 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:32.577793 23290 leader_election.cc:304] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:32.579229 23511 leader_election.cc:304] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:32.583931 23595 tablet_bootstrap.cc:654] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.585059 23594 ts_tablet_manager.cc:1434] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.120s	user 0.003s	sys 0.004s
I20260709 13:09:32.593502 23593 ts_tablet_manager.cc:1434] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.348s	user 0.009s	sys 0.000s
I20260709 13:09:32.602957 23988 raft_consensus.cc:2804] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.605101 23976 raft_consensus.cc:3060] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.607131 23544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:32.608093 23544 raft_consensus.cc:3060] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:32.611433 23511 leader_election.cc:343] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.614647 23593 tablet_bootstrap.cc:492] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:32.619540 23964 raft_consensus.cc:493] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.620107 23964 raft_consensus.cc:515] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.620476 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:32.622423 23964 leader_election.cc:290] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:32.622799 23594 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:32.628644 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:32.631588 23437 leader_election.cc:343] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.632722 23511 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:32.633637 23663 raft_consensus.cc:2749] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:32.640866 23365 leader_election.cc:343] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.641150 23290 leader_election.cc:304] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:32.643713 23999 raft_consensus.cc:2804] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.644423 23999 raft_consensus.cc:697] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:32.648823 23594 tablet_bootstrap.cc:654] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.651221 23437 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:32.657666 23964 raft_consensus.cc:2749] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:32.645480 23999 consensus_queue.cc:237] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:32.679560 23593 tablet_bootstrap.cc:654] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.675218 23976 raft_consensus.cc:2749] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.697454 23592 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:32.698231 23592 ts_tablet_manager.cc:1403] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.042s
I20260709 13:09:32.702484 23988 raft_consensus.cc:697] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:32.721773 23544 raft_consensus.cc:2468] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:32.723927 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:32.724699 23538 raft_consensus.cc:2468] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:32.725011 23851 raft_consensus.cc:2749] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.739760 23988 consensus_queue.cc:237] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.756441 23592 raft_consensus.cc:359] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:32.757411 23592 raft_consensus.cc:385] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.757766 23592 raft_consensus.cc:740] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.774572 23896 raft_consensus.cc:493] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.775308 23896 raft_consensus.cc:515] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.777856 23896 leader_election.cc:290] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:32.781195 23592 consensus_queue.cc:260] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:32.780907 23215 catalog_manager.cc:5697] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 1 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.782200 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2845d7f0f10e4626832ab106dc1a747a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:32.782928 23320 raft_consensus.cc:2468] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:32.783151 23592 ts_tablet_manager.cc:1434] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:09:32.784240 23592 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:32.790413 23363 leader_election.cc:304] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:32.791641 23892 raft_consensus.cc:2804] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.792146 23892 raft_consensus.cc:493] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.792591 23892 raft_consensus.cc:3060] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.793973 23851 consensus_queue.cc:1048] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.794291 23363 leader_election.cc:304] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:32.794667 23437 leader_election.cc:304] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:32.795528 23996 raft_consensus.cc:2804] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.796185 23774 raft_consensus.cc:2804] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.796620 23774 raft_consensus.cc:493] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.796953 23774 raft_consensus.cc:3060] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.803524 23595 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:32.804109 23595 ts_tablet_manager.cc:1403] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.441s	user 0.019s	sys 0.007s
I20260709 13:09:32.807179 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2845d7f0f10e4626832ab106dc1a747a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:32.807964 23543 raft_consensus.cc:2468] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:32.796176 23996 raft_consensus.cc:697] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:32.811901 23592 tablet_bootstrap.cc:654] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.812251 23996 consensus_queue.cc:237] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.823541 23595 raft_consensus.cc:359] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:32.827636 23595 raft_consensus.cc:385] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.829397 23851 consensus_queue.cc:1048] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:32.833081 23595 raft_consensus.cc:740] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.840391 23774 raft_consensus.cc:515] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.848461 23595 consensus_queue.cc:260] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:32.854856 23595 ts_tablet_manager.cc:1434] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:09:32.861953 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:32.866814 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:32.867615 23542 raft_consensus.cc:3060] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.874596 23595 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:32.852421 23774 leader_election.cc:290] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
W20260709 13:09:32.878428 23437 leader_election.cc:343] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.878491 23594 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:32.880234 23594 ts_tablet_manager.cc:1403] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.258s	user 0.013s	sys 0.007s
I20260709 13:09:32.881486 23473 raft_consensus.cc:3060] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.883145 23594 raft_consensus.cc:359] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:32.884476 23594 raft_consensus.cc:385] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.894179 23594 raft_consensus.cc:740] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.895537 23593 tablet_bootstrap.cc:492] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:32.898025 23593 ts_tablet_manager.cc:1403] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.284s	user 0.020s	sys 0.018s
I20260709 13:09:32.896960 23595 tablet_bootstrap.cc:654] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.908190 23594 consensus_queue.cc:260] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:32.912185 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.912689 23217 catalog_manager.cc:5697] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.919682 23594 ts_tablet_manager.cc:1434] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:09:32.906973 23892 raft_consensus.cc:515] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:32.910272 23542 raft_consensus.cc:2468] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:32.926409 23437 leader_election.cc:304] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:32.926980 23892 leader_election.cc:290] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:32.927615 23964 raft_consensus.cc:2804] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.928154 23964 raft_consensus.cc:697] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:32.928761 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2845d7f0f10e4626832ab106dc1a747a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:32.930078 23593 raft_consensus.cc:359] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.930831 23593 raft_consensus.cc:385] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.931151 23593 raft_consensus.cc:740] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.929400 23320 raft_consensus.cc:3060] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.928977 23964 consensus_queue.cc:237] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.937851 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2845d7f0f10e4626832ab106dc1a747a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:32.939381 23592 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:32.939633 23542 raft_consensus.cc:3060] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.939946 23592 ts_tablet_manager.cc:1403] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.156s	user 0.004s	sys 0.012s
I20260709 13:09:32.934751 23593 consensus_queue.cc:260] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.945128 23593 ts_tablet_manager.cc:1434] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 13:09:32.960908 23593 tablet_bootstrap.cc:492] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:32.961983 23594 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:32.976523 23652 raft_consensus.cc:493] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.977077 23652 raft_consensus.cc:515] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:32.981544 23592 raft_consensus.cc:359] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:32.983024 23592 raft_consensus.cc:385] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.983265 23592 raft_consensus.cc:740] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.988524 23592 consensus_queue.cc:260] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.022926 23652 leader_election.cc:290] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:33.023808 23592 ts_tablet_manager.cc:1434] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.001s
I20260709 13:09:33.024410 23959 raft_consensus.cc:493] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.025096 23592 tablet_bootstrap.cc:492] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:33.024966 23959 raft_consensus.cc:515] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.028259 23959 leader_election.cc:290] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.030843 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:33.031563 23543 raft_consensus.cc:2468] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:33.033247 23320 raft_consensus.cc:2468] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:33.033532 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:33.034267 23469 raft_consensus.cc:2468] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:33.035529 23365 leader_election.cc:304] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:33.042049 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:33.042774 23472 raft_consensus.cc:2468] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 0.
I20260709 13:09:33.049094 23594 tablet_bootstrap.cc:654] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.046190 23513 leader_election.cc:304] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:33.051533 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:33.057706 23542 raft_consensus.cc:2468] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:33.040529 23959 raft_consensus.cc:2804] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.058898 23959 raft_consensus.cc:493] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.059276 23959 raft_consensus.cc:3060] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.060506 23363 leader_election.cc:304] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:33.060734 23599 raft_consensus.cc:2804] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.061174 23599 raft_consensus.cc:493] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.061431 23997 raft_consensus.cc:2804] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.062130 23997 raft_consensus.cc:697] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:33.062947 23997 consensus_queue.cc:237] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.068184 23592 tablet_bootstrap.cc:654] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.070091 23663 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.070658 23663 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.073163 23663 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:33.074733 23959 raft_consensus.cc:515] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.061488 23599 raft_consensus.cc:3060] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.075954 23394 raft_consensus.cc:2393] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:33.076412 23595 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:33.079305 23595 ts_tablet_manager.cc:1403] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.205s	user 0.019s	sys 0.011s
I20260709 13:09:33.083571 23593 tablet_bootstrap.cc:654] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.086680 23216 catalog_manager.cc:5697] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.089252 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:33.089435 23959 leader_election.cc:290] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.092167 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:33.092760 23471 raft_consensus.cc:3060] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:33.096081 23513 leader_election.cc:343] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.097357 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:33.121897 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:33.129993 23511 leader_election.cc:343] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.131057 23511 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:33.138286 23595 raft_consensus.cc:359] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.141055 23595 raft_consensus.cc:385] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.141317 23595 raft_consensus.cc:740] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.142134 23595 consensus_queue.cc:260] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.135054 23972 raft_consensus.cc:2749] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.142306 23988 consensus_queue.cc:1048] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:33.147253 23594 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:33.147771 23594 ts_tablet_manager.cc:1403] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.012s
I20260709 13:09:33.147989 23595 ts_tablet_manager.cc:1434] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.001s
I20260709 13:09:33.149267 23595 tablet_bootstrap.cc:492] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:33.159205 23594 raft_consensus.cc:359] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.160009 23594 raft_consensus.cc:385] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.160296 23594 raft_consensus.cc:740] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.150012 23471 raft_consensus.cc:2468] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:33.186291 23592 tablet_bootstrap.cc:492] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:33.186863 23592 ts_tablet_manager.cc:1403] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.021s
I20260709 13:09:33.192874 23599 raft_consensus.cc:515] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.193516 23595 tablet_bootstrap.cc:654] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.196485 23543 raft_consensus.cc:2393] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:33.195293 23365 leader_election.cc:304] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:33.199559 23593 tablet_bootstrap.cc:492] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:33.200126 23593 ts_tablet_manager.cc:1403] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.015s
I20260709 13:09:33.201797 23592 raft_consensus.cc:359] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.202513 23592 raft_consensus.cc:385] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.202781 23592 raft_consensus.cc:740] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
W20260709 13:09:33.206152 23288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 44812.4us
I20260709 13:09:33.208902 23997 raft_consensus.cc:2804] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.209769 23997 raft_consensus.cc:697] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:33.210716 23997 consensus_queue.cc:237] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.206481 23594 consensus_queue.cc:260] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.212610 23599 leader_election.cc:290] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:33.213328 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:33.214289 23472 raft_consensus.cc:2393] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
W20260709 13:09:33.218664 23288 consensus_peers.cc:597] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.219468 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:33.219288 23593 raft_consensus.cc:359] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.220055 23593 raft_consensus.cc:385] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.220367 23593 raft_consensus.cc:740] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.219656 23594 ts_tablet_manager.cc:1434] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:09:33.225726 23599 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.226351 23599 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.221410 23511 leader_election.cc:304] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:33.221308 23593 consensus_queue.cc:260] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.230228 23652 raft_consensus.cc:2749] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.208653 23592 consensus_queue.cc:260] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.241529 23594 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:33.242265 23593 ts_tablet_manager.cc:1434] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:09:33.238581 23217 catalog_manager.cc:5697] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.249667 23595 tablet_bootstrap.cc:492] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:33.250761 23595 ts_tablet_manager.cc:1403] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.006s
I20260709 13:09:33.243083 23951 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.252091 23951 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:33.261168 23288 consensus_peers.cc:597] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.264649 23951 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.265631 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:33.266310 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:33.267869 23290 leader_election.cc:343] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.266458 23542 raft_consensus.cc:2468] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:33.269076 23217 catalog_manager.cc:5697] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.273372 23595 raft_consensus.cc:359] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.274214 23595 raft_consensus.cc:385] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.274539 23595 raft_consensus.cc:740] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.275192 23595 consensus_queue.cc:260] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.277434 23595 ts_tablet_manager.cc:1434] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.000s
I20260709 13:09:33.278296 23592 ts_tablet_manager.cc:1434] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.002s
I20260709 13:09:33.265548 23594 tablet_bootstrap.cc:654] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.282287 23592 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03: Bootstrap starting.
I20260709 13:09:33.289283 23592 tablet_bootstrap.cc:654] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.293073 23593 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:33.294291 23594 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:33.295478 23594 ts_tablet_manager.cc:1403] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.003s
I20260709 13:09:33.299638 23594 raft_consensus.cc:359] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.318169 23594 raft_consensus.cc:385] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.318658 23594 raft_consensus.cc:740] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.319276 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:33.322398 23594 consensus_queue.cc:260] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.324560 23594 ts_tablet_manager.cc:1434] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:09:33.321471 23288 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:33.325428 23999 raft_consensus.cc:2804] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.308506 23216 catalog_manager.cc:5697] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.325845 23999 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.311259 23599 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:33.328912 23999 raft_consensus.cc:3060] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.313678 23593 tablet_bootstrap.cc:654] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.313637 23595 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:33.331796 23321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
W20260709 13:09:33.333391 23513 leader_election.cc:343] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.336905 23999 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.343365 23321 raft_consensus.cc:2393] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:33.337684 23595 tablet_bootstrap.cc:654] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.347610 23959 consensus_queue.cc:1048] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.337637 23951 raft_consensus.cc:493] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.349148 23999 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.349257 23959 raft_consensus.cc:493] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.340570 23592 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03: No bootstrap required, opened a new log
I20260709 13:09:33.350747 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:33.353173 23959 raft_consensus.cc:515] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.353816 23592 ts_tablet_manager.cc:1403] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.031s
I20260709 13:09:33.351655 23511 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:33.356271 23959 leader_election.cc:290] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.356679 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:33.358183 23290 leader_election.cc:343] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.358865 23599 raft_consensus.cc:3060] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.359828 23979 raft_consensus.cc:493] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.360065 23365 consensus_peers.cc:597] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.360436 23979 raft_consensus.cc:515] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.349263 23951 raft_consensus.cc:515] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.362836 23979 leader_election.cc:290] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.363397 23951 leader_election.cc:290] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:33.363691 23592 raft_consensus.cc:359] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.364692 23592 raft_consensus.cc:385] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.365046 23592 raft_consensus.cc:740] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.365118 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:33.365958 23592 consensus_queue.cc:260] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.366987 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:33.369228 23437 leader_election.cc:343] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.369509 23592 ts_tablet_manager.cc:1434] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
W20260709 13:09:33.370608 23290 leader_election.cc:343] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.372344 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:33.374627 23976 consensus_queue.cc:1048] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.378155 23397 raft_consensus.cc:2468] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:33.376780 23979 consensus_queue.cc:1048] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.379747 23288 leader_election.cc:304] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:33.340202 23594 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:33.383728 23976 raft_consensus.cc:2804] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.384204 23976 raft_consensus.cc:493] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.384577 23976 raft_consensus.cc:3060] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.382725 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:33.391512 23215 catalog_manager.cc:5697] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.393920 23215 catalog_manager.cc:5697] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.395920 23215 catalog_manager.cc:5697] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.398762 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:33.399904 23540 raft_consensus.cc:2393] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 1: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:33.405496 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:33.406307 23540 raft_consensus.cc:2468] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 0.
I20260709 13:09:33.421330 23398 raft_consensus.cc:3060] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.424157 23363 leader_election.cc:304] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:33.430462 23437 leader_election.cc:304] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:33.431622 23999 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.432401 23999 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.435212 23959 raft_consensus.cc:2749] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.435249 23999 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.437987 23964 raft_consensus.cc:2804] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.438439 23964 raft_consensus.cc:493] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.438868 23964 raft_consensus.cc:3060] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.443069 23594 tablet_bootstrap.cc:654] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.447029 23593 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:33.447535 23593 ts_tablet_manager.cc:1403] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.026s
I20260709 13:09:33.450296 23593 raft_consensus.cc:359] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.450974 23593 raft_consensus.cc:385] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.450866 23964 raft_consensus.cc:515] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.451246 23976 raft_consensus.cc:515] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.454519 23979 consensus_queue.cc:1048] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.451359 23593 raft_consensus.cc:740] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.473796 23964 leader_election.cc:290] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.460125 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:33.475418 23468 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:33.474375 23593 consensus_queue.cc:260] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.477247 23599 raft_consensus.cc:2749] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.479001 23593 ts_tablet_manager.cc:1434] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:09:33.481418 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:33.482144 23546 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:33.460090 23594 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:33.483167 23594 ts_tablet_manager.cc:1403] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.143s	user 0.009s	sys 0.010s
I20260709 13:09:33.469023 23595 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:33.496693 23595 ts_tablet_manager.cc:1403] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.045s
I20260709 13:09:33.486931 23593 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:33.503475 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:33.489811 23594 raft_consensus.cc:359] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.505919 23594 raft_consensus.cc:385] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.506238 23594 raft_consensus.cc:740] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.507771 23288 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:33.508116 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:33.509073 23951 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.513504 23951 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.513938 23951 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.488996 23976 leader_election.cc:290] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:33.493314 23543 raft_consensus.cc:2468] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:33.494629 23984 raft_consensus.cc:493] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.519285 23984 raft_consensus.cc:515] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.495416 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:33.520371 23398 raft_consensus.cc:3060] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.521332 23594 consensus_queue.cc:260] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.521445 23984 leader_election.cc:290] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:33.509516 23437 leader_election.cc:343] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.518661 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:33.534425 23542 raft_consensus.cc:3060] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.542510 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff5bda8d894486ca77e2e65f89c0494" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:33.543462 23322 raft_consensus.cc:2468] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:33.551914 23363 leader_election.cc:304] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:33.553287 23996 raft_consensus.cc:2804] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.553689 23996 raft_consensus.cc:493] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.554067 23996 raft_consensus.cc:3060] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.499735 23595 raft_consensus.cc:359] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.555756 23595 raft_consensus.cc:385] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.559947 23595 raft_consensus.cc:740] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.560775 23595 consensus_queue.cc:260] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.561926 23468 raft_consensus.cc:3060] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.550868 23398 raft_consensus.cc:2468] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
W20260709 13:09:33.588935 23288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 56652.3us
I20260709 13:09:33.591089 23288 leader_election.cc:304] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:33.592443 23792 raft_consensus.cc:2804] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.609642 23593 tablet_bootstrap.cc:654] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:33.615275 24031 log.cc:927] Time spent T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: Append to log took a long time: real 0.061s	user 0.004s	sys 0.007s
I20260709 13:09:33.616242 23594 ts_tablet_manager.cc:1434] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.000s
I20260709 13:09:33.592599 23288 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:33.624758 23542 raft_consensus.cc:2468] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:33.626637 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff5bda8d894486ca77e2e65f89c0494" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:33.628474 23546 raft_consensus.cc:2468] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 0.
I20260709 13:09:33.638243 23999 raft_consensus.cc:2804] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.644137 23999 raft_consensus.cc:697] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:33.647464 23999 consensus_queue.cc:237] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:33.628957 24030 log.cc:927] Time spent T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: Append to log took a long time: real 0.074s	user 0.002s	sys 0.009s
I20260709 13:09:33.642601 23792 raft_consensus.cc:697] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:33.659672 23437 leader_election.cc:304] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:33.662432 23964 raft_consensus.cc:2804] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.663023 23964 raft_consensus.cc:697] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:33.664023 23964 consensus_queue.cc:237] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.665611 23951 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.671396 23594 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:33.682060 23792 consensus_queue.cc:237] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.692786 23468 raft_consensus.cc:2468] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:33.699015 23951 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:33.701860 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:33.702580 23471 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.713603 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:33.714394 23542 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.712952 23996 raft_consensus.cc:515] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.720644 23984 consensus_queue.cc:1048] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.724295 23595 ts_tablet_manager.cc:1434] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.227s	user 0.006s	sys 0.003s
I20260709 13:09:33.725446 23595 tablet_bootstrap.cc:492] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:33.728801 23471 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:33.729842 23995 consensus_queue.cc:1048] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.730314 23290 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:33.731282 23999 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.761438 23546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff5bda8d894486ca77e2e65f89c0494" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:33.762131 23546 raft_consensus.cc:3060] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.761996 23999 raft_consensus.cc:697] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:33.772895 23959 consensus_queue.cc:1048] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.774050 23999 consensus_queue.cc:237] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:33.799085 23595 tablet_bootstrap.cc:654] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.801241 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff5bda8d894486ca77e2e65f89c0494" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:33.801921 23322 raft_consensus.cc:3060] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.804181 23594 tablet_bootstrap.cc:654] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.788902 23996 leader_election.cc:290] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:33.791754 23542 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:33.804243 23215 catalog_manager.cc:5697] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.815691 23996 consensus_queue.cc:1048] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.843919 23593 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:33.844153 23546 raft_consensus.cc:2468] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:33.847543 23363 leader_election.cc:304] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:33.848529 23984 raft_consensus.cc:2804] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.849085 23984 raft_consensus.cc:697] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:33.849984 23984 consensus_queue.cc:237] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.859952 23322 raft_consensus.cc:2468] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:33.843942 23219 catalog_manager.cc:5697] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.844552 23593 ts_tablet_manager.cc:1403] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.358s	user 0.021s	sys 0.003s
I20260709 13:09:33.900033 23595 tablet_bootstrap.cc:492] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:33.900549 23595 ts_tablet_manager.cc:1403] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.175s	user 0.026s	sys 0.009s
I20260709 13:09:33.904853 23595 raft_consensus.cc:359] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.905542 23595 raft_consensus.cc:385] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.905865 23595 raft_consensus.cc:740] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.908697 23593 raft_consensus.cc:359] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.909451 23593 raft_consensus.cc:385] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.909724 23593 raft_consensus.cc:740] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.911327 23594 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: No bootstrap required, opened a new log
I20260709 13:09:33.911900 23594 ts_tablet_manager.cc:1403] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.243s	user 0.029s	sys 0.009s
I20260709 13:09:33.912061 23595 consensus_queue.cc:260] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:33.926047 23594 raft_consensus.cc:359] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.927101 23594 raft_consensus.cc:385] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.927380 23594 raft_consensus.cc:740] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.928036 23594 consensus_queue.cc:260] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:33.932099 23594 ts_tablet_manager.cc:1434] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:09:33.931509 23215 catalog_manager.cc:5697] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.935864 23595 ts_tablet_manager.cc:1434] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:09:33.937126 23595 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:33.928113 23593 consensus_queue.cc:260] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:33.943482 23595 tablet_bootstrap.cc:654] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.943815 23593 ts_tablet_manager.cc:1434] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:09:33.948267 23593 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:33.952167 23216 catalog_manager.cc:5697] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.953860 23216 catalog_manager.cc:5697] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.968101 23593 tablet_bootstrap.cc:654] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.981293 23595 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:33.981871 23595 ts_tablet_manager.cc:1403] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.009s
I20260709 13:09:33.991741 23595 raft_consensus.cc:359] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:34.001422 23595 raft_consensus.cc:385] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.001775 23595 raft_consensus.cc:740] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.002527 23595 consensus_queue.cc:260] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:34.005349 23593 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:34.005934 23593 ts_tablet_manager.cc:1403] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.006s
I20260709 13:09:34.006292 23595 ts_tablet_manager.cc:1434] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:34.008268 23595 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60: Bootstrap starting.
I20260709 13:09:34.008675 23593 raft_consensus.cc:359] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.009404 23593 raft_consensus.cc:385] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.009671 23593 raft_consensus.cc:740] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.010344 23593 consensus_queue.cc:260] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.019948 23979 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.020730 23595 tablet_bootstrap.cc:654] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.020493 23979 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:34.022732 23979 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:34.024654 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:34.024720 23593 ts_tablet_manager.cc:1434] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:09:34.031283 23593 tablet_bootstrap.cc:492] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:34.033443 23595 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60: No bootstrap required, opened a new log
I20260709 13:09:34.034062 23595 ts_tablet_manager.cc:1403] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 13:09:34.037256 23593 tablet_bootstrap.cc:654] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.037233 23595 raft_consensus.cc:359] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.038349 23595 raft_consensus.cc:385] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.038867 23595 raft_consensus.cc:740] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.039991 23595 consensus_queue.cc:260] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.045491 23595 ts_tablet_manager.cc:1434] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:34.049204 23593 tablet_bootstrap.cc:492] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:34.049813 23593 ts_tablet_manager.cc:1403] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:09:34.053202 23593 raft_consensus.cc:359] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:34.054131 23593 raft_consensus.cc:385] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.054381 23999 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.054392 23593 raft_consensus.cc:740] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.054996 23999 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.055294 23593 consensus_queue.cc:260] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:34.056856 23593 ts_tablet_manager.cc:1434] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:34.057132 23999 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:34.057917 23593 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: Bootstrap starting.
I20260709 13:09:34.058907 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:34.059540 23468 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 0.
I20260709 13:09:34.060784 23290 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:34.061647 23999 raft_consensus.cc:2804] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.062067 23999 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.061877 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:34.062871 23540 raft_consensus.cc:2393] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 1: Already voted for candidate 9dd2728dca8a44f79946d0da19b32c53 in this term.
I20260709 13:09:34.062670 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:34.063596 23999 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.064378 23593 tablet_bootstrap.cc:654] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:34.064523 23288 leader_election.cc:343] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.071229 23437 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:34.072896 23964 raft_consensus.cc:3060] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.077153 23593 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: No bootstrap required, opened a new log
I20260709 13:09:34.077795 23593 ts_tablet_manager.cc:1403] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.018s
I20260709 13:09:34.080523 23593 raft_consensus.cc:359] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.081169 23593 raft_consensus.cc:385] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.081414 23593 raft_consensus.cc:740] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.082271 23593 consensus_queue.cc:260] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.083999 23593 ts_tablet_manager.cc:1434] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:34.091320 23979 consensus_queue.cc:1048] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:34.094080 23269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:34.096491 23964 raft_consensus.cc:2749] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.097960 23844 consensus_queue.cc:1048] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.099706 23999 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.101842 23999 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:34.105304 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:34.106114 23397 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.108450 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:34.109138 23471 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.119015 23471 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:34.126255 23290 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:34.127341 23999 raft_consensus.cc:2804] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.127976 23999 raft_consensus.cc:697] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:34.128947 23398 raft_consensus.cc:3060] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.129783 23999 consensus_queue.cc:237] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:34.137703 23979 consensus_queue.cc:1048] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.133404 23397 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 1.
I20260709 13:09:34.147014 24038 consensus_queue.cc:1048] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.188308 23217 catalog_manager.cc:5697] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.223913 23999 consensus_queue.cc:1048] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.226341 23397 raft_consensus.cc:3060] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.237519 23984 consensus_queue.cc:1048] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.238299 24040 consensus_queue.cc:1048] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.257515 24040 consensus_queue.cc:1048] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.273593 23959 consensus_queue.cc:1048] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.292886 23964 raft_consensus.cc:493] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.293504 23964 raft_consensus.cc:515] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:34.311865 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:34.314083 23964 leader_election.cc:290] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:34.321898 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b429b743f704b32ab6f8ee57f5bd163" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:34.329519 23437 leader_election.cc:304] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:34.330665 23979 raft_consensus.cc:2749] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.334769 23792 consensus_queue.cc:1048] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.394276 23996 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.394829 23996 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:34.396703 23996 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:34.397152 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:34.397652 23320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:34.399415 23363 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:34.400346 23997 raft_consensus.cc:2749] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.402392 23468 raft_consensus.cc:3060] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.428333 23397 raft_consensus.cc:3060] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.617285 23792 consensus_queue.cc:1048] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.641204 24040 consensus_queue.cc:1048] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.649135 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
W20260709 13:09:34.653834 23363 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:34.664961 23363 consensus_peers.cc:597] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.676697 23511 consensus_peers.cc:597] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.701711 23363 consensus_peers.cc:597] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.715226 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:34.716202 14516 tablet_replica.cc:333] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.718851 14516 raft_consensus.cc:2243] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.719905 14516 raft_consensus.cc:2272] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.722744 14516 tablet_replica.cc:333] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.723605 14516 raft_consensus.cc:2243] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.724687 14516 raft_consensus.cc:2272] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.727612 14516 tablet_replica.cc:333] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
W20260709 13:09:34.728225 23437 consensus_peers.cc:597] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.728425 14516 raft_consensus.cc:2243] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.728996 14516 raft_consensus.cc:2272] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.729743 23363 consensus_peers.cc:597] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.731709 14516 tablet_replica.cc:333] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.732759 14516 raft_consensus.cc:2243] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.734364 14516 raft_consensus.cc:2272] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.735776 23511 consensus_peers.cc:597] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.737340 14516 tablet_replica.cc:333] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.738324 14516 raft_consensus.cc:2243] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.738814 14516 raft_consensus.cc:2272] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.741519 14516 tablet_replica.cc:333] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.742488 14516 raft_consensus.cc:2243] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.743427 14516 raft_consensus.cc:2272] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.746065 14516 tablet_replica.cc:333] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.746999 14516 raft_consensus.cc:2243] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.747502 14516 raft_consensus.cc:2272] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.748296 23363 consensus_peers.cc:597] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.749454 23511 consensus_peers.cc:597] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.750278 14516 tablet_replica.cc:333] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.751279 14516 raft_consensus.cc:2243] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.752300 14516 raft_consensus.cc:2272] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.752465 23363 consensus_peers.cc:597] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.754477 14516 tablet_replica.cc:333] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.755373 14516 raft_consensus.cc:2243] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.755905 14516 raft_consensus.cc:2272] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.758206 14516 tablet_replica.cc:333] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.758769 14516 raft_consensus.cc:2243] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.759141 14516 raft_consensus.cc:2272] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.761375 14516 tablet_replica.cc:333] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.762138 14516 raft_consensus.cc:2243] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.762591 14516 raft_consensus.cc:2272] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.764539 14516 tablet_replica.cc:333] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.765185 14516 raft_consensus.cc:2243] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.765616 14516 raft_consensus.cc:2272] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.767773 14516 tablet_replica.cc:333] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.768469 14516 raft_consensus.cc:2243] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.768916 14516 raft_consensus.cc:2272] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.771060 14516 tablet_replica.cc:333] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.771776 14516 raft_consensus.cc:2243] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.772557 14516 raft_consensus.cc:2272] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.774989 14516 tablet_replica.cc:333] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.775542 14516 raft_consensus.cc:2243] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.776027 14516 raft_consensus.cc:2272] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.778075 14516 tablet_replica.cc:333] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.778628 14516 raft_consensus.cc:2243] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.779042 14516 raft_consensus.cc:2272] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.780702 14516 tablet_replica.cc:333] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.781296 14516 raft_consensus.cc:2243] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.781726 14516 raft_consensus.cc:2272] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.784559 14516 tablet_replica.cc:333] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.785344 14516 raft_consensus.cc:2243] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.786486 14516 raft_consensus.cc:2272] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.786878 23363 consensus_peers.cc:597] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.787093 23437 consensus_peers.cc:597] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.788625 14516 tablet_replica.cc:333] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.789368 14516 raft_consensus.cc:2243] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.789891 14516 raft_consensus.cc:2272] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.791951 14516 tablet_replica.cc:333] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.792626 14516 raft_consensus.cc:2243] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.793124 14516 raft_consensus.cc:2272] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.795421 14516 tablet_replica.cc:333] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.795987 14516 raft_consensus.cc:2243] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.796800 14516 raft_consensus.cc:2272] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.799094 14516 tablet_replica.cc:333] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.799634 14516 raft_consensus.cc:2243] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.800081 14516 raft_consensus.cc:2272] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.802237 14516 tablet_replica.cc:333] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.802788 14516 raft_consensus.cc:2243] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.803293 14516 raft_consensus.cc:2272] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.805730 14516 tablet_replica.cc:333] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.806357 14516 raft_consensus.cc:2243] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.807533 14516 raft_consensus.cc:2272] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.810045 14516 tablet_replica.cc:333] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.810804 14516 raft_consensus.cc:2243] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.811425 14516 raft_consensus.cc:2272] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.813267 23363 consensus_peers.cc:597] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.814162 14516 tablet_replica.cc:333] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.815004 14516 raft_consensus.cc:2243] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.815972 14516 raft_consensus.cc:2272] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.816602 23511 consensus_peers.cc:597] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.818166 14516 tablet_replica.cc:333] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.818861 14516 raft_consensus.cc:2243] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.819250 14516 raft_consensus.cc:2272] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.821228 14516 tablet_replica.cc:333] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.821781 14516 raft_consensus.cc:2243] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.822480 14516 raft_consensus.cc:2272] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.825718 14516 tablet_replica.cc:333] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.826529 14516 raft_consensus.cc:2243] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.827555 14516 raft_consensus.cc:2272] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.830430 14516 tablet_replica.cc:333] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.831058 14516 raft_consensus.cc:2243] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.831847 14516 raft_consensus.cc:2272] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.834209 14516 tablet_replica.cc:333] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.834793 14516 raft_consensus.cc:2243] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.835337 14516 raft_consensus.cc:2272] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.837355 14516 tablet_replica.cc:333] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.838243 14516 raft_consensus.cc:2243] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.838713 14516 raft_consensus.cc:2272] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.841233 14516 tablet_replica.cc:333] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.841727 14516 raft_consensus.cc:2243] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.842693 14516 raft_consensus.cc:2272] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.844573 14516 tablet_replica.cc:333] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.845052 14516 raft_consensus.cc:2243] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.845721 14516 raft_consensus.cc:2272] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.847601 14516 tablet_replica.cc:333] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.848132 14516 raft_consensus.cc:2243] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.848922 14516 raft_consensus.cc:2272] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.851246 14516 tablet_replica.cc:333] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.852008 14516 raft_consensus.cc:2243] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.852484 14516 raft_consensus.cc:2272] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.853235 23437 consensus_peers.cc:597] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.854625 14516 tablet_replica.cc:333] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.855185 14516 raft_consensus.cc:2243] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.855664 14516 raft_consensus.cc:2272] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.857591 14516 tablet_replica.cc:333] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.858162 14516 raft_consensus.cc:2243] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.858563 14516 raft_consensus.cc:2272] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.860538 14516 tablet_replica.cc:333] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.861063 14516 raft_consensus.cc:2243] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.862069 14516 raft_consensus.cc:2272] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.864651 14516 tablet_replica.cc:333] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.865247 14516 raft_consensus.cc:2243] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.866194 14516 raft_consensus.cc:2272] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.868810 14516 tablet_replica.cc:333] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.869398 14516 raft_consensus.cc:2243] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:34.869804 23363 consensus_peers.cc:597] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.869912 14516 raft_consensus.cc:2272] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.872274 14516 tablet_replica.cc:333] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.872848 14516 raft_consensus.cc:2243] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.873718 14516 raft_consensus.cc:2272] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.876277 14516 tablet_replica.cc:333] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.876888 14516 raft_consensus.cc:2243] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.877714 14516 raft_consensus.cc:2272] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.879648 14516 tablet_replica.cc:333] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.880128 14516 raft_consensus.cc:2243] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.880523 14516 raft_consensus.cc:2272] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.882511 14516 tablet_replica.cc:333] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: stopping tablet replica
I20260709 13:09:34.883015 14516 raft_consensus.cc:2243] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.883437 14516 raft_consensus.cc:2272] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:34.888041 23511 consensus_peers.cc:597] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.895968 23363 consensus_peers.cc:597] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.908661 23363 consensus_peers.cc:597] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.933494 23437 consensus_peers.cc:597] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.938333 23511 consensus_peers.cc:597] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.948223 23511 connection.cc:573] client connection to 127.14.45.1:39473 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:09:34.948704 23511 consensus_peers.cc:597] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.955411 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
W20260709 13:09:34.959615 23511 consensus_peers.cc:597] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:35.013691 23363 consensus_peers.cc:597] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.028609 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:35.036003 24080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:35.036473 24081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:35.037634 24083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:35.038782 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:35.043833 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:35.044119 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:35.044389 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602575044368 us; error 0 us; skew 500 ppm
I20260709 13:09:35.045164 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:35.049032 14516 webserver.cc:533] Webserver started at http://127.14.45.1:40459/ using document root <none> and password file <none>
I20260709 13:09:35.049696 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:35.049971 14516 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:09:35.053030 23363 consensus_peers.cc:597] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.055132 14516 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:35.063246 24088 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:35.064244 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:09:35.064688 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "9dd2728dca8a44f79946d0da19b32c53"
format_stamp: "Formatted at 2026-07-09 13:09:23 on dist-test-slave-lfdf"
I20260709 13:09:35.065142 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:35.122661 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:35.124049 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:35.125864 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:35.134404 24095 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:09:35.135422 23511 consensus_peers.cc:597] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:35.232209 23437 consensus_peers.cc:597] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.451848 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:35.452240 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.319s	user 0.009s	sys 0.000s
I20260709 13:09:35.452598 14516 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:35.462157 24095 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.479158 24095 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.479938 24095 tablet_bootstrap.cc:492] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.480470 24095 ts_tablet_manager.cc:1403] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:09:35.483052 24095 raft_consensus.cc:359] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.483740 24095 raft_consensus.cc:740] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.484587 24095 consensus_queue.cc:260] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.489403 24095 ts_tablet_manager.cc:1434] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:09:35.490329 24095 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.506749 24095 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.507714 24095 tablet_bootstrap.cc:492] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.508397 24095 ts_tablet_manager.cc:1403] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:09:35.510970 24095 raft_consensus.cc:359] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.511678 24095 raft_consensus.cc:740] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.512377 24095 consensus_queue.cc:260] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.514483 24095 ts_tablet_manager.cc:1434] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:35.515496 24095 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.532732 24095 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.533547 24095 tablet_bootstrap.cc:492] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.534219 24095 ts_tablet_manager.cc:1403] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:09:35.536775 24095 raft_consensus.cc:359] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.537510 24095 raft_consensus.cc:740] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.538365 24095 consensus_queue.cc:260] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.539721 24095 ts_tablet_manager.cc:1434] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:35.540355 24095 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.552282 24095 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.553174 24095 tablet_bootstrap.cc:492] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.553818 24095 ts_tablet_manager.cc:1403] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:35.556418 24095 raft_consensus.cc:359] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.557090 24095 raft_consensus.cc:740] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.557904 24095 consensus_queue.cc:260] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.560070 24095 ts_tablet_manager.cc:1434] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:35.560819 24095 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.573371 24095 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.574389 24095 tablet_bootstrap.cc:492] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.575012 24095 ts_tablet_manager.cc:1403] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:09:35.577414 24095 raft_consensus.cc:359] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.578076 24095 raft_consensus.cc:740] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.578723 24095 consensus_queue.cc:260] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.580587 24095 ts_tablet_manager.cc:1434] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:35.581247 24095 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.592936 24095 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.593909 24095 tablet_bootstrap.cc:492] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.594619 24095 ts_tablet_manager.cc:1403] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:09:35.597031 24095 raft_consensus.cc:359] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.597681 24095 raft_consensus.cc:740] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.598390 24095 consensus_queue.cc:260] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.600219 24095 ts_tablet_manager.cc:1434] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:35.601140 24095 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.617034 24095 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.618001 24095 tablet_bootstrap.cc:492] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.618634 24095 ts_tablet_manager.cc:1403] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:09:35.621235 24095 raft_consensus.cc:359] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.621932 24095 raft_consensus.cc:740] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.622634 24095 consensus_queue.cc:260] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.624562 24095 ts_tablet_manager.cc:1434] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:35.625315 24095 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.638298 24095 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.639008 24095 tablet_bootstrap.cc:492] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.639540 24095 ts_tablet_manager.cc:1403] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:09:35.641258 24095 raft_consensus.cc:359] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.642006 24095 raft_consensus.cc:740] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.642653 24095 consensus_queue.cc:260] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.644140 24095 ts_tablet_manager.cc:1434] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:35.644780 24095 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.661458 24095 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.662480 24095 tablet_bootstrap.cc:492] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.663069 24095 ts_tablet_manager.cc:1403] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:09:35.664776 24095 raft_consensus.cc:359] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.665274 24095 raft_consensus.cc:740] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.665892 24095 consensus_queue.cc:260] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.667506 24095 ts_tablet_manager.cc:1434] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:35.668093 24095 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.679253 24095 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.680205 24095 tablet_bootstrap.cc:492] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.680809 24095 ts_tablet_manager.cc:1403] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:09:35.681007 14516 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:35.681389 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.229s	user 0.208s	sys 0.004s
I20260709 13:09:35.683171 24095 raft_consensus.cc:359] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.683881 24095 raft_consensus.cc:740] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.684540 24095 consensus_queue.cc:260] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.686486 24095 ts_tablet_manager.cc:1434] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:35.687443 24095 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.701960 24095 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.702831 24095 tablet_bootstrap.cc:492] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.703413 24095 ts_tablet_manager.cc:1403] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:09:35.706096 24095 raft_consensus.cc:359] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.706776 24095 raft_consensus.cc:740] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.707513 24095 consensus_queue.cc:260] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.709522 24095 ts_tablet_manager.cc:1434] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:35.710178 24095 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.726234 24095 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.727234 24095 tablet_bootstrap.cc:492] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.727909 24095 ts_tablet_manager.cc:1403] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:09:35.729948 24095 raft_consensus.cc:359] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.730481 24095 raft_consensus.cc:740] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.731122 24095 consensus_queue.cc:260] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.733593 24095 ts_tablet_manager.cc:1434] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:35.734459 24095 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.739583 23599 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.740186 23599 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.743778 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:35.746979 24096 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.747741 24096 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.742187 23599 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.753590 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:35.754382 23538 raft_consensus.cc:2468] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:35.756258 24095 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.757583 24095 tablet_bootstrap.cc:492] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.756314 23437 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:35.758441 24096 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.759085 24096 raft_consensus.cc:2804] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:35.759469 24096 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.759840 24096 raft_consensus.cc:3060] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:35.761451 23437 leader_election.cc:336] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.762284 24077 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.758286 24095 ts_tablet_manager.cc:1403] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:09:35.763023 24077 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.767637 24096 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.765827 24095 raft_consensus.cc:359] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.770011 24095 raft_consensus.cc:740] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.770149 24096 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.770870 24095 consensus_queue.cc:260] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.771478 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:35.772095 23538 raft_consensus.cc:3060] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.773250 24095 ts_tablet_manager.cc:1434] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:35.774192 24095 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.787773 24077 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.795305 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
W20260709 13:09:35.802250 23437 leader_election.cc:336] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.802661 24095 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.803646 24095 tablet_bootstrap.cc:492] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.804289 24095 ts_tablet_manager.cc:1403] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.003s
I20260709 13:09:35.804270 23538 raft_consensus.cc:2468] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:35.807063 24095 raft_consensus.cc:359] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.809231 24095 raft_consensus.cc:740] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
W20260709 13:09:35.810295 23511 leader_election.cc:336] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.810806 23511 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:35.810065 24095 consensus_queue.cc:260] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.811090 23437 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:35.811797 23599 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.812280 23599 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.813553 24095 ts_tablet_manager.cc:1434] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:35.813473 24096 raft_consensus.cc:2804] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.813496 23972 raft_consensus.cc:2749] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.814456 24095 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:35.814582 23599 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:35.815191 24096 raft_consensus.cc:697] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:35.816093 24096 consensus_queue.cc:237] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.824563 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:35.825754 23394 raft_consensus.cc:2468] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:35.834977 23511 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:35.839334 23972 raft_consensus.cc:2804] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:35.839953 23972 raft_consensus.cc:493] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.840469 23972 raft_consensus.cc:3060] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.840991 24100 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.841888 24100 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.844843 24100 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.855465 23216 catalog_manager.cc:5697] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:35.864830 23437 leader_election.cc:336] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.868283 23964 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.869167 23964 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.872037 23964 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.874293 23979 raft_consensus.cc:493] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.875073 23979 raft_consensus.cc:515] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.882849 23979 leader_election.cc:290] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:35.883998 23972 raft_consensus.cc:515] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.887408 23964 raft_consensus.cc:493] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.887974 24098 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.888391 23964 raft_consensus.cc:515] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.888902 24098 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.893558 23997 raft_consensus.cc:493] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.894249 24098 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.894464 23997 raft_consensus.cc:515] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.899185 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:35.897629 23511 leader_election.cc:336] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.901675 23997 leader_election.cc:290] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:35.907346 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:35.908110 23468 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:35.908227 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:35.908830 23538 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:35.910553 24096 raft_consensus.cc:493] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.911087 24096 raft_consensus.cc:515] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.913102 24096 leader_election.cc:290] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:35.914500 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:35.891639 23964 leader_election.cc:290] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.916525 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:35.919445 24095 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:35.920933 24095 tablet_bootstrap.cc:492] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:35.921177 23513 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:35.923707 23599 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:35.924290 23599 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.924768 23599 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:35.926611 23363 leader_election.cc:336] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.927138 23363 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
W20260709 13:09:35.928427 23437 leader_election.cc:336] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:35.928972 23437 leader_election.cc:336] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:35.929440 23437 leader_election.cc:336] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.930146 23997 raft_consensus.cc:2749] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.931133 23437 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:35.932029 23964 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:35.932476 23964 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.932932 23964 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.935487 23997 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.936048 23997 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.938122 23997 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.939465 23599 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.943449 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef74de67fbd4b549e342a137de78861" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:35.944007 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:35.944375 23394 raft_consensus.cc:3060] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.951344 24077 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.951938 24077 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.952188 23437 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:35.955420 24100 raft_consensus.cc:2749] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.955693 24077 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.955655 23394 raft_consensus.cc:2468] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:35.957085 23437 leader_election.cc:304] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:35.961851 24100 raft_consensus.cc:2749] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.887409 23972 leader_election.cc:290] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:35.964859 23996 raft_consensus.cc:493] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.965416 23996 raft_consensus.cc:515] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.965651 23511 leader_election.cc:304] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:35.966712 23972 raft_consensus.cc:2804] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.967528 23972 raft_consensus.cc:697] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:35.967614 23996 leader_election.cc:290] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:35.964648 24077 raft_consensus.cc:493] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.968504 23972 consensus_queue.cc:237] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.968585 24077 raft_consensus.cc:515] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.969542 24095 ts_tablet_manager.cc:1403] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.155s	user 0.038s	sys 0.055s
I20260709 13:09:35.969403 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:35.970988 23996 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.971522 23996 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:35.973451 23996 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:35.975342 24077 leader_election.cc:290] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:35.975898 23599 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:35.977614 23511 leader_election.cc:336] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:35.978433 23511 leader_election.cc:336] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.978716 24100 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:35.979269 24100 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:35.980815 24095 raft_consensus.cc:359] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.981654 24095 raft_consensus.cc:740] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.984915 24095 consensus_queue.cc:260] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:35.988566 24100 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
W20260709 13:09:35.989182 23437 leader_election.cc:336] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:35.992329 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:35.993995 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:35.994599 23398 raft_consensus.cc:2468] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:35.999431 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
W20260709 13:09:36.001384 23511 leader_election.cc:336] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.004875 23964 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.006296 23471 raft_consensus.cc:2393] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 2: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:36.009262 23513 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:35.998430 24095 ts_tablet_manager.cc:1434] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:09:36.010057 23972 raft_consensus.cc:2749] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.011133 24095 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:36.017088 23964 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.023161 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:36.023954 23543 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:36.024411 23437 leader_election.cc:304] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.025254 24100 raft_consensus.cc:2749] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.026625 23437 leader_election.cc:304] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.026684 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:36.027838 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:36.029580 23996 raft_consensus.cc:493] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.029464 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:36.030623 23996 raft_consensus.cc:515] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.031167 23543 raft_consensus.cc:2393] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 2: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:36.032087 24100 raft_consensus.cc:2804] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.032510 24100 raft_consensus.cc:493] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.032894 23996 leader_election.cc:290] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.032997 23599 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.032982 24100 raft_consensus.cc:3060] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.033594 23599 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.034741 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.035564 23599 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.031818 23216 catalog_manager.cc:5697] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.041260 24100 raft_consensus.cc:515] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.044603 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.045280 23471 raft_consensus.cc:2468] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
W20260709 13:09:36.020784 23363 leader_election.cc:336] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.043648 23437 leader_election.cc:336] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.046459 24100 leader_election.cc:290] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.046504 23363 leader_election.cc:304] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.047803 23996 raft_consensus.cc:2749] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:36.049687 23363 leader_election.cc:336] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.050611 23363 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:36.052547 23513 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
W20260709 13:09:36.053457 23437 leader_election.cc:336] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.054575 23437 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:36.054670 23972 raft_consensus.cc:2804] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.056345 23972 raft_consensus.cc:493] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.056605 23964 raft_consensus.cc:2749] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.055008 23996 raft_consensus.cc:2749] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.056869 23972 raft_consensus.cc:3060] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:36.060923 23437 leader_election.cc:336] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.065022 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.066227 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c3dcd176fe419db880690b124927e7" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.067087 23394 raft_consensus.cc:3060] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.071609 23363 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.072475 23997 raft_consensus.cc:2804] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.072913 23997 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.073326 23997 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:36.075498 23363 leader_election.cc:336] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.076493 23363 leader_election.cc:336] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.076947 23363 leader_election.cc:304] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.077765 23996 raft_consensus.cc:2749] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:36.078969 23363 leader_election.cc:336] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.079547 23363 leader_election.cc:304] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:36.080317 23996 raft_consensus.cc:2749] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:36.081212 23363 leader_election.cc:336] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.081221 23511 leader_election.cc:336] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.081879 23363 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:36.083415 23996 raft_consensus.cc:2749] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.087052 23437 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.087898 24100 raft_consensus.cc:2749] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.086416 23997 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:36.091934 23363 leader_election.cc:336] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.092518 23996 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.092698 23394 raft_consensus.cc:2468] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:36.090474 23997 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.093107 23996 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.095453 23996 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.092530 23363 leader_election.cc:304] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.096849 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.097318 24077 raft_consensus.cc:2749] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.099695 23543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:36.100327 23543 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.100980 24095 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:36.102129 23599 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.102670 23599 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.103237 23437 leader_election.cc:304] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.104615 24100 raft_consensus.cc:2804] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.105211 24100 raft_consensus.cc:697] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:36.105319 23599 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.102627 23972 raft_consensus.cc:515] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.106281 24100 consensus_queue.cc:237] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.106871 23599 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.107272 24095 tablet_bootstrap.cc:492] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:36.108002 24095 ts_tablet_manager.cc:1403] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.018s
I20260709 13:09:36.107431 23599 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.109150 23543 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:36.109606 23599 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.112044 23972 leader_election.cc:290] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.113080 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.115504 23394 raft_consensus.cc:2468] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
W20260709 13:09:36.116256 23511 leader_election.cc:336] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.113396 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
W20260709 13:09:36.116948 23511 leader_election.cc:336] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.117166 23398 raft_consensus.cc:2468] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:36.113471 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385ef80a9064010a9965cd059570c71" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:36.113880 23964 raft_consensus.cc:493] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.127242 23471 raft_consensus.cc:3060] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.127622 23964 raft_consensus.cc:515] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.122195 23996 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.113500 24095 raft_consensus.cc:359] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.128016 23363 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.136895 24077 raft_consensus.cc:2804] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.137086 23471 raft_consensus.cc:2468] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:36.137421 24077 raft_consensus.cc:697] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:36.129712 23964 leader_election.cc:290] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.138293 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.130031 23511 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.139127 23394 raft_consensus.cc:2468] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:36.140055 23513 leader_election.cc:304] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.140272 23972 raft_consensus.cc:2804] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.140676 23972 raft_consensus.cc:493] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.128834 23996 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.141294 23972 raft_consensus.cc:3060] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.143023 23996 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.144294 23216 catalog_manager.cc:5697] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.145020 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.145834 23599 raft_consensus.cc:2804] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.145977 23964 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
W20260709 13:09:36.146098 23363 leader_election.cc:336] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.146412 23599 raft_consensus.cc:697] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:36.146725 23964 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.147244 23599 consensus_queue.cc:237] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:36.147073 23363 leader_election.cc:336] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.149242 23964 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.149281 23363 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.149888 23996 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.130242 24095 raft_consensus.cc:740] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.150646 23997 raft_consensus.cc:2749] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.138341 24077 consensus_queue.cc:237] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.150707 23996 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.154923 23996 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.151363 24095 consensus_queue.cc:260] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.158285 24095 ts_tablet_manager.cc:1434] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 13:09:36.159389 24095 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:36.140098 23511 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 9dd2728dca8a44f79946d0da19b32c53
W20260709 13:09:36.163355 23511 leader_election.cc:336] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.161861 23437 leader_election.cc:336] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.165355 24098 raft_consensus.cc:2804] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.166009 24098 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.166489 24098 raft_consensus.cc:3060] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.168803 23437 leader_election.cc:304] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.175179 24163 raft_consensus.cc:493] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.176105 23964 raft_consensus.cc:2804] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.176023 24163 raft_consensus.cc:515] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.176607 23964 raft_consensus.cc:493] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.177057 23964 raft_consensus.cc:3060] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.179116 24163 leader_election.cc:290] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:36.190629 23363 leader_election.cc:336] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.191155 23363 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.191376 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.192194 23394 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:36.193027 24100 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.193614 24100 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.196053 24100 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.203099 24162 raft_consensus.cc:493] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.185755 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.204160 23472 raft_consensus.cc:2468] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:36.204073 24162 raft_consensus.cc:515] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.203325 23979 raft_consensus.cc:493] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.205263 23979 raft_consensus.cc:515] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.205638 23513 leader_election.cc:304] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.206537 24182 raft_consensus.cc:2804] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.206923 24182 raft_consensus.cc:493] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.207281 24182 raft_consensus.cc:3060] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.184634 23964 raft_consensus.cc:515] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.210017 23964 leader_election.cc:290] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
W20260709 13:09:36.207278 23511 leader_election.cc:336] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.224757 23363 leader_election.cc:336] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.211499 23972 raft_consensus.cc:515] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.212337 23997 raft_consensus.cc:2749] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.207376 23979 leader_election.cc:290] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.206564 24162 leader_election.cc:290] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.215189 24098 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.246718 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.247335 24098 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.247493 23394 raft_consensus.cc:2468] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
W20260709 13:09:36.203719 23437 leader_election.cc:336] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.249063 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 45385.1us
I20260709 13:09:36.217555 23996 raft_consensus.cc:493] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.218359 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.238586 23599 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.244957 23972 leader_election.cc:290] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.252671 23599 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.215655 24182 raft_consensus.cc:515] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.252645 23471 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:36.265353 23437 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.267647 23437 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:36.273141 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.273903 23394 raft_consensus.cc:2468] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:36.264104 23996 raft_consensus.cc:515] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.262073 24162 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.275341 23216 catalog_manager.cc:5697] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.277787 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164c20e4fe9043b0ac2f2db5488e004e" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.276053 24162 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.278439 23396 raft_consensus.cc:3060] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.279878 24162 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.279982 23599 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.276715 24100 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.280793 24100 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.282328 24182 leader_election.cc:290] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.282560 23543 raft_consensus.cc:1275] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.272414 24096 raft_consensus.cc:2804] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:36.284085 23437 leader_election.cc:336] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.288385 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.262322 23997 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.283051 24100 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.277501 23996 leader_election.cc:290] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.270879 23964 raft_consensus.cc:2804] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.300985 23997 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.293334 24096 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.302023 23964 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.307860 23964 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.321375 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.322156 23472 raft_consensus.cc:2468] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:36.325387 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.326026 23471 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 1.
I20260709 13:09:36.302314 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:36.328962 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:36.329679 23468 raft_consensus.cc:2468] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:36.330642 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:36.330806 23979 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.331342 23538 raft_consensus.cc:2468] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:36.331393 23979 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:36.338505 23363 leader_election.cc:336] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.339147 23363 leader_election.cc:336] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.305709 23997 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.341466 23513 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.341754 23470 raft_consensus.cc:3060] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.345515 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.346282 23394 raft_consensus.cc:2468] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 1.
I20260709 13:09:36.339716 23396 raft_consensus.cc:2468] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:36.333688 23979 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.311959 24096 raft_consensus.cc:3060] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.346370 24182 raft_consensus.cc:2804] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.351191 24182 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.351593 24182 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.352969 23964 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.337163 23217 catalog_manager.cc:5697] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.340229 23365 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.359345 23365 leader_election.cc:304] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.361430 23365 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:36.362037 23437 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.363881 23437 leader_election.cc:304] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:36.360764 24189 raft_consensus.cc:2804] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.370044 24189 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.370647 24189 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.372627 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.373334 23396 raft_consensus.cc:3060] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.363999 23996 raft_consensus.cc:2804] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.374089 23996 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.374485 23996 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.378144 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.378804 23394 raft_consensus.cc:3060] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.379251 24100 consensus_queue.cc:1048] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.379163 24182 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.380630 24100 raft_consensus.cc:2804] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.381021 24100 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.381371 24100 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.381560 24182 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.361626 23997 raft_consensus.cc:2804] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.384893 23979 raft_consensus.cc:2804] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.386070 23997 raft_consensus.cc:493] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.386763 23997 raft_consensus.cc:3060] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.381448 24096 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.400184 24096 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.400614 23996 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.365083 23470 raft_consensus.cc:2468] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:36.403558 23513 leader_election.cc:304] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.385351 23964 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.386185 23979 raft_consensus.cc:493] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.384917 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:36.405922 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:39473
I20260709 13:09:36.404395 23511 leader_election.cc:304] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.408975 23979 raft_consensus.cc:3060] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.409433 24182 raft_consensus.cc:2804] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.406765 24162 raft_consensus.cc:2804] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.410384 24162 raft_consensus.cc:697] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:36.411478 24162 consensus_queue.cc:237] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.414314 24182 raft_consensus.cc:493] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.417316 24182 raft_consensus.cc:3060] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.406064 24193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:39473 every 8 connection(s)
I20260709 13:09:36.424853 23394 raft_consensus.cc:2468] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:36.425715 23396 raft_consensus.cc:2468] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:36.428579 23996 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
W20260709 13:09:36.429957 23511 leader_election.cc:336] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:36.431471 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 67820.6us
I20260709 13:09:36.432171 23437 leader_election.cc:304] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:36.432896 24188 raft_consensus.cc:2804] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.433354 24188 raft_consensus.cc:697] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:36.434234 24188 consensus_queue.cc:237] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.433876 24189 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:36.437493 23437 leader_election.cc:336] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.438148 23538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:36.438946 23538 raft_consensus.cc:2468] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:36.439972 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:36.440183 24189 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.440717 23468 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.440207 23979 raft_consensus.cc:515] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:36.438174 23437 leader_election.cc:336] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:36.449965 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:36.450986 23470 raft_consensus.cc:2393] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5227af10b4e44d23b9afdeff9f43a849 in current term 2: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:36.460721 24100 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.462718 23511 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.463882 23511 leader_election.cc:304] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.464841 23599 raft_consensus.cc:2804] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.465602 23599 raft_consensus.cc:697] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:36.466571 23471 raft_consensus.cc:2393] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1265f7d704d41df83adf9f1c74d3f03 in current term 2: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:36.467133 23599 consensus_queue.cc:237] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.473917 24187 raft_consensus.cc:2804] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.474606 24187 raft_consensus.cc:697] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:36.452286 23979 leader_election.cc:290] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.479236 23217 catalog_manager.cc:5697] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.477514 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.506538 23396 raft_consensus.cc:2393] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 2: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:36.506971 24100 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:36.510645 23437 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:36.520059 24187 consensus_queue.cc:237] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.522084 24095 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:36.489578 23397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.523694 23216 catalog_manager.cc:5697] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.489862 23979 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.577112 24095 tablet_bootstrap.cc:492] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:36.582459 24095 ts_tablet_manager.cc:1403] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.423s	user 0.033s	sys 0.017s
I20260709 13:09:36.576498 23397 raft_consensus.cc:3060] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.589007 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:36.590464 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:36.564998 23997 raft_consensus.cc:515] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.585273 23979 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.654464 24190 raft_consensus.cc:2804] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.628639 23468 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:36.638887 23394 raft_consensus.cc:3060] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.613054 24182 raft_consensus.cc:515] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.670996 23540 raft_consensus.cc:2393] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 2: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
W20260709 13:09:36.684886 24195 log.cc:927] Time spent T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:36.662082 24190 raft_consensus.cc:493] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:36.685191 24095 raft_consensus.cc:359] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.748876 24095 raft_consensus.cc:740] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.752810 24095 consensus_queue.cc:260] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.750337 24190 raft_consensus.cc:3060] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.782542 23471 raft_consensus.cc:1275] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.812479 23394 raft_consensus.cc:2468] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:36.815809 23997 leader_election.cc:290] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.817152 24182 leader_election.cc:290] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.826498 23397 raft_consensus.cc:2468] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:36.839548 24098 consensus_queue.cc:1048] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:36.844103 23365 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:36.849895 23397 raft_consensus.cc:1275] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.852523 23471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:36.853216 23471 raft_consensus.cc:3060] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.854199 24223 raft_consensus.cc:493] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.849620 24194 raft_consensus.cc:2804] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.854785 24223 raft_consensus.cc:515] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.866915 23466 raft_consensus.cc:1275] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.866755 23471 raft_consensus.cc:2468] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:36.871546 24194 raft_consensus.cc:697] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:36.872901 24194 consensus_queue.cc:237] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
W20260709 13:09:36.903697 23365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 46979.1us
I20260709 13:09:36.907184 23979 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.906200 24222 raft_consensus.cc:493] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.946179 24225 raft_consensus.cc:493] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.950124 23437 leader_election.cc:304] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
W20260709 13:09:36.951010 23365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:43233, user_credentials={real_user=slave}} blocked reactor thread for 45529.9us
I20260709 13:09:36.964141 23437 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:36.911466 23399 raft_consensus.cc:1275] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.967608 23365 leader_election.cc:304] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:36.969291 23399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:36.966252 24225 raft_consensus.cc:515] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.975561 24142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:36.975971 24225 leader_election.cc:290] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.976271 24142 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.976549 24225 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.977993 24213 consensus_queue.cc:1048] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:36.947088 24145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:36.967545 24100 raft_consensus.cc:2804] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.981607 24100 raft_consensus.cc:697] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:36.982527 24100 consensus_queue.cc:237] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:36.983003 24096 consensus_queue.cc:1048] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.982740 24213 consensus_queue.cc:1048] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.984608 24209 raft_consensus.cc:2804] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.985939 23546 raft_consensus.cc:1275] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.991279 23398 raft_consensus.cc:1275] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.991899 24226 raft_consensus.cc:493] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.992430 24226 raft_consensus.cc:515] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:36.994583 24226 leader_election.cc:290] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:36.997917 24226 raft_consensus.cc:493] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.997064 24223 leader_election.cc:290] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:36.999235 24182 consensus_queue.cc:1048] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:36.999306 24226 raft_consensus.cc:515] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:37.001588 24226 leader_election.cc:290] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:36.998550 24142 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:37.013113 24095 ts_tablet_manager.cc:1434] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.430s	user 0.016s	sys 0.014s
I20260709 13:09:36.967461 23979 raft_consensus.cc:2804] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.969913 23399 raft_consensus.cc:2468] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 1.
I20260709 13:09:37.028469 24095 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:36.925227 24190 raft_consensus.cc:515] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:37.011348 23394 raft_consensus.cc:1275] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.028962 23437 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:37.012084 24209 raft_consensus.cc:697] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:36.977092 24225 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:37.025707 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:37.038937 23964 raft_consensus.cc:2804] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.046430 23964 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:37.046559 24220 consensus_queue.cc:1048] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:09:37.047015 23964 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.036154 23979 raft_consensus.cc:697] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:37.061658 23964 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:36.964279 24222 raft_consensus.cc:515] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:37.071128 24143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.060421 23396 raft_consensus.cc:3060] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.072932 24190 leader_election.cc:290] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:37.075681 23964 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:37.093358 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.094434 24139 raft_consensus.cc:2393] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 83a33b9d895a442287d4b46856f57a60 in current term 2: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:37.095386 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c554bef114234298a189605cf26a64d1" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.096438 24137 raft_consensus.cc:3060] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.096730 24138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.097796 24138 raft_consensus.cc:3060] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.100070 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:37.110792 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.116484 24138 raft_consensus.cc:2468] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:37.079970 24145 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.099237 24136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:37.144161 23979 consensus_queue.cc:237] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:37.151947 23217 catalog_manager.cc:5697] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:37.186470 24224 log.cc:927] Time spent T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:09:37.195097 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:37.195807 23394 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:37.199303 24231 log.cc:927] Time spent T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:37.199615 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:37.200299 23540 raft_consensus.cc:3060] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:37.203416 24230 log.cc:927] Time spent T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:37.188560 24144 raft_consensus.cc:3060] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.231812 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:37.232494 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.233024 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbf2dfc5cf4b48f69167416ab3bf4cb1" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.233160 24141 raft_consensus.cc:3060] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.234673 24222 leader_election.cc:290] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:37.235543 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:37.237622 23540 raft_consensus.cc:2468] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:37.159020 24190 consensus_queue.cc:1048] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:09:37.133584 24209 consensus_queue.cc:237] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:37.242147 23437 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:37.257175 24225 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:37.260062 24225 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.260617 24142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4706da1890fc4ca585d0a3450848f462" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.260579 24225 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:37.261312 24142 raft_consensus.cc:3060] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:37.263396 23511 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.263942 23511 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:37.262830 24225 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:37.266861 23394 raft_consensus.cc:2468] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:37.267338 24144 raft_consensus.cc:1275] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.268540 24144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afa3ae86d604ec2992da64a89540734" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.269191 24144 raft_consensus.cc:3060] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.273149 24190 raft_consensus.cc:2804] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.273722 24190 raft_consensus.cc:697] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:37.274585 24190 consensus_queue.cc:237] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:37.275452 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:37.276777 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94a184780fd46dbab2854fb725ca574" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.278956 24137 raft_consensus.cc:1275] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.282109 23437 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
W20260709 13:09:37.284060 23437 leader_election.cc:343] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.285095 23437 leader_election.cc:343] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.287011 23437 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.287679 23437 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03
W20260709 13:09:37.296322 23437 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.298159 23437 leader_election.cc:343] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.299398 23437 leader_election.cc:343] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.303175 24199 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40477
I20260709 13:09:37.253883 24138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50034ac82496425fac0be0a983f3fdc9" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.309267 24206 consensus_queue.cc:1048] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:09:37.318746 24143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:37.312482 24199 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:37.320457 24199 heartbeater.cc:507] Master 127.14.45.62:40477 requested a full tablet report, sending...
I20260709 13:09:37.322540 23396 raft_consensus.cc:2468] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:37.324460 24144 raft_consensus.cc:2468] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:37.305770 24207 raft_consensus.cc:2749] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.286244 24187 raft_consensus.cc:2749] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.290704 24191 raft_consensus.cc:2749] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.332373 24212 consensus_queue.cc:1048] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:37.334225 24141 raft_consensus.cc:2468] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
W20260709 13:09:37.347393 23437 leader_election.cc:343] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.353849 23437 consensus_peers.cc:597] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.336621 24142 raft_consensus.cc:2468] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
W20260709 13:09:37.333029 23511 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.356848 23511 leader_election.cc:343] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.358237 23511 leader_election.cc:343] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.358799 23511 leader_election.cc:304] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:37.338050 23219 catalog_manager.cc:5697] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.360421 23219 catalog_manager.cc:5697] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.339712 24145 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:37.366915 23396 raft_consensus.cc:1275] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.370018 24187 raft_consensus.cc:2749] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:37.371178 23511 consensus_peers.cc:597] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.378051 23511 consensus_peers.cc:597] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.384189 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:37.384598 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:37.380398 24139 raft_consensus.cc:1275] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.389556 23467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:37.398379 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:37.399313 23468 raft_consensus.cc:2393] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 2: Already voted for candidate 5227af10b4e44d23b9afdeff9f43a849 in this term.
I20260709 13:09:37.409673 24095 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:37.415278 23511 leader_election.cc:304] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:37.419281 24095 tablet_bootstrap.cc:492] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:37.420825 24095 ts_tablet_manager.cc:1403] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.401s	user 0.021s	sys 0.006s
I20260709 13:09:37.424630 24095 raft_consensus.cc:359] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:37.425424 24095 raft_consensus.cc:740] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.426313 24095 consensus_queue.cc:260] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:37.429848 24095 ts_tablet_manager.cc:1434] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:09:37.430749 24095 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:37.431972 23542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:37.433580 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:37.434589 23541 raft_consensus.cc:2393] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 2: Already voted for candidate a1265f7d704d41df83adf9f1c74d3f03 in this term.
I20260709 13:09:37.437615 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26483779be92418ab5dc80b6e0228254" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
I20260709 13:09:37.438350 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:37.439256 23469 raft_consensus.cc:2393] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 2: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
I20260709 13:09:37.603052 23467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
W20260709 13:09:37.604342 24249 log.cc:927] Time spent T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: Append to log took a long time: real 0.301s	user 0.003s	sys 0.000s
W20260709 13:09:37.692879 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 277701us
I20260709 13:09:37.693909 24250 raft_consensus.cc:2804] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.694460 24250 raft_consensus.cc:697] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
W20260709 13:09:37.695166 23511 consensus_peers.cc:597] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.695792 23511 leader_election.cc:343] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.695389 24250 consensus_queue.cc:237] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
W20260709 13:09:37.696722 23511 consensus_peers.cc:597] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.754887 24139 raft_consensus.cc:1275] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:37.757586 23437 consensus_peers.cc:597] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.757401 24205 consensus_queue.cc:1048] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:37.760219 23437 consensus_peers.cc:597] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:37.760485 24092 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:37.763124 24222 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:37.792799 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 94592.9us
I20260709 13:09:37.793996 24255 consensus_queue.cc:1048] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.805596 24098 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.819301 24222 raft_consensus.cc:2749] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:37.819978 23363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.021s	sys 0.013s
W20260709 13:09:37.820389 23363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.021s	sys 0.013s
W20260709 13:09:37.820674 23363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 581047us
I20260709 13:09:37.806166 24098 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:37.831138 24098 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:37.835546 23437 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 9dd2728dca8a44f79946d0da19b32c53
W20260709 13:09:37.842535 23437 consensus_peers.cc:597] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:37.844077 24090 leader_election.cc:304] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:37.852434 23473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60" is_pre_election: true
I20260709 13:09:37.857419 23473 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:37.867165 24145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:37.867918 24145 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 2.
I20260709 13:09:37.846221 24205 raft_consensus.cc:2804] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:37.872457 23437 consensus_peers.cc:597] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.862919 23473 raft_consensus.cc:1275] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.873255 23511 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:37.871906 24205 raft_consensus.cc:697] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:37.875263 24098 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:37.875650 24098 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.875926 24205 consensus_queue.cc:237] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:37.853238 24222 raft_consensus.cc:2749] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.887030 23391 raft_consensus.cc:1275] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.896987 23547 raft_consensus.cc:1275] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.899123 23472 raft_consensus.cc:1275] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.876003 24098 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.898577 24189 consensus_queue.cc:1048] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:09:37.891774 24213 consensus_queue.cc:1048] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:09:37.913658 23216 catalog_manager.cc:5697] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.923959 23216 catalog_manager.cc:5697] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.904836 24077 consensus_queue.cc:1048] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:09:37.982879 24260 consensus_queue.cc:1048] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:37.990916 24095 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.031s
W20260709 13:09:37.991341 24095 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.031s
I20260709 13:09:37.995272 24098 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.001770 24095 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:37.997591 24098 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:38.008153 23469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:38.008750 23469 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.009716 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "a1265f7d704d41df83adf9f1c74d3f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:38.010347 24095 tablet_bootstrap.cc:492] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.010725 24139 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.011150 24095 ts_tablet_manager.cc:1403] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.581s	user 0.026s	sys 0.031s
I20260709 13:09:38.014649 23394 raft_consensus.cc:1275] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:38.015975 23363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 104915us
I20260709 13:09:38.017243 23363 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:38.020977 24221 raft_consensus.cc:2804] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.021680 24221 raft_consensus.cc:697] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:38.022830 24221 consensus_queue.cc:237] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.026185 23469 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 3.
I20260709 13:09:38.027470 23513 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:38.028368 23972 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.028914 23972 raft_consensus.cc:697] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 LEADER]: Becoming Leader. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:38.029852 23972 consensus_queue.cc:237] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.032509 24139 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1265f7d704d41df83adf9f1c74d3f03 in term 3.
W20260709 13:09:38.066769 23363 consensus_peers.cc:597] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.065171 24095 raft_consensus.cc:359] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.070828 24095 raft_consensus.cc:740] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.072988 23217 catalog_manager.cc:5697] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.079313 24095 consensus_queue.cc:260] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.088578 24095 ts_tablet_manager.cc:1434] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:09:38.114032 24139 raft_consensus.cc:1275] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.114707 24095 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.129895 24139 raft_consensus.cc:1275] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.138388 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da1469aee244edbcec3c6c6b867007" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:38.138896 24216 consensus_queue.cc:1048] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:38.139282 23396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:38.139765 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d423ffa47984e5e9d46f998841ff374" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:38.124656 23979 consensus_queue.cc:1048] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:09:38.140519 23398 raft_consensus.cc:2393] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dd2728dca8a44f79946d0da19b32c53 in current term 2: Already voted for candidate 83a33b9d895a442287d4b46856f57a60 in this term.
W20260709 13:09:38.147635 23437 consensus_peers.cc:597] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.152256 23395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1736a3967424f8982475f4c769a395d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:38.160802 23393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2dd029e78d44d49664082ab994aec9" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5227af10b4e44d23b9afdeff9f43a849" is_pre_election: true
I20260709 13:09:38.180187 23997 consensus_queue.cc:1048] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.183964 24214 consensus_queue.cc:1048] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:38.184507 24090 leader_election.cc:304] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03
I20260709 13:09:38.185599 24227 raft_consensus.cc:2749] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.186069 24090 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:38.187158 24227 raft_consensus.cc:2749] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.187217 23393 raft_consensus.cc:1275] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:38.192836 23363 consensus_peers.cc:597] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.187368 24090 leader_election.cc:304] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:38.199667 24162 consensus_queue.cc:1048] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:09:38.222810 24227 raft_consensus.cc:2749] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.233176 24090 leader_election.cc:304] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:38.234071 24222 raft_consensus.cc:2749] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.235369 24090 leader_election.cc:304] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53; no voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60
W20260709 13:09:38.236320 23511 consensus_peers.cc:597] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.240592 24222 raft_consensus.cc:2749] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.251052 23219 catalog_manager.cc:5697] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 2 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:38.237538 23511 consensus_peers.cc:597] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.260267 23219 catalog_manager.cc:5697] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } }
I20260709 13:09:38.262328 23219 catalog_manager.cc:5697] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 reported cstate change: term changed from 1 to 3, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4). New cstate: current_term: 3 leader_uuid: "a1265f7d704d41df83adf9f1c74d3f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.274433 23217 ts_manager.cc:194] Re-registered known tserver with Master: 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:38.287290 24139 raft_consensus.cc:1275] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.307972 23216 catalog_manager.cc:5697] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.319784 24095 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.321132 24095 tablet_bootstrap.cc:492] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.322037 24095 ts_tablet_manager.cc:1403] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.004s
W20260709 13:09:38.324148 23437 consensus_peers.cc:597] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.330588 24215 consensus_queue.cc:1048] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.339728 24095 raft_consensus.cc:359] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.340559 24095 raft_consensus.cc:740] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.341212 24095 consensus_queue.cc:260] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.343286 24095 ts_tablet_manager.cc:1434] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:09:38.344071 24095 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:38.431212 23511 consensus_peers.cc:597] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.453289 24095 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.454273 24095 tablet_bootstrap.cc:492] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.454973 24095 ts_tablet_manager.cc:1403] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.111s	user 0.024s	sys 0.026s
W20260709 13:09:38.464960 23437 consensus_peers.cc:597] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:38.469133 23363 consensus_peers.cc:597] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.472206 24095 raft_consensus.cc:359] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.474623 24095 raft_consensus.cc:740] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.475914 24095 consensus_queue.cc:260] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.478698 24095 ts_tablet_manager.cc:1434] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:09:38.479710 24095 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:38.496133 23494 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0920 after lost signal to thread 14519
W20260709 13:09:38.497676 23494 debug-util.cc:398] Leaking SignalData structure 0x7b0800138760 after lost signal to thread 23256
W20260709 13:09:38.499075 23494 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6280 after lost signal to thread 23423
W20260709 13:09:38.500329 23494 debug-util.cc:398] Leaking SignalData structure 0x7b08002255c0 after lost signal to thread 23497
W20260709 13:09:38.501567 23494 debug-util.cc:398] Leaking SignalData structure 0x7b0800273360 after lost signal to thread 23571
W20260709 13:09:38.509765 23494 debug-util.cc:398] Leaking SignalData structure 0x7b0800056f80 after lost signal to thread 24193
W20260709 13:09:38.522171 23511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 45238.7us
I20260709 13:09:38.523972 23469 raft_consensus.cc:1275] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.524222 23392 raft_consensus.cc:1275] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.526652 24214 consensus_queue.cc:1048] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.534818 23215 catalog_manager.cc:5697] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.534453 24207 consensus_queue.cc:1048] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:38.554298 24095 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.558271 24095 tablet_bootstrap.cc:492] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.560103 24095 ts_tablet_manager.cc:1403] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.081s	user 0.029s	sys 0.021s
I20260709 13:09:38.554322 24143 raft_consensus.cc:1275] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.565457 24095 raft_consensus.cc:359] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:38.565972 24293 consensus_queue.cc:1048] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.567610 23469 raft_consensus.cc:1275] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:38.570120 24095 raft_consensus.cc:740] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.571501 24095 consensus_queue.cc:260] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:38.573038 24213 consensus_queue.cc:1048] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.574993 24095 ts_tablet_manager.cc:1434] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:09:38.577330 24095 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.589300 24139 raft_consensus.cc:1275] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Refusing update from remote peer a1265f7d704d41df83adf9f1c74d3f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:38.617902 24210 consensus_queue.cc:1048] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.650434 24095 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.673497 24095 tablet_bootstrap.cc:492] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.674254 24095 ts_tablet_manager.cc:1403] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.017s
W20260709 13:09:38.676954 23363 consensus_peers.cc:597] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:38.680784 23511 consensus_peers.cc:597] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.678668 24095 raft_consensus.cc:359] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:38.681802 24095 raft_consensus.cc:740] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.682662 24095 consensus_queue.cc:260] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:38.683086 23217 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38048
I20260709 13:09:38.684962 24095 ts_tablet_manager.cc:1434] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:38.685789 24095 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.688974 24199 heartbeater.cc:499] Master 127.14.45.62:40477 was elected leader, sending a full tablet report...
I20260709 13:09:38.709717 24095 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.711344 24095 tablet_bootstrap.cc:492] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.712041 24095 ts_tablet_manager.cc:1403] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:09:38.714838 24095 raft_consensus.cc:359] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.715555 24095 raft_consensus.cc:740] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.716356 24095 consensus_queue.cc:260] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.718726 24095 ts_tablet_manager.cc:1434] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:38.719558 24095 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.738114 24095 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.739601 24095 tablet_bootstrap.cc:492] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.740340 24095 ts_tablet_manager.cc:1403] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.001s
I20260709 13:09:38.742805 24095 raft_consensus.cc:359] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.743508 24095 raft_consensus.cc:740] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.744259 24095 consensus_queue.cc:260] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.746484 24095 ts_tablet_manager.cc:1434] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:38.747345 24095 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:38.760301 23437 consensus_peers.cc:597] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:38.777513 24095 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.778982 24095 tablet_bootstrap.cc:492] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.779736 24095 ts_tablet_manager.cc:1403] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 13:09:38.787029 24095 raft_consensus.cc:359] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.788038 24095 raft_consensus.cc:740] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.788805 24095 consensus_queue.cc:260] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:38.791303 24095 ts_tablet_manager.cc:1434] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:38.792174 24095 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.826452 24095 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.827425 24095 tablet_bootstrap.cc:492] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.828058 24095 ts_tablet_manager.cc:1403] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.004s
I20260709 13:09:38.830655 24095 raft_consensus.cc:359] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.831352 24095 raft_consensus.cc:740] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.832177 24095 consensus_queue.cc:260] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.836640 24095 ts_tablet_manager.cc:1434] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:09:38.837925 24095 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.847330 24139 raft_consensus.cc:3060] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.898711 24095 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.899772 24095 tablet_bootstrap.cc:492] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:38.900525 24095 ts_tablet_manager.cc:1403] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.036s
I20260709 13:09:38.905702 24095 raft_consensus.cc:359] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.906541 24095 raft_consensus.cc:740] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.907016 24143 raft_consensus.cc:3060] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.907898 24095 consensus_queue.cc:260] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:38.910125 24095 ts_tablet_manager.cc:1434] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:09:38.910954 24095 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:38.932070 24095 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:38.934481 23363 consensus_peers.cc:597] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:39.056483 24095 tablet_bootstrap.cc:492] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.058257 24095 ts_tablet_manager.cc:1403] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.148s	user 0.054s	sys 0.032s
I20260709 13:09:39.059024 24216 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.078414 24216 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.080533 24216 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
I20260709 13:09:39.099707 24095 raft_consensus.cc:359] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.100560 24095 raft_consensus.cc:740] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.101315 24095 consensus_queue.cc:260] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.105875 24095 ts_tablet_manager.cc:1434] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.006s
I20260709 13:09:39.106685 24095 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.109098 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03" is_pre_election: true
W20260709 13:09:39.130287 23363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.4:43503, user_credentials={real_user=slave}} blocked reactor thread for 62542.2us
W20260709 13:09:39.137534 23363 consensus_peers.cc:597] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:39.123586 24143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53" is_pre_election: true
I20260709 13:09:39.135145 23545 raft_consensus.cc:2468] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:39.155210 23437 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:39.157946 23979 raft_consensus.cc:2804] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:39.158387 23979 raft_consensus.cc:493] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.158767 23979 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:39.163286 23437 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.200205 24145 raft_consensus.cc:3060] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.234018 23979 raft_consensus.cc:515] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.284310 23979 leader_election.cc:290] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 3 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:39.324326 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 101973us
I20260709 13:09:39.331337 24138 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.334363 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:39.335026 23540 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.340857 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aecea6ace44d388502b338a5f8bdea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
I20260709 13:09:39.346483 23540 raft_consensus.cc:2468] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 3.
I20260709 13:09:39.369509 23437 leader_election.cc:304] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:39.370370 24313 raft_consensus.cc:2804] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:39.370879 24313 raft_consensus.cc:697] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 3 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:39.371670 24313 consensus_queue.cc:237] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.389269 24095 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:39.397812 23437 leader_election.cc:343] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.406082 24095 tablet_bootstrap.cc:492] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.407236 24095 ts_tablet_manager.cc:1403] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.301s	user 0.021s	sys 0.001s
I20260709 13:09:39.409723 24095 raft_consensus.cc:359] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.411841 24095 raft_consensus.cc:740] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.413921 23216 catalog_manager.cc:5697] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 3, leader changed from 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.416957 24095 consensus_queue.cc:260] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.419636 24095 ts_tablet_manager.cc:1434] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:39.466156 24095 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.549664 24095 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.550930 24095 tablet_bootstrap.cc:492] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.551734 24095 ts_tablet_manager.cc:1403] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.086s	user 0.036s	sys 0.023s
I20260709 13:09:39.554731 24095 raft_consensus.cc:359] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.555615 24095 raft_consensus.cc:740] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.556589 24095 consensus_queue.cc:260] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.558735 24095 ts_tablet_manager.cc:1434] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:39.565933 24095 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.624852 24095 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.625960 24095 tablet_bootstrap.cc:492] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.626642 24095 ts_tablet_manager.cc:1403] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.061s	user 0.034s	sys 0.007s
I20260709 13:09:39.629400 24095 raft_consensus.cc:359] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:39.630158 24095 raft_consensus.cc:740] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.630822 24095 consensus_queue.cc:260] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:39.639314 24095 ts_tablet_manager.cc:1434] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:39.648219 24095 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:39.657156 23511 consensus_peers.cc:597] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:39.672698 24095 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.673537 24095 tablet_bootstrap.cc:492] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.674103 24095 ts_tablet_manager.cc:1403] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:09:39.675992 24095 raft_consensus.cc:359] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:39.676613 24095 raft_consensus.cc:740] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.677181 24095 consensus_queue.cc:260] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:39.679040 24095 ts_tablet_manager.cc:1434] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:39.680158 24095 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:39.723145 23437 consensus_peers.cc:597] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:39.728464 24095 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.729496 24095 tablet_bootstrap.cc:492] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.730160 24095 ts_tablet_manager.cc:1403] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.013s
I20260709 13:09:39.733166 24095 raft_consensus.cc:359] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:39.734244 24095 raft_consensus.cc:740] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.734930 24095 consensus_queue.cc:260] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:39.744407 24095 ts_tablet_manager.cc:1434] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:39.745404 24095 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.775013 24095 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.776034 24095 tablet_bootstrap.cc:492] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.776867 24095 ts_tablet_manager.cc:1403] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.009s
I20260709 13:09:39.779520 24095 raft_consensus.cc:359] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.780228 24095 raft_consensus.cc:740] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.802769 24095 consensus_queue.cc:260] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.807441 24095 ts_tablet_manager.cc:1434] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:09:39.808322 24095 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.818783 24138 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.840229 24095 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.841491 24095 tablet_bootstrap.cc:492] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.842211 24095 ts_tablet_manager.cc:1403] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.000s
I20260709 13:09:39.845793 24095 raft_consensus.cc:359] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.846596 24095 raft_consensus.cc:740] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.847394 24095 consensus_queue.cc:260] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:39.862052 24095 ts_tablet_manager.cc:1434] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:39.863041 24095 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.876703 23545 raft_consensus.cc:1275] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:39.878994 24311 consensus_queue.cc:1048] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.908387 24095 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.909468 24095 tablet_bootstrap.cc:492] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:39.910276 24095 ts_tablet_manager.cc:1403] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.009s
I20260709 13:09:39.913547 24095 raft_consensus.cc:359] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:39.914309 24095 raft_consensus.cc:740] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.915426 24095 consensus_queue.cc:260] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:39.918499 24095 ts_tablet_manager.cc:1434] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:39.919500 24095 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:39.996424 24138 raft_consensus.cc:3060] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.018347 24095 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.019443 24095 tablet_bootstrap.cc:492] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.020156 24095 ts_tablet_manager.cc:1403] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.058s
I20260709 13:09:40.023243 24095 raft_consensus.cc:359] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.023948 24095 raft_consensus.cc:740] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.024725 24095 consensus_queue.cc:260] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.026719 24095 ts_tablet_manager.cc:1434] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:40.028506 24138 raft_consensus.cc:1275] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:40.028955 24095 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:40.030323 24311 consensus_queue.cc:1048] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.070070 24095 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.071619 24095 tablet_bootstrap.cc:492] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.072477 24095 ts_tablet_manager.cc:1403] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.016s
I20260709 13:09:40.075318 24095 raft_consensus.cc:359] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.076177 24095 raft_consensus.cc:740] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.077229 24095 consensus_queue.cc:260] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.079963 24095 ts_tablet_manager.cc:1434] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:40.080760 24095 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:40.116024 23437 consensus_peers.cc:597] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:40.168506 24095 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.169669 24095 tablet_bootstrap.cc:492] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.170514 24095 ts_tablet_manager.cc:1403] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.090s	user 0.031s	sys 0.036s
I20260709 13:09:40.173429 24095 raft_consensus.cc:359] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:40.174265 24095 raft_consensus.cc:740] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.175071 24095 consensus_queue.cc:260] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:40.176898 24095 ts_tablet_manager.cc:1434] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:40.178699 24095 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:40.179503 24145 raft_consensus.cc:3060] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.233052 24095 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.234421 24095 tablet_bootstrap.cc:492] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.235134 24143 raft_consensus.cc:3060] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.236092 24095 ts_tablet_manager.cc:1403] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.021s
I20260709 13:09:40.238915 24095 raft_consensus.cc:359] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.239645 24095 raft_consensus.cc:740] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.240374 24095 consensus_queue.cc:260] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.242625 24095 ts_tablet_manager.cc:1434] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:40.243484 24095 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
W20260709 13:09:40.269170 23437 consensus_peers.cc:597] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.292397 24140 raft_consensus.cc:3060] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.325141 24095 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.329636 24095 tablet_bootstrap.cc:492] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.330699 24095 ts_tablet_manager.cc:1403] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.087s	user 0.034s	sys 0.026s
I20260709 13:09:40.334029 24095 raft_consensus.cc:359] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:40.340258 24095 raft_consensus.cc:740] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.341084 24095 consensus_queue.cc:260] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:40.347947 24095 ts_tablet_manager.cc:1434] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:09:40.348902 24095 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:40.395351 24095 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.396382 24095 tablet_bootstrap.cc:492] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.396973 24095 ts_tablet_manager.cc:1403] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.023s
I20260709 13:09:40.398947 24095 raft_consensus.cc:359] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.399530 24095 raft_consensus.cc:740] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.400177 24095 consensus_queue.cc:260] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.402395 24095 ts_tablet_manager.cc:1434] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:40.403955 24095 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:40.433429 24095 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.434478 24095 tablet_bootstrap.cc:492] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.435196 24095 ts_tablet_manager.cc:1403] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.008s
I20260709 13:09:40.437808 24095 raft_consensus.cc:359] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:40.438524 24095 raft_consensus.cc:740] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.439226 24095 consensus_queue.cc:260] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:40.441442 24095 ts_tablet_manager.cc:1434] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:40.442425 24095 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap starting.
I20260709 13:09:40.460186 24095 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.461181 24095 tablet_bootstrap.cc:492] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Bootstrap complete.
I20260709 13:09:40.461966 24095 ts_tablet_manager.cc:1403] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:09:40.464584 24095 raft_consensus.cc:359] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.465328 24095 raft_consensus.cc:740] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.465972 24095 consensus_queue.cc:260] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:40.468505 24095 ts_tablet_manager.cc:1434] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:40.766266 24143 raft_consensus.cc:3060] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:41.705124 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:34005, user_credentials={real_user=slave}} blocked reactor thread for 57259.9us
W20260709 13:09:41.779016 23363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 59170.3us
I20260709 13:09:46.973773 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:47.063216 23540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049"
dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
mode: GRACEFUL
new_leader_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:46084
I20260709 13:09:47.064153 23540 raft_consensus.cc:606] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Received request to transfer leadership to TS 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:47.082414 23394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "83a33b9d895a442287d4b46856f57a60"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:47.083030 23394 raft_consensus.cc:606] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:47.099802 23470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
mode: GRACEFUL
new_leader_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:09:47.100436 23470 raft_consensus.cc:606] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Received request to transfer leadership to TS 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:47.103529 23394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:47.104148 23394 raft_consensus.cc:606] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:47.107221 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:47.107851 23398 raft_consensus.cc:606] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:47.110674 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:47.111317 23398 raft_consensus.cc:606] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:47.114951 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:47.116436 23398 raft_consensus.cc:606] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:47.118506 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:09:47.120052 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:47.120731 24369 raft_consensus.cc:993] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: : Instructing follower 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:47.121474 24361 raft_consensus.cc:1081] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Signalling peer 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:47.123399 23398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:09:47.124028 23398 raft_consensus.cc:493] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.124469 23398 raft_consensus.cc:3060] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.136698 23398 raft_consensus.cc:515] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.141800 23398 leader_election.cc:290] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:47.142170 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:47.143134 23472 raft_consensus.cc:3060] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.147135 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0623e04a00fb4ef7bf47ed03410a5049" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:47.147884 23540 raft_consensus.cc:3055] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:47.148329 23540 raft_consensus.cc:740] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:47.149303 23540 consensus_queue.cc:260] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.151153 23540 raft_consensus.cc:3060] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.155230 23472 raft_consensus.cc:2468] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:47.156728 23365 leader_election.cc:304] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:47.157845 24366 raft_consensus.cc:2804] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.158342 24366 raft_consensus.cc:697] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.160410 24366 consensus_queue.cc:237] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.172852 23215 catalog_manager.cc:5697] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.176962 23540 raft_consensus.cc:2468] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:47.253582 24376 raft_consensus.cc:993] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.254413 24362 raft_consensus.cc:1081] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.257061 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:47.257658 24140 raft_consensus.cc:493] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.258102 24140 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.266427 24359 raft_consensus.cc:993] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: : Instructing follower 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:47.267253 24368 raft_consensus.cc:1081] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Signalling peer 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:47.270524 24140 raft_consensus.cc:515] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.272596 23398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:09:47.273083 24140 leader_election.cc:290] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:47.273316 23398 raft_consensus.cc:493] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.273729 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:47.273869 23398 raft_consensus.cc:3060] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.274477 23394 raft_consensus.cc:3055] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:47.274833 23394 raft_consensus.cc:740] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.275605 23394 consensus_queue.cc:260] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.276646 23394 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.277915 23472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16aa3c6fc924654b9a831ea21ada64d" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:47.282292 23472 raft_consensus.cc:3060] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.295944 24376 raft_consensus.cc:993] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 83a33b9d895a442287d4b46856f57a60 to start an election
I20260709 13:09:47.296543 24376 raft_consensus.cc:1081] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 83a33b9d895a442287d4b46856f57a60 to start an election
I20260709 13:09:47.299088 23470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
 from {username='slave'} at 127.0.0.1:43904
I20260709 13:09:47.299631 23470 raft_consensus.cc:493] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.299993 23470 raft_consensus.cc:3060] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.300199 23394 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:47.301879 24090 leader_election.cc:304] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:47.322073 24376 raft_consensus.cc:993] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.322793 24376 raft_consensus.cc:1081] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.325471 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:47.326385 24138 raft_consensus.cc:493] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.326704 24138 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.329527 23398 raft_consensus.cc:515] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.331990 23398 leader_election.cc:290] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:47.333189 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:47.333847 23540 raft_consensus.cc:3060] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.336069 24138 raft_consensus.cc:515] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.336231 23472 raft_consensus.cc:2468] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:47.337524 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb06ec9f38f44c28c9059cefb321a04" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:47.340986 23468 raft_consensus.cc:3055] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:47.341405 23468 raft_consensus.cc:740] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:47.342465 23468 consensus_queue.cc:260] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.343779 24138 leader_election.cc:290] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:47.344895 23467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:47.345364 23468 raft_consensus.cc:3060] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.345572 23467 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.351051 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d0a0dbdf2f4194b4ba44d16193ee2e" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:47.351776 23394 raft_consensus.cc:3055] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:47.352248 23394 raft_consensus.cc:740] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.353379 23394 consensus_queue.cc:260] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.361186 23394 raft_consensus.cc:3060] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.338209 24381 raft_consensus.cc:2804] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:47.362100 23540 raft_consensus.cc:2468] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:47.364913 23363 leader_election.cc:304] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:47.365031 23467 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:47.366844 24092 leader_election.cc:304] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:47.372680 24362 raft_consensus.cc:2804] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.374667 24362 raft_consensus.cc:697] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.375455 24384 raft_consensus.cc:2804] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:47.375635 24362 consensus_queue.cc:237] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.376166 24384 raft_consensus.cc:697] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:47.377727 24384 consensus_queue.cc:237] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.378863 23470 raft_consensus.cc:515] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.379201 24381 raft_consensus.cc:697] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:47.383082 23394 raft_consensus.cc:2468] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:47.376318 23468 raft_consensus.cc:2468] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:47.388690 24381 consensus_queue.cc:237] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.407424 23470 leader_election.cc:290] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:47.408540 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:47.408442 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d125c0c59b849edb09535466ab6ffba" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:47.409329 23540 raft_consensus.cc:3060] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.409544 23394 raft_consensus.cc:3055] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:47.410082 23394 raft_consensus.cc:740] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.419668 23540 raft_consensus.cc:2468] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:47.419562 23215 catalog_manager.cc:5697] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 83a33b9d895a442287d4b46856f57a60 (127.14.45.3) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.421141 23437 leader_election.cc:304] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:47.422339 24380 raft_consensus.cc:2804] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.422804 24380 raft_consensus.cc:697] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:47.420281 23394 consensus_queue.cc:260] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.423655 24380 consensus_queue.cc:237] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:47.424263 23394 raft_consensus.cc:3060] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.443849 23216 catalog_manager.cc:5697] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 2 to 3, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.456625 23394 raft_consensus.cc:2468] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:47.484880 23216 catalog_manager.cc:5697] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 2 to 3, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.484161 23215 catalog_manager.cc:5697] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.531889 24366 raft_consensus.cc:993] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.532466 24362 raft_consensus.cc:1081] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.534336 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:47.534929 24140 raft_consensus.cc:493] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.535182 24140 raft_consensus.cc:3060] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.541339 24140 raft_consensus.cc:515] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.543222 24140 leader_election.cc:290] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:47.543867 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:47.544348 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa22c116262947f39fbe06c006be0cf3" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:47.544567 23394 raft_consensus.cc:3055] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:47.544981 23470 raft_consensus.cc:3060] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.545107 23394 raft_consensus.cc:740] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.546190 23394 consensus_queue.cc:260] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.547595 23394 raft_consensus.cc:3060] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.552642 23470 raft_consensus.cc:2468] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:47.554086 24376 raft_consensus.cc:993] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.554180 24092 leader_election.cc:304] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:47.554818 24376 raft_consensus.cc:1081] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:47.555896 24381 raft_consensus.cc:2804] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.556476 24381 raft_consensus.cc:697] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:47.556996 23394 raft_consensus.cc:2468] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:47.557566 24381 consensus_queue.cc:237] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:47.559577 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:47.560179 24138 raft_consensus.cc:493] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.560555 24138 raft_consensus.cc:3060] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.569319 24138 raft_consensus.cc:515] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:47.575567 24138 leader_election.cc:290] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:47.577199 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:47.577575 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fb88e4ccef4a92b6d7370ff8456d98" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:47.578290 23540 raft_consensus.cc:3060] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.578449 23394 raft_consensus.cc:3055] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:47.578935 23394 raft_consensus.cc:740] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:47.579734 23394 consensus_queue.cc:260] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:47.581830 23394 raft_consensus.cc:3060] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.582335 23215 catalog_manager.cc:5697] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.589543 23394 raft_consensus.cc:2468] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:47.591449 24090 leader_election.cc:304] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:47.592268 24381 raft_consensus.cc:2804] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.590065 23540 raft_consensus.cc:2468] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:47.593667 24381 raft_consensus.cc:697] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:47.596921 24381 consensus_queue.cc:237] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:47.619696 23215 catalog_manager.cc:5697] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.634140 23470 raft_consensus.cc:1275] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.635437 24366 consensus_queue.cc:1048] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.673605 23545 raft_consensus.cc:1275] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.675935 24362 consensus_queue.cc:1048] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.781211 23470 raft_consensus.cc:1275] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.782742 24381 consensus_queue.cc:1048] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:47.809207 23394 raft_consensus.cc:1275] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.811040 24381 consensus_queue.cc:1048] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:47.867434 23470 raft_consensus.cc:1275] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.868989 24376 consensus_queue.cc:1048] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.886088 23545 raft_consensus.cc:1275] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.887693 24362 consensus_queue.cc:1048] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.940232 23394 raft_consensus.cc:1275] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.941655 24381 consensus_queue.cc:1048] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.947603 23398 raft_consensus.cc:1275] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.949144 24380 consensus_queue.cc:1048] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.954080 23470 raft_consensus.cc:1275] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.956120 24381 consensus_queue.cc:1048] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.982553 23545 raft_consensus.cc:1275] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.984184 23470 raft_consensus.cc:1275] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.986086 24384 consensus_queue.cc:1048] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:47.987787 24359 consensus_queue.cc:1048] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.989346 23398 raft_consensus.cc:1275] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.995134 24384 consensus_queue.cc:1048] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:48.110782 23398 raft_consensus.cc:1275] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.112389 24384 consensus_queue.cc:1048] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.121286 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.125707 23545 raft_consensus.cc:1275] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.127666 24384 consensus_queue.cc:1048] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.179481 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.216051 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:48.216567 23398 raft_consensus.cc:606] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:48.219007 23470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
mode: GRACEFUL
new_leader_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:09:48.219530 23470 raft_consensus.cc:606] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Received request to transfer leadership to TS 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:48.223703 23470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
mode: GRACEFUL
new_leader_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:09:48.224270 23470 raft_consensus.cc:606] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Received request to transfer leadership to TS 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:48.226536 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:48.227018 23398 raft_consensus.cc:606] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:48.229332 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:48.229868 23398 raft_consensus.cc:606] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:48.232143 23545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83"
dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46084
I20260709 13:09:48.232702 23545 raft_consensus.cc:606] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:48.233875 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:48.235517 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:48.265542 24361 raft_consensus.cc:993] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.266172 24364 raft_consensus.cc:1081] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.266470 24366 raft_consensus.cc:993] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.267005 24362 raft_consensus.cc:1081] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.268088 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45900
I20260709 13:09:48.268599 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:48.268662 24140 raft_consensus.cc:493] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.269214 24138 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.269405 24140 raft_consensus.cc:3060] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.269647 24138 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.275064 24138 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.275744 24140 raft_consensus.cc:515] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:48.277825 24366 raft_consensus.cc:993] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.278755 24138 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:48.278970 23545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:48.279358 24401 raft_consensus.cc:1081] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.279901 23545 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.280537 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:48.281126 23540 raft_consensus.cc:3055] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.281457 23540 raft_consensus.cc:740] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:48.282233 23540 consensus_queue.cc:260] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:48.282881 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa37604736d74fe9ab5b98ecb52b2d83" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:48.283278 23540 raft_consensus.cc:3060] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.283427 23470 raft_consensus.cc:3060] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.285257 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:48.285874 24138 raft_consensus.cc:493] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.286224 24138 raft_consensus.cc:3060] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.285871 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f73d1ea60d4e67b869c7388c8b9df4" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:48.286743 23398 raft_consensus.cc:3055] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:48.287056 23398 raft_consensus.cc:740] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:48.277954 24140 leader_election.cc:290] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:48.293004 24138 raft_consensus.cc:515] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.293045 23398 consensus_queue.cc:260] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.297607 23398 raft_consensus.cc:3060] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.300316 23470 raft_consensus.cc:2468] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:48.302585 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:48.302692 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70646f6eebd7451ab1f6c4030b732600" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:48.303390 23394 raft_consensus.cc:3055] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.303412 23541 raft_consensus.cc:3060] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.304301 23394 raft_consensus.cc:740] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:48.305235 23394 consensus_queue.cc:260] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.306303 23394 raft_consensus.cc:3060] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.301010 23545 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:48.307819 23539 raft_consensus.cc:1240] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Rejecting Update request from peer 5227af10b4e44d23b9afdeff9f43a849 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:48.313609 24092 leader_election.cc:304] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:48.314635 24384 raft_consensus.cc:2804] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.315171 24384 raft_consensus.cc:697] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:48.316025 24384 consensus_queue.cc:237] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:48.316744 23398 raft_consensus.cc:2468] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:48.303181 24138 leader_election.cc:290] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:48.323349 24090 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:48.324239 24381 raft_consensus.cc:2804] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:48.324759 24381 raft_consensus.cc:697] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:48.325767 24381 consensus_queue.cc:237] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.326200 23541 raft_consensus.cc:2468] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:48.329274 23394 raft_consensus.cc:2468] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:48.338363 24090 leader_election.cc:304] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:48.339246 23217 catalog_manager.cc:5697] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.344774 23540 raft_consensus.cc:2468] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:48.348114 24381 raft_consensus.cc:2804] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.348697 24381 raft_consensus.cc:697] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:48.349639 24381 consensus_queue.cc:237] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.376111 23216 catalog_manager.cc:5697] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 2 to 3, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.377795 23216 catalog_manager.cc:5697] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.476063 24368 raft_consensus.cc:993] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: : Instructing follower 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:48.476730 24359 raft_consensus.cc:1081] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Signalling peer 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:48.478168 23398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:09:48.478650 23398 raft_consensus.cc:493] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.478984 23398 raft_consensus.cc:3060] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.484236 23398 raft_consensus.cc:515] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:48.485678 23398 leader_election.cc:290] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:48.486626 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:48.486508 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c40a2a2441a4fb790b33bfcfd880413" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:48.487401 23540 raft_consensus.cc:3060] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.487423 23470 raft_consensus.cc:3055] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.488098 23470 raft_consensus.cc:740] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:48.488950 23470 consensus_queue.cc:260] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:48.489965 23470 raft_consensus.cc:3060] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.493561 23540 raft_consensus.cc:2468] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:48.494515 23470 raft_consensus.cc:2468] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:48.494846 23363 leader_election.cc:304] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:48.495867 24362 raft_consensus.cc:2804] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.496325 24362 raft_consensus.cc:697] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:48.496978 24362 consensus_queue.cc:237] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:48.506695 23216 catalog_manager.cc:5697] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 83a33b9d895a442287d4b46856f57a60 (127.14.45.3) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.575277 24380 raft_consensus.cc:993] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: : Instructing follower 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:48.575796 24359 raft_consensus.cc:1081] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Signalling peer 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:48.577356 23398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:09:48.577920 23398 raft_consensus.cc:493] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.578255 23398 raft_consensus.cc:3060] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.583819 23398 raft_consensus.cc:515] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:48.585376 23398 leader_election.cc:290] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:48.586169 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:48.586261 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270bce0e96a24453b6b35f8451f5c7dc" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:48.586874 23470 raft_consensus.cc:3055] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.586944 23540 raft_consensus.cc:3060] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.587195 23470 raft_consensus.cc:740] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:48.587975 23470 consensus_queue.cc:260] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:48.589196 23470 raft_consensus.cc:3060] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.592937 23540 raft_consensus.cc:2468] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:48.594255 23363 leader_election.cc:304] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:48.595399 23470 raft_consensus.cc:2468] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:48.598145 24362 raft_consensus.cc:2804] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.598690 24362 raft_consensus.cc:697] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:48.599473 24362 consensus_queue.cc:237] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:48.613600 23216 catalog_manager.cc:5697] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from 83a33b9d895a442287d4b46856f57a60 (127.14.45.3) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.752730 23540 raft_consensus.cc:1275] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.753897 24384 consensus_queue.cc:1048] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.763564 23470 raft_consensus.cc:1275] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.765107 24384 consensus_queue.cc:1048] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.802167 23398 raft_consensus.cc:1275] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:48.803459 24381 consensus_queue.cc:1048] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.813109 23540 raft_consensus.cc:1275] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:48.818823 24381 consensus_queue.cc:1048] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.826737 24401 raft_consensus.cc:993] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.827315 24401 raft_consensus.cc:1081] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:48.829001 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:48.829675 24138 raft_consensus.cc:493] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.830176 24138 raft_consensus.cc:3060] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.840602 24138 raft_consensus.cc:515] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.844599 24138 leader_election.cc:290] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:48.845476 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:48.846184 23541 raft_consensus.cc:3060] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.850181 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dfcecaa22e4ea58c57fcee6c5ec966" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:48.850827 23398 raft_consensus.cc:3055] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.851125 23398 raft_consensus.cc:740] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:48.851866 23398 consensus_queue.cc:260] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.853091 23398 raft_consensus.cc:3060] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.853869 23541 raft_consensus.cc:2468] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:48.856173 24090 leader_election.cc:304] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:48.856922 24381 raft_consensus.cc:2804] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.857021 23394 raft_consensus.cc:1275] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.857435 24381 raft_consensus.cc:697] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:48.858456 24381 consensus_queue.cc:237] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:48.861336 23398 raft_consensus.cc:2468] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:48.869624 24383 consensus_queue.cc:1048] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.873674 23216 catalog_manager.cc:5697] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.899015 23541 raft_consensus.cc:1275] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.901189 24383 consensus_queue.cc:1048] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.997212 23470 raft_consensus.cc:1275] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.998409 24401 consensus_queue.cc:1048] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.011229 23541 raft_consensus.cc:1275] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.013236 24362 consensus_queue.cc:1048] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.157930 23541 raft_consensus.cc:1275] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.159317 24362 consensus_queue.cc:1048] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.168300 23470 raft_consensus.cc:1275] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.169996 24366 consensus_queue.cc:1048] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.236390 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.268369 23398 raft_consensus.cc:1275] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.269603 24381 consensus_queue.cc:1048] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.280434 23541 raft_consensus.cc:1275] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.282045 24384 consensus_queue.cc:1048] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.283041 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.328860 23541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92"
dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
mode: GRACEFUL
new_leader_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:46084
I20260709 13:09:49.329452 23541 raft_consensus.cc:606] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Received request to transfer leadership to TS 5227af10b4e44d23b9afdeff9f43a849
I20260709 13:09:49.332683 23470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:09:49.333251 23470 raft_consensus.cc:606] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:49.336004 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "83a33b9d895a442287d4b46856f57a60"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:49.336431 23398 raft_consensus.cc:606] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:49.339138 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:49.339614 23398 raft_consensus.cc:606] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:49.342826 23541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca"
dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46084
I20260709 13:09:49.343343 23541 raft_consensus.cc:606] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:49.344581 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:49.345881 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:49.390816 24362 raft_consensus.cc:993] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:49.391347 24366 raft_consensus.cc:1081] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:49.392699 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45886
I20260709 13:09:49.393226 24138 raft_consensus.cc:493] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.393651 24138 raft_consensus.cc:3060] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.399694 24138 raft_consensus.cc:515] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:49.401684 24138 leader_election.cc:290] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:49.402303 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:49.402932 23540 raft_consensus.cc:3060] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.403851 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4a5edf9439448a85d0cf3f5d53996b" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:49.404497 23398 raft_consensus.cc:3055] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.404755 23398 raft_consensus.cc:740] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:49.405445 23398 consensus_queue.cc:260] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:49.406517 23398 raft_consensus.cc:3060] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.413046 23398 raft_consensus.cc:2468] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:49.414423 24090 leader_election.cc:304] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:49.415314 24383 raft_consensus.cc:2804] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.416491 24383 raft_consensus.cc:697] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:49.417060 23540 raft_consensus.cc:2468] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:49.417464 24383 consensus_queue.cc:237] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:49.429306 23216 catalog_manager.cc:5697] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.447587 24429 raft_consensus.cc:993] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: : Instructing follower 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:49.448112 24361 raft_consensus.cc:1081] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Signalling peer 5227af10b4e44d23b9afdeff9f43a849 to start an election
I20260709 13:09:49.449774 23398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:09:49.450227 23398 raft_consensus.cc:493] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.450604 23398 raft_consensus.cc:3060] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.455538 23398 raft_consensus.cc:515] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:49.457093 23398 leader_election.cc:290] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:49.457849 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:49.458011 23540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470aca24cb8b4480a3395752f86d1a92" candidate_uuid: "5227af10b4e44d23b9afdeff9f43a849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:49.458483 23470 raft_consensus.cc:3060] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.458585 23540 raft_consensus.cc:3055] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.458946 23540 raft_consensus.cc:740] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:49.459594 23540 consensus_queue.cc:260] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:49.460493 23540 raft_consensus.cc:3060] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.463199 23470 raft_consensus.cc:2468] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:49.464432 23365 leader_election.cc:304] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:49.465161 24366 raft_consensus.cc:2804] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.465597 24366 raft_consensus.cc:697] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Becoming Leader. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:49.465852 23540 raft_consensus.cc:2468] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5227af10b4e44d23b9afdeff9f43a849 in term 2.
I20260709 13:09:49.466470 24366 consensus_queue.cc:237] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:49.476797 23216 catalog_manager.cc:5697] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 reported cstate change: term changed from 1 to 2, leader changed from a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4) to 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "5227af10b4e44d23b9afdeff9f43a849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.607038 24359 raft_consensus.cc:993] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:49.607506 24380 raft_consensus.cc:1081] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:49.608827 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45896
I20260709 13:09:49.609265 24138 raft_consensus.cc:493] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.609509 24138 raft_consensus.cc:3060] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.613926 24138 raft_consensus.cc:515] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:49.615454 24138 leader_election.cc:290] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:49.616300 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:49.616428 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee83cf672964ae8875b8899f5c8a0b8" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:49.617029 23470 raft_consensus.cc:3055] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.617177 23541 raft_consensus.cc:3060] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.617421 23470 raft_consensus.cc:740] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:49.618453 23470 consensus_queue.cc:260] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:49.619608 23470 raft_consensus.cc:3060] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.626436 23541 raft_consensus.cc:2468] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:49.628042 23470 raft_consensus.cc:2468] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:49.628647 24090 leader_election.cc:304] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd2728dca8a44f79946d0da19b32c53, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:49.630062 24384 raft_consensus.cc:2804] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.631040 24384 raft_consensus.cc:697] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:49.632241 24384 consensus_queue.cc:237] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:49.644353 23216 catalog_manager.cc:5697] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 83a33b9d895a442287d4b46856f57a60 (127.14.45.3) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.690582 24362 raft_consensus.cc:993] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 83a33b9d895a442287d4b46856f57a60 to start an election
I20260709 13:09:49.691102 24362 raft_consensus.cc:1081] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 83a33b9d895a442287d4b46856f57a60 to start an election
I20260709 13:09:49.692750 23470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
 from {username='slave'} at 127.0.0.1:43904
I20260709 13:09:49.693364 23470 raft_consensus.cc:493] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.693782 23470 raft_consensus.cc:3060] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.702579 23470 raft_consensus.cc:515] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:49.704200 23470 leader_election.cc:290] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:49.705010 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:49.705251 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f394ca7ac8e4fb0904b5c5129a503fc" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:49.705715 23398 raft_consensus.cc:3055] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.706014 23541 raft_consensus.cc:3060] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.706147 23398 raft_consensus.cc:740] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:49.707056 23398 consensus_queue.cc:260] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:49.708026 23398 raft_consensus.cc:3060] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.711879 23541 raft_consensus.cc:2468] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:49.713079 23398 raft_consensus.cc:2468] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:49.713258 23437 leader_election.cc:304] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, a1265f7d704d41df83adf9f1c74d3f03; no voters: 
I20260709 13:09:49.714181 24359 raft_consensus.cc:2804] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.714673 24359 raft_consensus.cc:697] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:49.715593 24359 consensus_queue.cc:237] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:49.729277 23215 catalog_manager.cc:5697] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.785984 24361 raft_consensus.cc:993] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:49.786594 24429 raft_consensus.cc:1081] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:49.788286 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45900
I20260709 13:09:49.788926 24138 raft_consensus.cc:493] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.789338 24138 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:49.795612 24138 raft_consensus.cc:515] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:49.797134 24138 leader_election.cc:290] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 4 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:49.798149 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:49.798087 23470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f771ca377747d1a9e0dbea4321b0ca" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:49.799078 23470 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:49.798940 23541 raft_consensus.cc:3055] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:49.799737 23541 raft_consensus.cc:740] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:49.800542 23541 consensus_queue.cc:260] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:49.802347 23541 raft_consensus.cc:3060] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:49.806282 23470 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 4.
I20260709 13:09:49.807682 24092 leader_election.cc:304] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:49.808854 24383 raft_consensus.cc:2804] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:49.809376 24383 raft_consensus.cc:697] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 4 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:49.810220 24383 consensus_queue.cc:237] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:49.812170 23541 raft_consensus.cc:2468] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 4.
I20260709 13:09:49.822646 23215 catalog_manager.cc:5697] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 3 to 4, leader changed from a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 4 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.858630 23398 raft_consensus.cc:1275] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.859936 24381 consensus_queue.cc:1048] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.870981 23541 raft_consensus.cc:1275] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.873667 24383 consensus_queue.cc:1048] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.935585 23470 raft_consensus.cc:1275] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.936800 24362 consensus_queue.cc:1048] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.956508 23541 raft_consensus.cc:1275] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 5227af10b4e44d23b9afdeff9f43a849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.965497 24366 consensus_queue.cc:1048] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:50.068718 23541 raft_consensus.cc:1275] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.070340 24384 consensus_queue.cc:1048] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.084400 23470 raft_consensus.cc:1275] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.086156 24384 consensus_queue.cc:1048] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.182776 23394 raft_consensus.cc:1275] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.183938 24380 consensus_queue.cc:1048] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.213550 23541 raft_consensus.cc:1275] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.216383 24380 consensus_queue.cc:1048] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.280514 23541 raft_consensus.cc:1275] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 4 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:50.282130 24384 consensus_queue.cc:1048] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.294461 23470 raft_consensus.cc:1275] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 4 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:50.295904 24381 consensus_queue.cc:1048] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.346655 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.390362 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.425995 23470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:09:50.426431 23470 raft_consensus.cc:606] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:50.428850 23398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea"
dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
mode: GRACEFUL
new_leader_uuid: "83a33b9d895a442287d4b46856f57a60"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:09:50.429286 23398 raft_consensus.cc:606] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Received request to transfer leadership to TS 83a33b9d895a442287d4b46856f57a60
I20260709 13:09:50.431779 23541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7"
dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:46084
I20260709 13:09:50.432231 23541 raft_consensus.cc:606] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:50.433471 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:50.434844 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:50.523159 24429 raft_consensus.cc:993] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:50.523931 24361 raft_consensus.cc:1081] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:50.525803 24143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45900
I20260709 13:09:50.526538 24143 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.526952 24143 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.532469 24143 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:50.534296 24143 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Requested vote from peers a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:50.534876 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:50.535269 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3539d30340348c89b32e10d26f060a7" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:50.535594 23541 raft_consensus.cc:3055] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:50.535898 23394 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.535948 23541 raft_consensus.cc:740] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1265f7d704d41df83adf9f1c74d3f03, State: Running, Role: LEADER
I20260709 13:09:50.536896 23541 consensus_queue.cc:260] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:50.538355 23541 raft_consensus.cc:3060] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.546631 23394 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:50.547459 23541 raft_consensus.cc:2468] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:50.548058 24090 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:50.548884 24383 raft_consensus.cc:2804] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.549335 24383 raft_consensus.cc:697] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:50.550360 24383 consensus_queue.cc:237] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:50.560323 23216 catalog_manager.cc:5697] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 2 to 3, leader changed from a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.567543 24401 raft_consensus.cc:993] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: : Instructing follower 83a33b9d895a442287d4b46856f57a60 to start an election
I20260709 13:09:50.568130 24366 raft_consensus.cc:1081] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Signalling peer 83a33b9d895a442287d4b46856f57a60 to start an election
I20260709 13:09:50.569650 23468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
 from {username='slave'} at 127.0.0.1:43904
I20260709 13:09:50.570174 23468 raft_consensus.cc:493] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.570514 23468 raft_consensus.cc:3060] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.575824 23468 raft_consensus.cc:515] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:50.577205 23468 leader_election.cc:290] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), a1265f7d704d41df83adf9f1c74d3f03 (127.14.45.4:43503)
I20260709 13:09:50.578058 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:50.578652 23394 raft_consensus.cc:3055] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.578501 23541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392ac267824ea8acd63f7b708f1aea" candidate_uuid: "83a33b9d895a442287d4b46856f57a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1265f7d704d41df83adf9f1c74d3f03"
I20260709 13:09:50.579010 23394 raft_consensus.cc:740] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5227af10b4e44d23b9afdeff9f43a849, State: Running, Role: LEADER
I20260709 13:09:50.579231 23541 raft_consensus.cc:3060] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.580365 23394 consensus_queue.cc:260] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:50.581573 23394 raft_consensus.cc:3060] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.586985 23394 raft_consensus.cc:2468] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:50.587131 23541 raft_consensus.cc:2468] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83a33b9d895a442287d4b46856f57a60 in term 2.
I20260709 13:09:50.588245 23437 leader_election.cc:304] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 83a33b9d895a442287d4b46856f57a60; no voters: 
I20260709 13:09:50.589176 24380 raft_consensus.cc:2804] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.589869 24380 raft_consensus.cc:697] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Leader. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:50.590667 24380 consensus_queue.cc:237] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } }
I20260709 13:09:50.604034 23215 catalog_manager.cc:5697] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 reported cstate change: term changed from 1 to 2, leader changed from 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2) to 83a33b9d895a442287d4b46856f57a60 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "83a33b9d895a442287d4b46856f57a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.729195 24380 raft_consensus.cc:993] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:50.729809 24456 raft_consensus.cc:1081] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:50.731467 24143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45896
I20260709 13:09:50.732065 24143 raft_consensus.cc:493] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.732417 24143 raft_consensus.cc:3060] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.740238 24143 raft_consensus.cc:515] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:50.743059 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:50.743498 23468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2dc354ec164815b07f203d5b6ddd16" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:50.743659 23398 raft_consensus.cc:3060] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.744122 23468 raft_consensus.cc:3055] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.744454 23468 raft_consensus.cc:740] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:50.745175 23468 consensus_queue.cc:260] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:50.746248 23468 raft_consensus.cc:3060] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.751449 23398 raft_consensus.cc:2468] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:50.752635 24143 leader_election.cc:290] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Requested vote from peers 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005), 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233)
I20260709 13:09:50.753278 24090 leader_election.cc:304] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:50.754194 24384 raft_consensus.cc:2804] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.755640 24384 raft_consensus.cc:697] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:50.755751 23468 raft_consensus.cc:2468] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 2.
I20260709 13:09:50.756660 24384 consensus_queue.cc:237] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } }
I20260709 13:09:50.772058 23215 catalog_manager.cc:5697] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 1 to 2, leader changed from 83a33b9d895a442287d4b46856f57a60 (127.14.45.3) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.971081 23394 raft_consensus.cc:1275] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.972363 24381 consensus_queue.cc:1048] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.991420 23540 raft_consensus.cc:1275] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.993485 24384 consensus_queue.cc:1048] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.048841 23540 raft_consensus.cc:1275] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.050288 24380 consensus_queue.cc:1048] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.065567 23398 raft_consensus.cc:1275] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 83a33b9d895a442287d4b46856f57a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.067301 24380 consensus_queue.cc:1048] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.180413 23468 raft_consensus.cc:1275] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.182036 24381 consensus_queue.cc:1048] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.197500 23398 raft_consensus.cc:1275] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.199268 24381 consensus_queue.cc:1048] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.435757 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.484987 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.529367 23468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a"
dest_uuid: "83a33b9d895a442287d4b46856f57a60"
mode: GRACEFUL
new_leader_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:09:51.530026 23468 raft_consensus.cc:606] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Received request to transfer leadership to TS 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:51.531860 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:51.533051 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:51.862006 23437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:39473, user_credentials={real_user=slave}} blocked reactor thread for 59032.3us
I20260709 13:09:51.922156 24470 raft_consensus.cc:993] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: : Instructing follower 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:51.924351 24491 raft_consensus.cc:1081] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Signalling peer 9dd2728dca8a44f79946d0da19b32c53 to start an election
I20260709 13:09:51.935213 24145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a"
dest_uuid: "9dd2728dca8a44f79946d0da19b32c53"
 from {username='slave'} at 127.0.0.1:45896
I20260709 13:09:51.936319 24145 raft_consensus.cc:493] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.936957 24145 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.956782 24145 raft_consensus.cc:515] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:51.959796 24145 leader_election.cc:290] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Requested vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:51.961138 23467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83a33b9d895a442287d4b46856f57a60"
I20260709 13:09:51.961053 23398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fc62a51cd40c78df360b93832f36a" candidate_uuid: "9dd2728dca8a44f79946d0da19b32c53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5227af10b4e44d23b9afdeff9f43a849"
I20260709 13:09:51.962010 23467 raft_consensus.cc:3055] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:51.962073 23398 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.962411 23467 raft_consensus.cc:740] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83a33b9d895a442287d4b46856f57a60, State: Running, Role: LEADER
I20260709 13:09:51.963445 23467 consensus_queue.cc:260] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:51.965080 23467 raft_consensus.cc:3060] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.969596 23398 raft_consensus.cc:2468] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:51.970932 24090 leader_election.cc:304] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53; no voters: 
I20260709 13:09:51.971765 24384 raft_consensus.cc:2804] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.972402 24384 raft_consensus.cc:697] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Becoming Leader. State: Replica: 9dd2728dca8a44f79946d0da19b32c53, State: Running, Role: LEADER
I20260709 13:09:51.975014 24384 consensus_queue.cc:237] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:51.980032 23467 raft_consensus.cc:2468] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd2728dca8a44f79946d0da19b32c53 in term 3.
I20260709 13:09:52.008594 23216 catalog_manager.cc:5697] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 reported cstate change: term changed from 2 to 3, leader changed from 83a33b9d895a442287d4b46856f57a60 (127.14.45.3) to 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "9dd2728dca8a44f79946d0da19b32c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.399914 23398 raft_consensus.cc:1275] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.401293 24468 consensus_queue.cc:1048] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:52.427992 23467 raft_consensus.cc:1275] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Refusing update from remote peer 9dd2728dca8a44f79946d0da19b32c53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.430320 24384 consensus_queue.cc:1048] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.534302 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.568732 14516 tablet_server.cc:179] TabletServer@127.14.45.1:39473 shutting down...
I20260709 13:09:52.607108 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:52.608173 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.609448 14516 raft_consensus.cc:2243] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.610697 14516 raft_consensus.cc:2272] T 4c2dc354ec164815b07f203d5b6ddd16 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.614501 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.615794 14516 raft_consensus.cc:2243] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.616308 14516 raft_consensus.cc:2272] T cff5bda8d894486ca77e2e65f89c0494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.619153 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.619804 14516 raft_consensus.cc:2243] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.620913 14516 raft_consensus.cc:2272] T 70646f6eebd7451ab1f6c4030b732600 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.623755 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.624440 14516 raft_consensus.cc:2243] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.625289 14516 raft_consensus.cc:2272] T c3539d30340348c89b32e10d26f060a7 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.627866 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.628573 14516 raft_consensus.cc:2243] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.629053 14516 raft_consensus.cc:2272] T 079d6319916749068ce3850998ab923a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.631896 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.632540 14516 raft_consensus.cc:2243] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:52.633047 23363 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 134 similar messages]
I20260709 13:09:52.633512 14516 raft_consensus.cc:2272] T c94a184780fd46dbab2854fb725ca574 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.638283 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.639238 14516 raft_consensus.cc:2243] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.640190 14516 raft_consensus.cc:2272] T c554bef114234298a189605cf26a64d1 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:52.640535 23363 consensus_peers.cc:597] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.644058 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.645248 14516 raft_consensus.cc:2243] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.645915 14516 raft_consensus.cc:2272] T 92aecea6ace44d388502b338a5f8bdea P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:52.647455 23437 consensus_peers.cc:597] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.648785 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.649503 14516 raft_consensus.cc:2243] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.650509 14516 raft_consensus.cc:2272] T 01f73d1ea60d4e67b869c7388c8b9df4 P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.653367 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.654070 14516 raft_consensus.cc:2243] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.654717 14516 raft_consensus.cc:2272] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.656752 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.657343 14516 raft_consensus.cc:2243] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.658160 14516 raft_consensus.cc:2272] T 8c4a5edf9439448a85d0cf3f5d53996b P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.661254 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.662355 14516 raft_consensus.cc:2243] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.663439 14516 raft_consensus.cc:2272] T 5ee83cf672964ae8875b8899f5c8a0b8 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:52.666702 23511 consensus_peers.cc:597] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.666911 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.667654 14516 raft_consensus.cc:2243] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.668118 14516 raft_consensus.cc:2272] T 69488a80b90e4fecb290b1a4249ea436 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.671336 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.672290 14516 raft_consensus.cc:2243] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.672868 14516 raft_consensus.cc:2272] T 50034ac82496425fac0be0a983f3fdc9 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.676915 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.677615 14516 raft_consensus.cc:2243] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.678161 14516 raft_consensus.cc:2272] T 52ab658aedf74a66805c779a3eb85bbc P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.681309 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.682089 14516 raft_consensus.cc:2243] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:52.682329 23363 consensus_peers.cc:597] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.682715 14516 raft_consensus.cc:2272] T 2385ef80a9064010a9965cd059570c71 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.685231 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.685838 14516 raft_consensus.cc:2243] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.686221 14516 raft_consensus.cc:2272] T ebdeb4d212974dcf9c19753ad30b5034 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.688530 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.689232 14516 raft_consensus.cc:2243] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.689828 14516 raft_consensus.cc:2272] T 891d07a8dc184d778dc815912cccc1ca P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.692574 14516 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:52.693110 23511 consensus_peers.cc:597] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.693181 14516 raft_consensus.cc:2243] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.694563 14516 raft_consensus.cc:2272] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.698124 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.699041 14516 raft_consensus.cc:2243] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.699747 14516 raft_consensus.cc:2272] T e5f5676b2fdd452da0db90b31878da8b P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.702859 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.703435 14516 raft_consensus.cc:2243] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.703915 14516 raft_consensus.cc:2272] T 4d423ffa47984e5e9d46f998841ff374 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.706153 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.706777 14516 raft_consensus.cc:2243] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.707638 14516 raft_consensus.cc:2272] T c16aa3c6fc924654b9a831ea21ada64d P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.709964 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.710558 14516 raft_consensus.cc:2243] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.710996 14516 raft_consensus.cc:2272] T f479efbeb6ad48938ed367d2bd50c494 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.713810 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.714679 14516 raft_consensus.cc:2243] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.715288 14516 raft_consensus.cc:2272] T 2ef74de67fbd4b549e342a137de78861 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.718453 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.719138 14516 raft_consensus.cc:2243] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.719746 14516 raft_consensus.cc:2272] T 2e2dd029e78d44d49664082ab994aec9 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.722791 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.723694 14516 raft_consensus.cc:2243] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.724926 14516 raft_consensus.cc:2272] T fa22c116262947f39fbe06c006be0cf3 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.728184 14516 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:52.728336 23437 consensus_peers.cc:597] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.729107 14516 raft_consensus.cc:2243] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.729651 14516 raft_consensus.cc:2272] T 09c3dcd176fe419db880690b124927e7 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.732173 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.732685 14516 raft_consensus.cc:2243] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.733043 14516 raft_consensus.cc:2272] T 2db51fbc97d3442cba36156e9429af61 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.735432 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.736047 14516 raft_consensus.cc:2243] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.736545 14516 raft_consensus.cc:2272] T 9b5978f4bba84a18982e38633bc2b626 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.739392 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.740096 14516 raft_consensus.cc:2243] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.740757 14516 raft_consensus.cc:2272] T 4706da1890fc4ca585d0a3450848f462 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.743793 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.744463 14516 raft_consensus.cc:2243] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.745266 14516 raft_consensus.cc:2272] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.747637 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.748227 14516 raft_consensus.cc:2243] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.749552 14516 raft_consensus.cc:2272] T c7f771ca377747d1a9e0dbea4321b0ca P 9dd2728dca8a44f79946d0da19b32c53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.752297 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.752943 14516 raft_consensus.cc:2243] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.753458 14516 raft_consensus.cc:2272] T 57da1469aee244edbcec3c6c6b867007 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.756199 14516 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:52.756166 23511 consensus_peers.cc:597] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.757050 14516 raft_consensus.cc:2243] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.757591 14516 raft_consensus.cc:2272] T 06c8577f61a841c0aa2491920a13d1af P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:52.760063 23363 consensus_peers.cc:597] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.760429 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.761130 14516 raft_consensus.cc:2243] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.761945 14516 raft_consensus.cc:2272] T a3fb88e4ccef4a92b6d7370ff8456d98 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.764034 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.764562 14516 raft_consensus.cc:2243] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.764912 14516 raft_consensus.cc:2272] T 1fa9aaf0293040738d08bf32226f26d7 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.766939 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.767583 14516 raft_consensus.cc:2243] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.768054 14516 raft_consensus.cc:2272] T 164c20e4fe9043b0ac2f2db5488e004e P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.770925 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.771696 14516 raft_consensus.cc:2243] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.772305 14516 raft_consensus.cc:2272] T 67ec9a7e5d824314a4743271735fab14 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.774513 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.775071 14516 raft_consensus.cc:2243] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.775835 14516 raft_consensus.cc:2272] T 589fc62a51cd40c78df360b93832f36a P 9dd2728dca8a44f79946d0da19b32c53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.778868 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.779450 14516 raft_consensus.cc:2243] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.779901 14516 raft_consensus.cc:2272] T 7ad4e8b8f5534f638a4422cd5668b846 P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.782820 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.783663 14516 raft_consensus.cc:2243] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.784305 14516 raft_consensus.cc:2272] T 26483779be92418ab5dc80b6e0228254 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:52.784802 23437 consensus_peers.cc:597] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.787242 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.788036 14516 raft_consensus.cc:2243] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.788993 14516 raft_consensus.cc:2272] T fa37604736d74fe9ab5b98ecb52b2d83 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.791189 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.791671 14516 raft_consensus.cc:2243] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.792048 14516 raft_consensus.cc:2272] T 9afa3ae86d604ec2992da64a89540734 P 9dd2728dca8a44f79946d0da19b32c53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.794010 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.794437 14516 raft_consensus.cc:2243] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.794766 14516 raft_consensus.cc:2272] T c1736a3967424f8982475f4c769a395d P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.796730 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:52.797304 14516 raft_consensus.cc:2243] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.797785 14516 raft_consensus.cc:2272] T 2845d7f0f10e4626832ab106dc1a747a P 9dd2728dca8a44f79946d0da19b32c53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:52.818943 23511 consensus_peers.cc:597] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.834605 23437 consensus_peers.cc:597] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.843962 23363 consensus_peers.cc:597] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.861153 23437 consensus_peers.cc:597] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.861423 23511 consensus_peers.cc:597] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.864704 23363 consensus_peers.cc:597] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.884719 14516 tablet_server.cc:196] TabletServer@127.14.45.1:39473 shutdown complete.
W20260709 13:09:52.889407 23363 consensus_peers.cc:597] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.898669 23511 consensus_peers.cc:597] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.907051 23437 consensus_peers.cc:597] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.925062 23511 consensus_peers.cc:597] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.947657 23511 consensus_peers.cc:597] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.948204 23511 consensus_peers.cc:597] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.958913 23511 consensus_peers.cc:597] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.977191 23511 consensus_peers.cc:597] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.984946 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
W20260709 13:09:53.020761 23437 consensus_peers.cc:597] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.021394 23437 consensus_peers.cc:597] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.025678 23511 consensus_peers.cc:597] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.026748 23437 consensus_peers.cc:597] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.044494 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:53.045531 14516 tablet_replica.cc:333] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.046753 14516 raft_consensus.cc:2243] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.047966 14516 raft_consensus.cc:2272] T 1fb06ec9f38f44c28c9059cefb321a04 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.050837 14516 tablet_replica.cc:333] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.051478 14516 raft_consensus.cc:2243] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.052295 14516 raft_consensus.cc:2272] T 9afa3ae86d604ec2992da64a89540734 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.054574 14516 tablet_replica.cc:333] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.055173 14516 raft_consensus.cc:2243] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.056003 14516 raft_consensus.cc:2272] T 2845d7f0f10e4626832ab106dc1a747a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.058066 14516 tablet_replica.cc:333] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.058640 14516 raft_consensus.cc:2243] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.059495 14516 raft_consensus.cc:2272] T 2e2dd029e78d44d49664082ab994aec9 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.061793 14516 tablet_replica.cc:333] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.062469 14516 raft_consensus.cc:2243] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.062989 14516 raft_consensus.cc:2272] T 4c2dc354ec164815b07f203d5b6ddd16 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.065537 14516 tablet_replica.cc:333] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
W20260709 13:09:53.065701 23437 consensus_peers.cc:597] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.066185 14516 raft_consensus.cc:2243] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.067137 14516 raft_consensus.cc:2272] T 270bce0e96a24453b6b35f8451f5c7dc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.069630 14516 tablet_replica.cc:333] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.070325 14516 raft_consensus.cc:2243] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.071377 14516 raft_consensus.cc:2272] T aaeb4174b82c42e79bc78ce12a770d8e P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.075119 14516 tablet_replica.cc:333] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.075901 14516 raft_consensus.cc:2243] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.076920 14516 raft_consensus.cc:2272] T 079d6319916749068ce3850998ab923a P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.079401 14516 tablet_replica.cc:333] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.080080 14516 raft_consensus.cc:2243] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.080566 14516 raft_consensus.cc:2272] T 57da1469aee244edbcec3c6c6b867007 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.082661 14516 tablet_replica.cc:333] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.083475 14516 raft_consensus.cc:2243] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.084057 14516 raft_consensus.cc:2272] T 06c8577f61a841c0aa2491920a13d1af P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.086069 23437 consensus_peers.cc:597] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.086721 14516 tablet_replica.cc:333] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.087360 14516 raft_consensus.cc:2243] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.087867 14516 raft_consensus.cc:2272] T ac392ac267824ea8acd63f7b708f1aea P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.090137 14516 tablet_replica.cc:333] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.090830 14516 raft_consensus.cc:2243] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.091928 14516 raft_consensus.cc:2272] T 470aca24cb8b4480a3395752f86d1a92 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.094542 14516 tablet_replica.cc:333] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.095328 14516 raft_consensus.cc:2243] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.096405 14516 raft_consensus.cc:2272] T 3c40a2a2441a4fb790b33bfcfd880413 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.098950 23437 consensus_peers.cc:597] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.099453 14516 tablet_replica.cc:333] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.100148 14516 raft_consensus.cc:2243] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:53.100198 23511 consensus_peers.cc:597] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Couldn't send request to peer 9dd2728dca8a44f79946d0da19b32c53. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.101117 14516 raft_consensus.cc:2272] T 0b429b743f704b32ab6f8ee57f5bd163 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.103819 14516 tablet_replica.cc:333] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.104476 14516 raft_consensus.cc:2243] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.105008 14516 raft_consensus.cc:2272] T 4706da1890fc4ca585d0a3450848f462 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.107636 14516 tablet_replica.cc:333] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.108417 14516 raft_consensus.cc:2243] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.108929 14516 raft_consensus.cc:2272] T 80dfcecaa22e4ea58c57fcee6c5ec966 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.111632 14516 tablet_replica.cc:333] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.112244 14516 raft_consensus.cc:2243] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.113045 14516 raft_consensus.cc:2272] T 9b5978f4bba84a18982e38633bc2b626 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.115271 14516 tablet_replica.cc:333] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.115855 14516 raft_consensus.cc:2243] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.116670 14516 raft_consensus.cc:2272] T 52ab658aedf74a66805c779a3eb85bbc P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.119390 14516 tablet_replica.cc:333] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.120260 14516 raft_consensus.cc:2243] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.120905 14516 raft_consensus.cc:2272] T a3fb88e4ccef4a92b6d7370ff8456d98 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.122363 23511 consensus_peers.cc:597] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.127732 14516 tablet_replica.cc:333] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.128841 14516 raft_consensus.cc:2243] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.129971 14516 raft_consensus.cc:2272] T c1736a3967424f8982475f4c769a395d P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.132990 14516 tablet_replica.cc:333] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.133603 14516 raft_consensus.cc:2243] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.134443 14516 raft_consensus.cc:2272] T cff5bda8d894486ca77e2e65f89c0494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.136564 14516 tablet_replica.cc:333] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.137115 14516 raft_consensus.cc:2243] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.137704 14516 raft_consensus.cc:2272] T 70646f6eebd7451ab1f6c4030b732600 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.140112 23437 consensus_peers.cc:597] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.140479 14516 tablet_replica.cc:333] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.141425 14516 raft_consensus.cc:2243] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.142153 14516 raft_consensus.cc:2272] T c85f3ba70a274480909cc569cf8886b2 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.149003 14516 tablet_replica.cc:333] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.149827 14516 raft_consensus.cc:2243] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:53.150311 23437 consensus_peers.cc:597] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.150341 14516 raft_consensus.cc:2272] T 5f394ca7ac8e4fb0904b5c5129a503fc P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.152827 14516 tablet_replica.cc:333] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.153419 14516 raft_consensus.cc:2243] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.153940 14516 raft_consensus.cc:2272] T 4d423ffa47984e5e9d46f998841ff374 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.155920 14516 tablet_replica.cc:333] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.156468 14516 raft_consensus.cc:2243] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.156924 14516 raft_consensus.cc:2272] T 164c20e4fe9043b0ac2f2db5488e004e P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.158860 14516 tablet_replica.cc:333] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.159467 14516 raft_consensus.cc:2243] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.159940 14516 raft_consensus.cc:2272] T 589fc62a51cd40c78df360b93832f36a P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.162671 14516 tablet_replica.cc:333] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.163344 14516 raft_consensus.cc:2243] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.163748 14516 raft_consensus.cc:2272] T 47e39de0746842d2b01a51bd445a746b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.165601 14516 tablet_replica.cc:333] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.166150 14516 raft_consensus.cc:2243] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.166522 14516 raft_consensus.cc:2272] T ae12c02cddd142b3b1a089058861d718 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.168365 14516 tablet_replica.cc:333] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.168982 14516 raft_consensus.cc:2243] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.170069 14516 raft_consensus.cc:2272] T 0623e04a00fb4ef7bf47ed03410a5049 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.172653 14516 tablet_replica.cc:333] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.173483 14516 raft_consensus.cc:2243] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.174084 14516 raft_consensus.cc:2272] T fa22c116262947f39fbe06c006be0cf3 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.176654 14516 tablet_replica.cc:333] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.177361 14516 raft_consensus.cc:2243] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.177942 14516 raft_consensus.cc:2272] T 09c3dcd176fe419db880690b124927e7 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.178087 23511 consensus_peers.cc:597] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.180817 14516 tablet_replica.cc:333] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.181458 14516 raft_consensus.cc:2243] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.182076 14516 raft_consensus.cc:2272] T 01f73d1ea60d4e67b869c7388c8b9df4 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.184721 14516 tablet_replica.cc:333] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.185348 14516 raft_consensus.cc:2243] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.185878 14516 raft_consensus.cc:2272] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.187801 14516 tablet_replica.cc:333] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.188426 14516 raft_consensus.cc:2243] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.188855 14516 raft_consensus.cc:2272] T 8c4a5edf9439448a85d0cf3f5d53996b P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.191093 14516 tablet_replica.cc:333] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.191594 14516 raft_consensus.cc:2243] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.192066 14516 raft_consensus.cc:2272] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.194131 14516 tablet_replica.cc:333] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.194727 14516 raft_consensus.cc:2243] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.195163 14516 raft_consensus.cc:2272] T 1d125c0c59b849edb09535466ab6ffba P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.197291 14516 tablet_replica.cc:333] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.197919 14516 raft_consensus.cc:2243] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.198441 14516 raft_consensus.cc:2272] T 2ef74de67fbd4b549e342a137de78861 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.200546 14516 tablet_replica.cc:333] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.201094 14516 raft_consensus.cc:2243] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.201552 14516 raft_consensus.cc:2272] T c16aa3c6fc924654b9a831ea21ada64d P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.203685 14516 tablet_replica.cc:333] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.204273 14516 raft_consensus.cc:2243] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.204739 14516 raft_consensus.cc:2272] T f479efbeb6ad48938ed367d2bd50c494 P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.207412 14516 tablet_replica.cc:333] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.208117 14516 raft_consensus.cc:2243] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.208621 14516 raft_consensus.cc:2272] T c3539d30340348c89b32e10d26f060a7 P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.208913 23511 consensus_peers.cc:597] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.211603 14516 tablet_replica.cc:333] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.212375 14516 raft_consensus.cc:2243] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:53.212487 23437 consensus_peers.cc:597] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.212958 14516 raft_consensus.cc:2272] T c554bef114234298a189605cf26a64d1 P 5227af10b4e44d23b9afdeff9f43a849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.215250 14516 tablet_replica.cc:333] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.215782 14516 raft_consensus.cc:2243] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.216271 14516 raft_consensus.cc:2272] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 5227af10b4e44d23b9afdeff9f43a849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.218909 14516 tablet_replica.cc:333] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849: stopping tablet replica
I20260709 13:09:53.219413 14516 raft_consensus.cc:2243] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.219964 14516 raft_consensus.cc:2272] T 891d07a8dc184d778dc815912cccc1ca P 5227af10b4e44d23b9afdeff9f43a849 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.236231 23437 consensus_peers.cc:597] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.236888 23437 consensus_peers.cc:597] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.239542 23437 consensus_peers.cc:597] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.240162 23437 consensus_peers.cc:597] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.292409 23511 consensus_peers.cc:597] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.298177 23511 consensus_peers.cc:597] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.316450 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
W20260709 13:09:53.362756 23511 consensus_peers.cc:597] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.375198 23437 consensus_peers.cc:597] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.404925 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
W20260709 13:09:53.453400 23513 consensus_peers.cc:597] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.459894 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:53.461323 14516 tablet_replica.cc:333] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.462457 14516 raft_consensus.cc:2243] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.463194 14516 raft_consensus.cc:2272] T c7f771ca377747d1a9e0dbea4321b0ca P 83a33b9d895a442287d4b46856f57a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.466341 14516 tablet_replica.cc:333] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.467010 14516 raft_consensus.cc:2243] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.467561 14516 raft_consensus.cc:2272] T 2e2dd029e78d44d49664082ab994aec9 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.469324 23511 consensus_peers.cc:597] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.470577 14516 tablet_replica.cc:333] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.471300 14516 raft_consensus.cc:2243] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.471755 14516 raft_consensus.cc:2272] T 1fa9aaf0293040738d08bf32226f26d7 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.474781 14516 tablet_replica.cc:333] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.475601 14516 raft_consensus.cc:2243] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.476162 14516 raft_consensus.cc:2272] T 9afa3ae86d604ec2992da64a89540734 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.479023 14516 tablet_replica.cc:333] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.479707 14516 raft_consensus.cc:2243] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.480237 14516 raft_consensus.cc:2272] T 0b429b743f704b32ab6f8ee57f5bd163 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.482710 14516 tablet_replica.cc:333] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.483464 14516 raft_consensus.cc:2243] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:53.483873 23511 consensus_peers.cc:597] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Couldn't send request to peer 5227af10b4e44d23b9afdeff9f43a849. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.483944 14516 raft_consensus.cc:2272] T 3c40a2a2441a4fb790b33bfcfd880413 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.486240 14516 tablet_replica.cc:333] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.486856 14516 raft_consensus.cc:2243] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.487723 14516 raft_consensus.cc:2272] T 2db51fbc97d3442cba36156e9429af61 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.489776 14516 tablet_replica.cc:333] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.490661 14516 raft_consensus.cc:2243] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.491125 14516 raft_consensus.cc:2272] T 270bce0e96a24453b6b35f8451f5c7dc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.493218 14516 tablet_replica.cc:333] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.493938 14516 raft_consensus.cc:2243] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.494349 14516 raft_consensus.cc:2272] T 4c2dc354ec164815b07f203d5b6ddd16 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.497160 14516 tablet_replica.cc:333] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.497989 14516 raft_consensus.cc:2243] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.498546 14516 raft_consensus.cc:2272] T 079d6319916749068ce3850998ab923a P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.501281 14516 tablet_replica.cc:333] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.501936 14516 raft_consensus.cc:2243] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.502385 14516 raft_consensus.cc:2272] T aaeb4174b82c42e79bc78ce12a770d8e P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.504509 14516 tablet_replica.cc:333] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.505254 14516 raft_consensus.cc:2243] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.505683 14516 raft_consensus.cc:2272] T d0d0a0dbdf2f4194b4ba44d16193ee2e P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.507552 14516 tablet_replica.cc:333] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.508044 14516 raft_consensus.cc:2243] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.508420 14516 raft_consensus.cc:2272] T e5f5676b2fdd452da0db90b31878da8b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.510461 14516 tablet_replica.cc:333] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.511023 14516 raft_consensus.cc:2243] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.511432 14516 raft_consensus.cc:2272] T 1fb06ec9f38f44c28c9059cefb321a04 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.514120 14516 tablet_replica.cc:333] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.514905 14516 raft_consensus.cc:2243] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.515479 14516 raft_consensus.cc:2272] T 7ad4e8b8f5534f638a4422cd5668b846 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.518435 14516 tablet_replica.cc:333] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.519227 14516 raft_consensus.cc:2243] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.519820 14516 raft_consensus.cc:2272] T 0623e04a00fb4ef7bf47ed03410a5049 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.522975 14516 tablet_replica.cc:333] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.523736 14516 raft_consensus.cc:2243] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.524603 14516 raft_consensus.cc:2272] T c94a184780fd46dbab2854fb725ca574 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.527420 14516 tablet_replica.cc:333] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
W20260709 13:09:53.527277 23513 consensus_peers.cc:597] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.528513 14516 raft_consensus.cc:2243] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.529567 14516 raft_consensus.cc:2272] T ae12c02cddd142b3b1a089058861d718 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.532513 14516 tablet_replica.cc:333] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.533295 14516 raft_consensus.cc:2243] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.533933 14516 raft_consensus.cc:2272] T 470aca24cb8b4480a3395752f86d1a92 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.536427 14516 tablet_replica.cc:333] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.537195 14516 raft_consensus.cc:2243] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.537829 14516 raft_consensus.cc:2272] T 5ee83cf672964ae8875b8899f5c8a0b8 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.540724 14516 tablet_replica.cc:333] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.541554 14516 raft_consensus.cc:2243] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:53.542132 23513 consensus_peers.cc:597] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.542651 14516 raft_consensus.cc:2272] T 92aecea6ace44d388502b338a5f8bdea P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.544799 14516 tablet_replica.cc:333] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.545387 14516 raft_consensus.cc:2243] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.546231 14516 raft_consensus.cc:2272] T c554bef114234298a189605cf26a64d1 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.548177 14516 tablet_replica.cc:333] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.548746 14516 raft_consensus.cc:2243] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.549578 14516 raft_consensus.cc:2272] T 26483779be92418ab5dc80b6e0228254 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.551595 14516 tablet_replica.cc:333] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.552203 14516 raft_consensus.cc:2243] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.553094 14516 raft_consensus.cc:2272] T ac392ac267824ea8acd63f7b708f1aea P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.555657 14516 tablet_replica.cc:333] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.556278 14516 raft_consensus.cc:2243] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.556869 14516 raft_consensus.cc:2272] T 52ab658aedf74a66805c779a3eb85bbc P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.558941 14516 tablet_replica.cc:333] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.559470 14516 raft_consensus.cc:2243] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.560245 14516 raft_consensus.cc:2272] T 09c3dcd176fe419db880690b124927e7 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.562078 14516 tablet_replica.cc:333] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.562608 14516 raft_consensus.cc:2243] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.563032 14516 raft_consensus.cc:2272] T fa22c116262947f39fbe06c006be0cf3 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.564860 14516 tablet_replica.cc:333] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.565377 14516 raft_consensus.cc:2243] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.565904 14516 raft_consensus.cc:2272] T 50034ac82496425fac0be0a983f3fdc9 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.568535 14516 tablet_replica.cc:333] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.569298 14516 raft_consensus.cc:2243] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.569821 14516 raft_consensus.cc:2272] T c1736a3967424f8982475f4c769a395d P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.571930 14516 tablet_replica.cc:333] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.572469 14516 raft_consensus.cc:2243] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.572916 14516 raft_consensus.cc:2272] T fa37604736d74fe9ab5b98ecb52b2d83 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.574983 14516 tablet_replica.cc:333] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.575551 14516 raft_consensus.cc:2243] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.576252 14516 raft_consensus.cc:2272] T 69488a80b90e4fecb290b1a4249ea436 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.578135 14516 tablet_replica.cc:333] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.578621 14516 raft_consensus.cc:2243] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.579001 14516 raft_consensus.cc:2272] T 47e39de0746842d2b01a51bd445a746b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.580772 14516 tablet_replica.cc:333] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.581207 14516 raft_consensus.cc:2243] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.582010 14516 raft_consensus.cc:2272] T 164c20e4fe9043b0ac2f2db5488e004e P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.584199 14516 tablet_replica.cc:333] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.584779 14516 raft_consensus.cc:2243] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.585210 14516 raft_consensus.cc:2272] T 67ec9a7e5d824314a4743271735fab14 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.587173 23513 consensus_peers.cc:597] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.587622 14516 tablet_replica.cc:333] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.588160 14516 raft_consensus.cc:2243] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.588513 14516 raft_consensus.cc:2272] T 589fc62a51cd40c78df360b93832f36a P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.590387 14516 tablet_replica.cc:333] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.590857 14516 raft_consensus.cc:2243] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.591557 14516 raft_consensus.cc:2272] T cd4f6dbbb32a4bb29cae9c9baf87c65b P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.593463 14516 tablet_replica.cc:333] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.593935 14516 raft_consensus.cc:2243] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.594619 14516 raft_consensus.cc:2272] T 1d125c0c59b849edb09535466ab6ffba P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.596580 14516 tablet_replica.cc:333] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.597151 14516 raft_consensus.cc:2243] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.597607 14516 raft_consensus.cc:2272] T c16aa3c6fc924654b9a831ea21ada64d P 83a33b9d895a442287d4b46856f57a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.599479 14516 tablet_replica.cc:333] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.599996 14516 raft_consensus.cc:2243] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.600771 14516 raft_consensus.cc:2272] T f479efbeb6ad48938ed367d2bd50c494 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.602599 14516 tablet_replica.cc:333] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.603103 14516 raft_consensus.cc:2243] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.603540 14516 raft_consensus.cc:2272] T 2385ef80a9064010a9965cd059570c71 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.605305 14516 tablet_replica.cc:333] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.605818 14516 raft_consensus.cc:2243] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.606262 14516 raft_consensus.cc:2272] T ebdeb4d212974dcf9c19753ad30b5034 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.608036 14516 tablet_replica.cc:333] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.608451 14516 raft_consensus.cc:2243] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.608796 14516 raft_consensus.cc:2272] T c85f3ba70a274480909cc569cf8886b2 P 83a33b9d895a442287d4b46856f57a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.610450 14516 tablet_replica.cc:333] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.610864 14516 raft_consensus.cc:2243] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.611567 14516 raft_consensus.cc:2272] T 5f394ca7ac8e4fb0904b5c5129a503fc P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.613328 14516 tablet_replica.cc:333] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60: stopping tablet replica
I20260709 13:09:53.613719 14516 raft_consensus.cc:2243] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.614542 14516 raft_consensus.cc:2272] T 4d423ffa47984e5e9d46f998841ff374 P 83a33b9d895a442287d4b46856f57a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.621353 24513 raft_consensus.cc:493] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.622004 24513 raft_consensus.cc:515] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:53.624222 24513 leader_election.cc:290] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
W20260709 13:09:53.627218 23513 consensus_peers.cc:597] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.629529 23511 leader_election.cc:336] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:53.630254 23511 leader_election.cc:336] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111)
I20260709 13:09:53.630571 23511 leader_election.cc:304] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.631166 24513 raft_consensus.cc:2749] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.646423 24513 raft_consensus.cc:493] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.646961 24513 raft_consensus.cc:515] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
I20260709 13:09:53.648947 24513 leader_election.cc:290] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:53.652036 23513 leader_election.cc:336] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:53.653944 23511 leader_election.cc:336] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:53.654471 23511 leader_election.cc:304] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.655218 24513 raft_consensus.cc:2749] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:53.710155 23513 consensus_peers.cc:597] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:43233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.727891 23513 consensus_peers.cc:597] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:43233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.734972 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
W20260709 13:09:53.757728 23513 consensus_peers.cc:597] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:43233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.767416 24513 raft_consensus.cc:493] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.768096 24513 raft_consensus.cc:515] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83a33b9d895a442287d4b46856f57a60" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 43233 } } peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } }
W20260709 13:09:53.770080 23513 consensus_peers.cc:597] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 -> Peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Couldn't send request to peer 83a33b9d895a442287d4b46856f57a60. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.3:43233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.770531 24513 leader_election.cc:290] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233), 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473)
W20260709 13:09:53.776582 23513 leader_election.cc:336] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 83a33b9d895a442287d4b46856f57a60 (127.14.45.3:43233): Network error: Client connection negotiation failed: client connection to 127.14.45.3:43233: connect: Connection refused (error 111)
W20260709 13:09:53.777520 23511 leader_election.cc:336] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:53.777989 23511 leader_election.cc:304] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 83a33b9d895a442287d4b46856f57a60, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.778767 24513 raft_consensus.cc:2749] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.815014 24512 raft_consensus.cc:493] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.815651 24512 raft_consensus.cc:515] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:53.818341 24512 leader_election.cc:290] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
W20260709 13:09:53.824520 23511 leader_election.cc:336] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:53.825801 23511 leader_election.cc:336] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111)
I20260709 13:09:53.826244 23511 leader_election.cc:304] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.827009 24512 raft_consensus.cc:2749] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.839488 14516 tablet_server.cc:179] TabletServer@127.14.45.4:0 shutting down...
I20260709 13:09:53.894834 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:53.895603 14516 tablet_replica.cc:333] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.896351 14516 raft_consensus.cc:2243] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.896884 14516 raft_consensus.cc:2272] T c7f771ca377747d1a9e0dbea4321b0ca P a1265f7d704d41df83adf9f1c74d3f03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.899078 14516 tablet_replica.cc:333] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.899685 14516 raft_consensus.cc:2243] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.900120 14516 raft_consensus.cc:2272] T 5f394ca7ac8e4fb0904b5c5129a503fc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.902055 14516 tablet_replica.cc:333] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.902601 14516 raft_consensus.cc:2243] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.903023 14516 raft_consensus.cc:2272] T 2845d7f0f10e4626832ab106dc1a747a P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.904844 14516 tablet_replica.cc:333] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.905436 14516 raft_consensus.cc:2243] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.905910 14516 raft_consensus.cc:2272] T 270bce0e96a24453b6b35f8451f5c7dc P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.907717 14516 tablet_replica.cc:333] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.908263 14516 raft_consensus.cc:2243] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.909016 14516 raft_consensus.cc:2272] T 67ec9a7e5d824314a4743271735fab14 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.910847 14516 tablet_replica.cc:333] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.911441 14516 raft_consensus.cc:2243] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.912222 14516 raft_consensus.cc:2272] T 2ef74de67fbd4b549e342a137de78861 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.914558 14516 tablet_replica.cc:333] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.915273 14516 raft_consensus.cc:2243] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.915792 14516 raft_consensus.cc:2272] T 1fb06ec9f38f44c28c9059cefb321a04 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.917889 14516 tablet_replica.cc:333] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.918494 14516 raft_consensus.cc:2243] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.919214 14516 raft_consensus.cc:2272] T 7ad4e8b8f5534f638a4422cd5668b846 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.921403 14516 tablet_replica.cc:333] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.922191 14516 raft_consensus.cc:2243] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.922734 14516 raft_consensus.cc:2272] T aaeb4174b82c42e79bc78ce12a770d8e P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.923759 24512 raft_consensus.cc:493] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.924256 24512 raft_consensus.cc:515] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:53.925477 14516 tablet_replica.cc:333] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.926467 14516 raft_consensus.cc:2243] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.927282 14516 raft_consensus.cc:2272] T 57da1469aee244edbcec3c6c6b867007 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.927578 24512 leader_election.cc:290] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:53.929986 14516 tablet_replica.cc:333] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.930866 14516 raft_consensus.cc:2243] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.931823 14516 raft_consensus.cc:2272] T 06c8577f61a841c0aa2491920a13d1af P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.932600 23511 leader_election.cc:336] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
W20260709 13:09:53.934489 23511 leader_election.cc:336] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111)
I20260709 13:09:53.934774 14516 tablet_replica.cc:333] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.934900 23511 leader_election.cc:304] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.935640 24512 raft_consensus.cc:2749] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.935760 14516 raft_consensus.cc:2243] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.936478 14516 raft_consensus.cc:2272] T cff5bda8d894486ca77e2e65f89c0494 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.938424 14516 tablet_replica.cc:333] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.938985 14516 raft_consensus.cc:2243] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.939459 14516 raft_consensus.cc:2272] T 70646f6eebd7451ab1f6c4030b732600 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.941370 14516 tablet_replica.cc:333] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.942005 14516 raft_consensus.cc:2243] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.942804 14516 raft_consensus.cc:2272] T 891d07a8dc184d778dc815912cccc1ca P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.944605 14516 tablet_replica.cc:333] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.945119 14516 raft_consensus.cc:2243] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.945902 14516 raft_consensus.cc:2272] T e5f5676b2fdd452da0db90b31878da8b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.947703 14516 tablet_replica.cc:333] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.948262 14516 raft_consensus.cc:2243] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.948689 14516 raft_consensus.cc:2272] T 0623e04a00fb4ef7bf47ed03410a5049 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.950649 14516 tablet_replica.cc:333] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.951191 14516 raft_consensus.cc:2243] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.951624 14516 raft_consensus.cc:2272] T c94a184780fd46dbab2854fb725ca574 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.953397 14516 tablet_replica.cc:333] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.954015 14516 raft_consensus.cc:2243] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.954414 14516 raft_consensus.cc:2272] T ae12c02cddd142b3b1a089058861d718 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.956310 14516 tablet_replica.cc:333] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.956853 14516 raft_consensus.cc:2243] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.957279 14516 raft_consensus.cc:2272] T 470aca24cb8b4480a3395752f86d1a92 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.959105 14516 tablet_replica.cc:333] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.959636 14516 raft_consensus.cc:2243] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.960055 14516 raft_consensus.cc:2272] T 26483779be92418ab5dc80b6e0228254 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.961840 14516 tablet_replica.cc:333] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.962364 14516 raft_consensus.cc:2243] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.962770 14516 raft_consensus.cc:2272] T ac392ac267824ea8acd63f7b708f1aea P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.964411 14516 tablet_replica.cc:333] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.964943 14516 raft_consensus.cc:2243] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.965344 14516 raft_consensus.cc:2272] T 5ee83cf672964ae8875b8899f5c8a0b8 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.967137 14516 tablet_replica.cc:333] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.967666 14516 raft_consensus.cc:2243] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.968091 14516 raft_consensus.cc:2272] T 3c40a2a2441a4fb790b33bfcfd880413 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.969914 14516 tablet_replica.cc:333] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.970407 14516 raft_consensus.cc:2243] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.970835 14516 raft_consensus.cc:2272] T 2db51fbc97d3442cba36156e9429af61 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.972864 14516 tablet_replica.cc:333] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.973730 14516 raft_consensus.cc:2243] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.974282 14516 raft_consensus.cc:2272] T 0b429b743f704b32ab6f8ee57f5bd163 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.976974 14516 tablet_replica.cc:333] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.977849 14516 raft_consensus.cc:2243] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.977955 24512 raft_consensus.cc:493] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.978550 24512 raft_consensus.cc:515] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:53.978905 14516 raft_consensus.cc:2272] T 4706da1890fc4ca585d0a3450848f462 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.980841 24512 leader_election.cc:290] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:53.981787 14516 tablet_replica.cc:333] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.982671 14516 raft_consensus.cc:2243] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.983198 14516 raft_consensus.cc:2272] T 80dfcecaa22e4ea58c57fcee6c5ec966 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.985282 24512 raft_consensus.cc:493] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.985919 14516 tablet_replica.cc:333] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.985754 24512 raft_consensus.cc:515] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:53.986850 14516 raft_consensus.cc:2243] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.987423 14516 raft_consensus.cc:2272] T 9b5978f4bba84a18982e38633bc2b626 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.987795 24512 leader_election.cc:290] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:53.989841 14516 tablet_replica.cc:333] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
W20260709 13:09:53.990149 23511 leader_election.cc:336] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111)
I20260709 13:09:53.990640 14516 raft_consensus.cc:2243] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.991704 14516 raft_consensus.cc:2272] T c85f3ba70a274480909cc569cf8886b2 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.991842 23511 leader_election.cc:336] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:53.992316 23511 leader_election.cc:304] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.993213 24513 raft_consensus.cc:2749] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.994640 14516 tablet_replica.cc:333] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:53.995467 14516 raft_consensus.cc:2243] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:53.996248 23511 leader_election.cc:336] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:53.996457 14516 raft_consensus.cc:2272] T 50034ac82496425fac0be0a983f3fdc9 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:53.997685 23511 leader_election.cc:336] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111)
I20260709 13:09:53.998203 23511 leader_election.cc:304] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:53.998203 24513 raft_consensus.cc:493] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9dd2728dca8a44f79946d0da19b32c53)
I20260709 13:09:53.998971 24513 raft_consensus.cc:515] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1265f7d704d41df83adf9f1c74d3f03" member_type: VOTER last_known_addr { host: "127.14.45.4" port: 43503 } } peers { permanent_uuid: "9dd2728dca8a44f79946d0da19b32c53" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 39473 } } peers { permanent_uuid: "5227af10b4e44d23b9afdeff9f43a849" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 34005 } }
I20260709 13:09:53.999316 24511 raft_consensus.cc:2749] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:54.000944 24513 leader_election.cc:290] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473), 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005)
I20260709 13:09:53.999264 14516 tablet_replica.cc:333] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.001991 14516 raft_consensus.cc:2243] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.002653 14516 raft_consensus.cc:2272] T 69488a80b90e4fecb290b1a4249ea436 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:54.005210 23511 leader_election.cc:336] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9dd2728dca8a44f79946d0da19b32c53 (127.14.45.1:39473): Network error: Client connection negotiation failed: client connection to 127.14.45.1:39473: connect: Connection refused (error 111)
I20260709 13:09:54.005576 14516 tablet_replica.cc:333] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
W20260709 13:09:54.006037 23511 leader_election.cc:336] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5227af10b4e44d23b9afdeff9f43a849 (127.14.45.2:34005): Network error: Client connection negotiation failed: client connection to 127.14.45.2:34005: connect: Connection refused (error 111)
I20260709 13:09:54.006476 14516 raft_consensus.cc:2243] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.006489 23511 leader_election.cc:304] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1265f7d704d41df83adf9f1c74d3f03; no voters: 5227af10b4e44d23b9afdeff9f43a849, 9dd2728dca8a44f79946d0da19b32c53
I20260709 13:09:54.007373 24513 raft_consensus.cc:2749] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:54.007690 14516 raft_consensus.cc:2272] T 47e39de0746842d2b01a51bd445a746b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.009801 14516 tablet_replica.cc:333] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.010386 14516 raft_consensus.cc:2243] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.010880 14516 raft_consensus.cc:2272] T 92aecea6ace44d388502b338a5f8bdea P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.012821 14516 tablet_replica.cc:333] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.013410 14516 raft_consensus.cc:2243] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.013938 14516 raft_consensus.cc:2272] T 8c4a5edf9439448a85d0cf3f5d53996b P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.015839 14516 tablet_replica.cc:333] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.016366 14516 raft_consensus.cc:2243] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.017117 14516 raft_consensus.cc:2272] T cbf2dfc5cf4b48f69167416ab3bf4cb1 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.019109 14516 tablet_replica.cc:333] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.019632 14516 raft_consensus.cc:2243] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.020366 14516 raft_consensus.cc:2272] T 2385ef80a9064010a9965cd059570c71 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.022552 14516 tablet_replica.cc:333] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.023047 14516 raft_consensus.cc:2243] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.023778 14516 raft_consensus.cc:2272] T ebdeb4d212974dcf9c19753ad30b5034 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.025906 14516 tablet_replica.cc:333] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.026419 14516 raft_consensus.cc:2243] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.027158 14516 raft_consensus.cc:2272] T 1fa9aaf0293040738d08bf32226f26d7 P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.029070 14516 tablet_replica.cc:333] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.029580 14516 raft_consensus.cc:2243] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.030085 14516 raft_consensus.cc:2272] T a3fb88e4ccef4a92b6d7370ff8456d98 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.032157 14516 tablet_replica.cc:333] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.032979 14516 raft_consensus.cc:2243] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.033494 14516 raft_consensus.cc:2272] T 01f73d1ea60d4e67b869c7388c8b9df4 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.035481 14516 tablet_replica.cc:333] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.035936 14516 raft_consensus.cc:2243] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.036296 14516 raft_consensus.cc:2272] T cd4f6dbbb32a4bb29cae9c9baf87c65b P a1265f7d704d41df83adf9f1c74d3f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.038257 14516 tablet_replica.cc:333] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.038690 14516 raft_consensus.cc:2243] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.039033 14516 raft_consensus.cc:2272] T fa37604736d74fe9ab5b98ecb52b2d83 P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.040778 14516 tablet_replica.cc:333] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.041208 14516 raft_consensus.cc:2243] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.041576 14516 raft_consensus.cc:2272] T c3539d30340348c89b32e10d26f060a7 P a1265f7d704d41df83adf9f1c74d3f03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.043475 14516 tablet_replica.cc:333] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03: stopping tablet replica
I20260709 13:09:54.043876 14516 raft_consensus.cc:2243] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.044238 14516 raft_consensus.cc:2272] T 1d125c0c59b849edb09535466ab6ffba P a1265f7d704d41df83adf9f1c74d3f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.112915 14516 tablet_server.cc:196] TabletServer@127.14.45.4:0 shutdown complete.
I20260709 13:09:54.174638 14516 master.cc:562] Master@127.14.45.62:40477 shutting down...
I20260709 13:09:54.201370 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.202021 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.202353 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 439eda8ff54f43dcb293d9a9d1d81d89: stopping tablet replica
I20260709 13:09:54.228199 14516 master.cc:584] Master@127.14.45.62:40477 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (31025 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:54.316051 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:40661
I20260709 13:09:54.317250 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.323932 24516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.323984 24517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.325119 24519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.325188 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:54.326673 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.326902 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.327118 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602594327082 us; error 0 us; skew 500 ppm
I20260709 13:09:54.327641 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.330304 14516 webserver.cc:533] Webserver started at http://127.14.45.62:33573/ using document root <none> and password file <none>
I20260709 13:09:54.330803 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.330999 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.331285 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.332427 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "317146c988a840aa980a5d84b0f57e77"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.336825 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:09:54.340391 24524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.341291 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:54.341583 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "317146c988a840aa980a5d84b0f57e77"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.341894 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.360113 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.361313 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.400775 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:40661
I20260709 13:09:54.400882 24575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:40661 every 8 connection(s)
I20260709 13:09:54.405108 24576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.415831 24576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77: Bootstrap starting.
I20260709 13:09:54.420691 24576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.425092 24576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77: No bootstrap required, opened a new log
I20260709 13:09:54.427415 24576 raft_consensus.cc:359] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317146c988a840aa980a5d84b0f57e77" member_type: VOTER }
I20260709 13:09:54.427778 24576 raft_consensus.cc:385] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.427965 24576 raft_consensus.cc:740] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 317146c988a840aa980a5d84b0f57e77, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.428537 24576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317146c988a840aa980a5d84b0f57e77" member_type: VOTER }
I20260709 13:09:54.428967 24576 raft_consensus.cc:399] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:54.429167 24576 raft_consensus.cc:493] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:54.429380 24576 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.434213 24576 raft_consensus.cc:515] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317146c988a840aa980a5d84b0f57e77" member_type: VOTER }
I20260709 13:09:54.434742 24576 leader_election.cc:304] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 317146c988a840aa980a5d84b0f57e77; no voters: 
I20260709 13:09:54.435900 24576 leader_election.cc:290] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:54.436316 24579 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.437675 24579 raft_consensus.cc:697] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 1 LEADER]: Becoming Leader. State: Replica: 317146c988a840aa980a5d84b0f57e77, State: Running, Role: LEADER
I20260709 13:09:54.438400 24579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317146c988a840aa980a5d84b0f57e77" member_type: VOTER }
I20260709 13:09:54.439000 24576 sys_catalog.cc:565] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:54.442768 24580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "317146c988a840aa980a5d84b0f57e77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317146c988a840aa980a5d84b0f57e77" member_type: VOTER } }
I20260709 13:09:54.443404 24580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:54.444592 24581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 317146c988a840aa980a5d84b0f57e77. Latest consensus state: current_term: 1 leader_uuid: "317146c988a840aa980a5d84b0f57e77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317146c988a840aa980a5d84b0f57e77" member_type: VOTER } }
I20260709 13:09:54.445238 24581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:54.452046 24586 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:54.460091 24586 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:54.461228 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:54.469285 24586 catalog_manager.cc:1383] Generated new cluster ID: cac89414a1424898a03a91220125e59c
I20260709 13:09:54.469583 24586 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:54.493310 24586 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:54.494985 24586 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:54.513319 24586 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77: Generated new TSK 0
I20260709 13:09:54.513957 24586 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:54.528620 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.535625 24597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.537271 24598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.539408 14516 server_base.cc:1061] running on GCE node
W20260709 13:09:54.539563 24600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.541682 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.541973 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.542132 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602594542119 us; error 0 us; skew 500 ppm
I20260709 13:09:54.542717 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.545249 14516 webserver.cc:533] Webserver started at http://127.14.45.1:37655/ using document root <none> and password file <none>
I20260709 13:09:54.545847 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.546038 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.546332 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.547432 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "023415e53632418788805b558a25eaaf"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.552023 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:54.555680 24605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.556607 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:54.556937 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "023415e53632418788805b558a25eaaf"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.557216 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.572268 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.573567 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.575133 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.577456 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.577696 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.577986 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.578181 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.619066 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:32783
I20260709 13:09:54.619175 24667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:32783 every 8 connection(s)
I20260709 13:09:54.624125 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.631775 24672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.633617 24673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.635725 14516 server_base.cc:1061] running on GCE node
W20260709 13:09:54.636756 24675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.637974 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.638230 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.638417 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602594638400 us; error 0 us; skew 500 ppm
I20260709 13:09:54.638775 24668 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40661
I20260709 13:09:54.638971 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.639197 24668 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.640012 24668 heartbeater.cc:507] Master 127.14.45.62:40661 requested a full tablet report, sending...
I20260709 13:09:54.642030 14516 webserver.cc:533] Webserver started at http://127.14.45.2:37291/ using document root <none> and password file <none>
I20260709 13:09:54.642614 24541 ts_manager.cc:194] Registered new tserver with Master: 023415e53632418788805b558a25eaaf (127.14.45.1:32783)
I20260709 13:09:54.642776 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.643141 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.643472 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.644976 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.645192 24541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51806
I20260709 13:09:54.650022 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:09:54.654021 24680 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.654917 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:09:54.655246 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.655584 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.692463 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.693792 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.695401 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.697788 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.697964 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.698266 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.698457 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.740219 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:46675
I20260709 13:09:54.740526 24742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:46675 every 8 connection(s)
I20260709 13:09:54.745056 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.752902 24746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.755409 24747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.759140 24749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.759760 14516 server_base.cc:1061] running on GCE node
I20260709 13:09:54.760386 24743 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40661
I20260709 13:09:54.760790 24743 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.761011 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.761296 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.761503 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602594761483 us; error 0 us; skew 500 ppm
I20260709 13:09:54.761611 24743 heartbeater.cc:507] Master 127.14.45.62:40661 requested a full tablet report, sending...
I20260709 13:09:54.762181 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.764170 24541 ts_manager.cc:194] Registered new tserver with Master: bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:54.764873 14516 webserver.cc:533] Webserver started at http://127.14.45.3:45353/ using document root <none> and password file <none>
I20260709 13:09:54.765420 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.765648 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.765702 24541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51812
I20260709 13:09:54.765956 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.767418 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "bed07f5ad4144a3a9888449359ff9223"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.771898 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:09:54.775617 24754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.776507 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:54.776825 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "bed07f5ad4144a3a9888449359ff9223"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:09:54.777123 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.799474 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.800736 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.802287 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.804584 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.804827 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.805075 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.805250 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.849165 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:42597
I20260709 13:09:54.849265 24816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:42597 every 8 connection(s)
I20260709 13:09:54.864406 24817 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40661
I20260709 13:09:54.864809 24817 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.865677 24817 heartbeater.cc:507] Master 127.14.45.62:40661 requested a full tablet report, sending...
I20260709 13:09:54.867792 24541 ts_manager.cc:194] Registered new tserver with Master: bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:54.868587 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016085357s
I20260709 13:09:54.869510 24541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51820
I20260709 13:09:54.896543 24541 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51828:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:54.899747 24541 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:54.974434 24708 tablet_service.cc:1511] Processing CreateTablet for tablet 5acc350e72f943f1ae6af73fc73eb048 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:54.975926 24708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acc350e72f943f1ae6af73fc73eb048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.981460 24705 tablet_service.cc:1511] Processing CreateTablet for tablet 57c4fceafd3f438e9c1f030c8cdb055d (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:54.983125 24705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c4fceafd3f438e9c1f030c8cdb055d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.983726 24633 tablet_service.cc:1511] Processing CreateTablet for tablet 5acc350e72f943f1ae6af73fc73eb048 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:54.984709 24632 tablet_service.cc:1511] Processing CreateTablet for tablet 530b1eb6da54447ead123d0f8e1568b9 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:54.985239 24633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acc350e72f943f1ae6af73fc73eb048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.986188 24632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530b1eb6da54447ead123d0f8e1568b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.986876 24707 tablet_service.cc:1511] Processing CreateTablet for tablet 530b1eb6da54447ead123d0f8e1568b9 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:54.988397 24707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530b1eb6da54447ead123d0f8e1568b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.990897 24631 tablet_service.cc:1511] Processing CreateTablet for tablet 4c486139d9604f188afcf0e39972c43e (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:54.992405 24631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c486139d9604f188afcf0e39972c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.992076 24704 tablet_service.cc:1511] Processing CreateTablet for tablet 37f17ee7e91c4908a9d1428edaa8c110 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:54.993515 24704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f17ee7e91c4908a9d1428edaa8c110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.990897 24706 tablet_service.cc:1511] Processing CreateTablet for tablet 4c486139d9604f188afcf0e39972c43e (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:54.994477 24630 tablet_service.cc:1511] Processing CreateTablet for tablet 57c4fceafd3f438e9c1f030c8cdb055d (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:54.995854 24630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c4fceafd3f438e9c1f030c8cdb055d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.997156 24703 tablet_service.cc:1511] Processing CreateTablet for tablet eb08a9bfaad94e1f8d880be3bb057c45 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:55.002161 24703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb08a9bfaad94e1f8d880be3bb057c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.003710 24702 tablet_service.cc:1511] Processing CreateTablet for tablet 6b68c3cfcd6c45e5b77b07c39025395b (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:55.004264 24629 tablet_service.cc:1511] Processing CreateTablet for tablet 37f17ee7e91c4908a9d1428edaa8c110 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:55.005311 24702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b68c3cfcd6c45e5b77b07c39025395b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.005820 24629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f17ee7e91c4908a9d1428edaa8c110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.006170 24706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c486139d9604f188afcf0e39972c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.008195 24628 tablet_service.cc:1511] Processing CreateTablet for tablet eb08a9bfaad94e1f8d880be3bb057c45 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:55.010933 24627 tablet_service.cc:1511] Processing CreateTablet for tablet 6b68c3cfcd6c45e5b77b07c39025395b (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:55.015893 24782 tablet_service.cc:1511] Processing CreateTablet for tablet 5acc350e72f943f1ae6af73fc73eb048 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:55.016057 24781 tablet_service.cc:1511] Processing CreateTablet for tablet 530b1eb6da54447ead123d0f8e1568b9 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:55.025182 24626 tablet_service.cc:1511] Processing CreateTablet for tablet 46ad2439738a422da8589c93809ff9c0 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:55.031392 24780 tablet_service.cc:1511] Processing CreateTablet for tablet 4c486139d9604f188afcf0e39972c43e (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:55.032923 24628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb08a9bfaad94e1f8d880be3bb057c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.032629 24701 tablet_service.cc:1511] Processing CreateTablet for tablet 46ad2439738a422da8589c93809ff9c0 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:55.035413 24700 tablet_service.cc:1511] Processing CreateTablet for tablet d3a07e68dc2e48f5b7b5a3c443a1394a (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:55.018035 24782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acc350e72f943f1ae6af73fc73eb048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.039156 24627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b68c3cfcd6c45e5b77b07c39025395b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.039881 24625 tablet_service.cc:1511] Processing CreateTablet for tablet d3a07e68dc2e48f5b7b5a3c443a1394a (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:55.041357 24625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a07e68dc2e48f5b7b5a3c443a1394a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.045229 24701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ad2439738a422da8589c93809ff9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.046226 24781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530b1eb6da54447ead123d0f8e1568b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.046937 24624 tablet_service.cc:1511] Processing CreateTablet for tablet e9bbd82cb3084db3b112637f07bfe6e7 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:55.048426 24624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bbd82cb3084db3b112637f07bfe6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.049381 24700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a07e68dc2e48f5b7b5a3c443a1394a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.050302 24626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ad2439738a422da8589c93809ff9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.044850 24699 tablet_service.cc:1511] Processing CreateTablet for tablet e9bbd82cb3084db3b112637f07bfe6e7 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:55.057721 24779 tablet_service.cc:1511] Processing CreateTablet for tablet 57c4fceafd3f438e9c1f030c8cdb055d (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:55.058424 24780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c486139d9604f188afcf0e39972c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.058055 24777 tablet_service.cc:1511] Processing CreateTablet for tablet eb08a9bfaad94e1f8d880be3bb057c45 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:55.059248 24779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c4fceafd3f438e9c1f030c8cdb055d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.058115 24778 tablet_service.cc:1511] Processing CreateTablet for tablet 37f17ee7e91c4908a9d1428edaa8c110 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:55.060786 24778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f17ee7e91c4908a9d1428edaa8c110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.066179 24777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb08a9bfaad94e1f8d880be3bb057c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.066464 24699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bbd82cb3084db3b112637f07bfe6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.079577 24776 tablet_service.cc:1511] Processing CreateTablet for tablet 6b68c3cfcd6c45e5b77b07c39025395b (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:55.079895 24775 tablet_service.cc:1511] Processing CreateTablet for tablet 46ad2439738a422da8589c93809ff9c0 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:55.081209 24776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b68c3cfcd6c45e5b77b07c39025395b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.082088 24775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ad2439738a422da8589c93809ff9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.083007 24774 tablet_service.cc:1511] Processing CreateTablet for tablet d3a07e68dc2e48f5b7b5a3c443a1394a (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:55.084477 24774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a07e68dc2e48f5b7b5a3c443a1394a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.086925 24773 tablet_service.cc:1511] Processing CreateTablet for tablet e9bbd82cb3084db3b112637f07bfe6e7 (DEFAULT_TABLE table=test-workload [id=fab97d9d02844e65afdb71eae482fd11]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:55.088516 24773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bbd82cb3084db3b112637f07bfe6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.166172 24832 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.174849 24832 tablet_bootstrap.cc:654] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.223007 24833 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.226627 24834 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.244012 24833 tablet_bootstrap.cc:654] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.248852 24834 tablet_bootstrap.cc:654] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.264927 24833 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.265007 24832 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.265652 24833 ts_tablet_manager.cc:1403] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.008s
I20260709 13:09:55.265786 24832 ts_tablet_manager.cc:1403] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.022s
I20260709 13:09:55.268818 24833 raft_consensus.cc:359] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.269222 24832 raft_consensus.cc:359] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.269582 24833 raft_consensus.cc:385] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.273893 24832 raft_consensus.cc:385] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.274060 24833 raft_consensus.cc:740] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.274322 24832 raft_consensus.cc:740] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.275398 24834 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.275291 24832 consensus_queue.cc:260] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.276044 24834 ts_tablet_manager.cc:1403] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 13:09:55.275444 24833 consensus_queue.cc:260] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.278717 24834 raft_consensus.cc:359] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.279296 24834 raft_consensus.cc:385] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.279541 24834 raft_consensus.cc:740] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.280282 24834 consensus_queue.cc:260] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.284216 24668 heartbeater.cc:499] Master 127.14.45.62:40661 was elected leader, sending a full tablet report...
I20260709 13:09:55.285844 24832 ts_tablet_manager.cc:1434] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:09:55.287591 24832 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.295115 24743 heartbeater.cc:499] Master 127.14.45.62:40661 was elected leader, sending a full tablet report...
I20260709 13:09:55.295730 24833 ts_tablet_manager.cc:1434] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 13:09:55.297142 24833 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.304556 24833 tablet_bootstrap.cc:654] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.306195 24817 heartbeater.cc:499] Master 127.14.45.62:40661 was elected leader, sending a full tablet report...
I20260709 13:09:55.306622 24834 ts_tablet_manager.cc:1434] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.030s	user 0.012s	sys 0.018s
I20260709 13:09:55.308041 24834 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.308195 24832 tablet_bootstrap.cc:654] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.315881 24834 tablet_bootstrap.cc:654] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.329113 24834 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.329674 24834 ts_tablet_manager.cc:1403] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.010s
I20260709 13:09:55.332657 24834 raft_consensus.cc:359] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.333401 24834 raft_consensus.cc:385] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.333727 24834 raft_consensus.cc:740] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.334755 24834 consensus_queue.cc:260] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.336961 24834 ts_tablet_manager.cc:1434] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:55.338022 24834 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.344528 24834 tablet_bootstrap.cc:654] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:55.353574 24818 tablet.cc:2406] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:55.356583 24834 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.357204 24834 ts_tablet_manager.cc:1403] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:09:55.360430 24834 raft_consensus.cc:359] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.361205 24834 raft_consensus.cc:385] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.361512 24834 raft_consensus.cc:740] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.362280 24834 consensus_queue.cc:260] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.365041 24834 ts_tablet_manager.cc:1434] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:55.366202 24834 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.367435 24833 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.368048 24833 ts_tablet_manager.cc:1403] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.071s	user 0.032s	sys 0.028s
I20260709 13:09:55.368465 24832 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.369117 24832 ts_tablet_manager.cc:1403] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.082s	user 0.036s	sys 0.014s
I20260709 13:09:55.371479 24833 raft_consensus.cc:359] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.372401 24833 raft_consensus.cc:385] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.372622 24832 raft_consensus.cc:359] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.373685 24834 tablet_bootstrap.cc:654] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.372742 24833 raft_consensus.cc:740] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.373780 24832 raft_consensus.cc:385] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.374538 24832 raft_consensus.cc:740] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.375090 24833 consensus_queue.cc:260] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.377665 24833 ts_tablet_manager.cc:1434] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:55.378773 24833 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.375592 24832 consensus_queue.cc:260] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.384395 24832 ts_tablet_manager.cc:1434] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:09:55.385656 24832 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.385941 24833 tablet_bootstrap.cc:654] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.394740 24832 tablet_bootstrap.cc:654] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.400141 24834 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.400686 24834 ts_tablet_manager.cc:1403] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.000s
I20260709 13:09:55.403657 24834 raft_consensus.cc:359] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.404386 24834 raft_consensus.cc:385] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.404714 24834 raft_consensus.cc:740] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.405507 24834 consensus_queue.cc:260] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.406114 24833 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.406735 24833 ts_tablet_manager.cc:1403] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 13:09:55.406873 24832 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.407444 24832 ts_tablet_manager.cc:1403] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 13:09:55.407559 24834 ts_tablet_manager.cc:1434] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:55.408665 24834 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.409993 24833 raft_consensus.cc:359] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.410869 24833 raft_consensus.cc:385] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.410705 24832 raft_consensus.cc:359] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.411258 24833 raft_consensus.cc:740] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.411608 24832 raft_consensus.cc:385] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.411970 24832 raft_consensus.cc:740] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.412267 24833 consensus_queue.cc:260] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.414323 24839 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.415089 24833 ts_tablet_manager.cc:1434] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:55.414844 24839 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.415637 24834 tablet_bootstrap.cc:654] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.416261 24833 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.424656 24833 tablet_bootstrap.cc:654] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.429225 24839 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.433914 24834 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.434517 24834 ts_tablet_manager.cc:1403] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:09:55.435410 24833 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.436010 24833 ts_tablet_manager.cc:1403] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:09:55.437258 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:55.437634 24834 raft_consensus.cc:359] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.438434 24834 raft_consensus.cc:385] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.438755 24834 raft_consensus.cc:740] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.439199 24833 raft_consensus.cc:359] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.440055 24833 raft_consensus.cc:385] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.439658 24834 consensus_queue.cc:260] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.440434 24833 raft_consensus.cc:740] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
W20260709 13:09:55.442440 24683 leader_election.cc:343] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.441569 24833 consensus_queue.cc:260] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.446486 24833 ts_tablet_manager.cc:1434] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:09:55.447675 24833 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.448158 24834 ts_tablet_manager.cc:1434] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
W20260709 13:09:55.451287 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:55.413030 24832 consensus_queue.cc:260] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.455639 24833 tablet_bootstrap.cc:654] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.456491 24834 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.464110 24832 ts_tablet_manager.cc:1434] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.004s
I20260709 13:09:55.465152 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.465569 24832 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.465565 24833 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.466724 24833 ts_tablet_manager.cc:1403] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:09:55.467586 24834 tablet_bootstrap.cc:654] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.470257 24833 raft_consensus.cc:359] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
W20260709 13:09:55.470719 24682 leader_election.cc:343] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.471297 24833 raft_consensus.cc:385] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.471378 24682 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223
I20260709 13:09:55.471796 24833 raft_consensus.cc:740] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.472442 24839 raft_consensus.cc:2749] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.472960 24833 consensus_queue.cc:260] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.474185 24832 tablet_bootstrap.cc:654] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.475838 24833 ts_tablet_manager.cc:1434] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:09:55.478632 24833 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.482301 24832 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.482316 24834 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.483016 24832 ts_tablet_manager.cc:1403] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:09:55.483364 24834 ts_tablet_manager.cc:1403] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.003s
I20260709 13:09:55.486202 24833 tablet_bootstrap.cc:654] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.486405 24832 raft_consensus.cc:359] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.487320 24832 raft_consensus.cc:385] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.486907 24834 raft_consensus.cc:359] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.487763 24832 raft_consensus.cc:740] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.487969 24834 raft_consensus.cc:385] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.488857 24832 consensus_queue.cc:260] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.490935 24834 raft_consensus.cc:740] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.491984 24834 consensus_queue.cc:260] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.494321 24834 ts_tablet_manager.cc:1434] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:55.495422 24834 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.496368 24839 raft_consensus.cc:493] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.496937 24839 raft_consensus.cc:515] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.499722 24832 ts_tablet_manager.cc:1434] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:55.500676 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.500948 24832 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.501401 24833 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.501470 24792 raft_consensus.cc:2468] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 0.
I20260709 13:09:55.502104 24833 ts_tablet_manager.cc:1403] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:09:55.502543 24834 tablet_bootstrap.cc:654] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.503335 24682 leader_election.cc:304] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.505865 24839 leader_election.cc:290] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.505651 24833 raft_consensus.cc:359] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.506745 24833 raft_consensus.cc:385] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.506880 24839 raft_consensus.cc:2804] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.509974 24839 raft_consensus.cc:493] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.511134 24839 raft_consensus.cc:3060] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.514053 24832 tablet_bootstrap.cc:654] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.507169 24833 raft_consensus.cc:740] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.508304 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:55.517376 24833 consensus_queue.cc:260] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
W20260709 13:09:55.518291 24683 leader_election.cc:343] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.520802 24833 ts_tablet_manager.cc:1434] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.007s
I20260709 13:09:55.522464 24833 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.533209 24833 tablet_bootstrap.cc:654] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.540812 24838 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.541774 24838 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.546305 24856 raft_consensus.cc:493] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.547010 24856 raft_consensus.cc:515] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.550046 24856 leader_election.cc:290] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.551132 24840 raft_consensus.cc:493] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.551934 24840 raft_consensus.cc:515] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.554421 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.555490 24792 raft_consensus.cc:2468] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 0.
I20260709 13:09:55.557566 24682 leader_election.cc:304] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.558823 24856 raft_consensus.cc:2804] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.559310 24856 raft_consensus.cc:493] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.559754 24856 raft_consensus.cc:3060] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.563293 24840 leader_election.cc:290] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:55.564741 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
W20260709 13:09:55.566814 24683 leader_election.cc:343] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.568130 24838 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.568810 24856 raft_consensus.cc:515] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.570919 24834 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.571609 24834 ts_tablet_manager.cc:1403] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.076s	user 0.035s	sys 0.040s
I20260709 13:09:55.573115 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:09:55.574460 24856 leader_election.cc:290] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.573115 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.575259 24792 raft_consensus.cc:3060] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.575841 24834 raft_consensus.cc:359] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.577006 24834 raft_consensus.cc:385] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.577469 24834 raft_consensus.cc:740] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.578559 24834 consensus_queue.cc:260] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
W20260709 13:09:55.576439 24683 leader_election.cc:343] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.582435 24834 ts_tablet_manager.cc:1434] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:09:55.584110 24834 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.586295 24792 raft_consensus.cc:2468] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 1.
I20260709 13:09:55.588174 24682 leader_election.cc:304] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:55.592167 24834 tablet_bootstrap.cc:654] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.601269 24856 raft_consensus.cc:2804] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.601867 24856 raft_consensus.cc:697] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:09:55.602762 24856 consensus_queue.cc:237] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.604300 24839 raft_consensus.cc:515] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.609599 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
W20260709 13:09:55.611635 24757 leader_election.cc:343] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.612246 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf"
W20260709 13:09:55.613839 24683 leader_election.cc:343] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.614858 24833 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.615514 24833 ts_tablet_manager.cc:1403] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.093s	user 0.033s	sys 0.008s
I20260709 13:09:55.619899 24833 raft_consensus.cc:359] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.621054 24833 raft_consensus.cc:385] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.621520 24833 raft_consensus.cc:740] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.622599 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.622622 24833 consensus_queue.cc:260] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
W20260709 13:09:55.623958 24607 leader_election.cc:343] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.625968 24833 ts_tablet_manager.cc:1434] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:09:55.626441 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.627307 24833 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.627231 24718 raft_consensus.cc:2468] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.628875 24608 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: bed07f5ad4144a3a9888449359ff9223
I20260709 13:09:55.628665 24541 catalog_manager.cc:5697] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.629722 24838 raft_consensus.cc:2804] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.630162 24838 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.630508 24838 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.634692 24840 raft_consensus.cc:493] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.635308 24840 raft_consensus.cc:515] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.637404 24840 leader_election.cc:290] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:55.639847 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:55.640182 24839 leader_election.cc:290] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.639948 24838 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.641242 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
W20260709 13:09:55.641727 24757 leader_election.cc:343] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.641956 24792 raft_consensus.cc:3060] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.643451 24833 tablet_bootstrap.cc:654] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.644560 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.647647 24757 leader_election.cc:304] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:09:55.647722 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.648985 24840 raft_consensus.cc:2749] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:55.649389 24607 leader_election.cc:343] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.645360 24832 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.646016 24834 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.650820 24834 ts_tablet_manager.cc:1403] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.000s
I20260709 13:09:55.651178 24838 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Requested vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.651937 24838 raft_consensus.cc:493] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.652467 24838 raft_consensus.cc:515] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.645869 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.655577 24792 raft_consensus.cc:2468] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 1.
I20260709 13:09:55.655668 24834 raft_consensus.cc:359] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.656687 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.656899 24682 leader_election.cc:304] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
W20260709 13:09:55.657226 24757 leader_election.cc:343] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.658392 24834 raft_consensus.cc:385] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.658423 24717 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.658864 24839 raft_consensus.cc:2804] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.659487 24839 raft_consensus.cc:697] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:09:55.659668 24832 ts_tablet_manager.cc:1403] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.159s	user 0.034s	sys 0.009s
I20260709 13:09:55.660347 24839 consensus_queue.cc:237] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.662673 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc350e72f943f1ae6af73fc73eb048" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.663265 24834 raft_consensus.cc:740] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.663350 24718 raft_consensus.cc:2468] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.665565 24834 consensus_queue.cc:260] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.658494 24757 leader_election.cc:304] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:09:55.671696 24840 raft_consensus.cc:2749] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.671840 24834 ts_tablet_manager.cc:1434] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:09:55.675351 24834 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.673321 24832 raft_consensus.cc:359] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.678756 24832 raft_consensus.cc:385] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.679287 24832 raft_consensus.cc:740] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.674361 24608 leader_election.cc:304] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:09:55.680909 24870 raft_consensus.cc:2804] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.681461 24870 raft_consensus.cc:493] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.680640 24832 consensus_queue.cc:260] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.692888 24870 raft_consensus.cc:3060] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.694090 24834 tablet_bootstrap.cc:654] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.696210 24539 catalog_manager.cc:5697] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.698295 24838 leader_election.cc:290] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.698880 24838 raft_consensus.cc:493] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.699316 24838 raft_consensus.cc:515] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.701282 24838 leader_election.cc:290] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.702071 24832 ts_tablet_manager.cc:1434] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:09:55.702766 24717 raft_consensus.cc:2468] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.704550 24840 raft_consensus.cc:493] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.705273 24840 raft_consensus.cc:515] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.707721 24840 leader_election.cc:290] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:55.709379 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc350e72f943f1ae6af73fc73eb048" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.710114 24792 raft_consensus.cc:2468] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.710935 24833 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.711138 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.711639 24833 ts_tablet_manager.cc:1403] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.043s
I20260709 13:09:55.713436 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:55.713861 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.711850 24791 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.714092 24643 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 0.
I20260709 13:09:55.714521 24717 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 0.
I20260709 13:09:55.714650 24833 raft_consensus.cc:359] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.715400 24833 raft_consensus.cc:385] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.715741 24833 raft_consensus.cc:740] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.715677 24757 leader_election.cc:304] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.716331 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.716431 24608 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: bed07f5ad4144a3a9888449359ff9223
I20260709 13:09:55.716939 24718 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.717165 24840 raft_consensus.cc:2804] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.717558 24840 raft_consensus.cc:493] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.717919 24840 raft_consensus.cc:3060] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.718211 24607 leader_election.cc:304] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.718650 24874 raft_consensus.cc:2804] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.719241 24875 raft_consensus.cc:2804] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.719734 24875 raft_consensus.cc:493] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.720132 24875 raft_consensus.cc:3060] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.725652 24840 raft_consensus.cc:515] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.713083 24870 raft_consensus.cc:515] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.729395 24834 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.730027 24834 ts_tablet_manager.cc:1403] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
I20260709 13:09:55.730523 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc350e72f943f1ae6af73fc73eb048" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.731266 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.731391 24717 raft_consensus.cc:3060] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.731889 24718 raft_consensus.cc:3060] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.733222 24834 raft_consensus.cc:359] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.734443 24834 raft_consensus.cc:385] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.734795 24834 raft_consensus.cc:740] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.726794 24833 consensus_queue.cc:260] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.739650 24833 ts_tablet_manager.cc:1434] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:09:55.739799 24718 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 1.
I20260709 13:09:55.740780 24833 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.741135 24757 leader_election.cc:304] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.742210 24834 consensus_queue.cc:260] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.742887 24832 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.743566 24838 raft_consensus.cc:493] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.746330 24840 leader_election.cc:290] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:55.751139 24875 raft_consensus.cc:515] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.753705 24838 raft_consensus.cc:515] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.755472 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc350e72f943f1ae6af73fc73eb048" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.756161 24791 raft_consensus.cc:3060] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.756618 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.757484 24792 raft_consensus.cc:2393] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 023415e53632418788805b558a25eaaf in current term 1: Already voted for candidate bed07f5ad4144a3a9888449359ff9223 in this term.
I20260709 13:09:55.757939 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.758643 24790 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.761107 24607 leader_election.cc:304] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.762048 24875 leader_election.cc:290] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Requested vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.762673 24875 raft_consensus.cc:493] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.763144 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.764068 24833 tablet_bootstrap.cc:654] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.764196 24716 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.764168 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.763604 24838 leader_election.cc:290] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.770888 24838 raft_consensus.cc:2804] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.771271 24838 raft_consensus.cc:493] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.771616 24838 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.763123 24875 raft_consensus.cc:515] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.764747 24874 raft_consensus.cc:697] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Becoming Leader. State: Replica: 023415e53632418788805b558a25eaaf, State: Running, Role: LEADER
I20260709 13:09:55.774045 24718 raft_consensus.cc:2393] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 023415e53632418788805b558a25eaaf in current term 1: Already voted for candidate bed07f5ad4144a3a9888449359ff9223 in this term.
I20260709 13:09:55.774413 24874 consensus_queue.cc:237] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.776054 24608 leader_election.cc:304] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 023415e53632418788805b558a25eaaf; no voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223
I20260709 13:09:55.765643 24840 raft_consensus.cc:2804] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.778174 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.778752 24832 tablet_bootstrap.cc:654] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.779165 24718 raft_consensus.cc:2468] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.779448 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.778437 24840 raft_consensus.cc:697] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:09:55.780093 24790 raft_consensus.cc:2468] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:55.780292 24791 raft_consensus.cc:2468] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.763661 24870 leader_election.cc:290] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Requested vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.778260 24875 leader_election.cc:290] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.781966 24840 consensus_queue.cc:237] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.782586 24877 raft_consensus.cc:2749] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.783951 24717 raft_consensus.cc:2468] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.781134 24608 leader_election.cc:304] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:09:55.787348 24834 ts_tablet_manager.cc:1434] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.057s	user 0.016s	sys 0.000s
I20260709 13:09:55.792979 24877 raft_consensus.cc:2804] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.794428 24877 raft_consensus.cc:493] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.794939 24834 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: Bootstrap starting.
I20260709 13:09:55.795025 24877 raft_consensus.cc:3060] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.795691 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:09:55.796802 24643 raft_consensus.cc:2393] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed07f5ad4144a3a9888449359ff9223 in current term 1: Already voted for candidate 023415e53632418788805b558a25eaaf in this term.
I20260709 13:09:55.796768 24879 raft_consensus.cc:493] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.797595 24879 raft_consensus.cc:515] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.800101 24879 leader_election.cc:290] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:55.801436 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:55.801874 24834 tablet_bootstrap.cc:654] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.804028 24838 raft_consensus.cc:515] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.805567 24833 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.805294 24877 raft_consensus.cc:515] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.806093 24833 ts_tablet_manager.cc:1403] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.001s
I20260709 13:09:55.806306 24838 leader_election.cc:290] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Requested vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.806943 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:55.807556 24717 raft_consensus.cc:2468] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 0.
I20260709 13:09:55.807659 24877 leader_election.cc:290] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Requested vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.808591 24757 leader_election.cc:304] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.808959 24833 raft_consensus.cc:359] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.809689 24833 raft_consensus.cc:385] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:55.809969 24757 leader_election.cc:343] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.810060 24833 raft_consensus.cc:740] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.810768 24879 raft_consensus.cc:2804] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.811200 24879 raft_consensus.cc:493] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.810994 24833 consensus_queue.cc:260] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.811555 24879 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.793843 24608 leader_election.cc:304] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:09:55.814234 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.815202 24717 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.819939 24833 ts_tablet_manager.cc:1434] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:55.820967 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.821666 24790 raft_consensus.cc:3060] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.824383 24539 catalog_manager.cc:5697] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 023415e53632418788805b558a25eaaf (127.14.45.1). New cstate: current_term: 1 leader_uuid: "023415e53632418788805b558a25eaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.821033 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.827666 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.828287 24718 raft_consensus.cc:3060] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.829850 24791 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.834803 24717 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.840358 24877 raft_consensus.cc:2804] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.845059 24834 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: No bootstrap required, opened a new log
I20260709 13:09:55.839881 24879 raft_consensus.cc:515] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.845348 24718 raft_consensus.cc:2468] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.849958 24608 leader_election.cc:304] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:09:55.850739 24838 raft_consensus.cc:2804] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.851230 24838 raft_consensus.cc:697] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Becoming Leader. State: Replica: 023415e53632418788805b558a25eaaf, State: Running, Role: LEADER
I20260709 13:09:55.851646 24833 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006: Bootstrap starting.
I20260709 13:09:55.852025 24838 consensus_queue.cc:237] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.852511 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:09:55.855749 24879 leader_election.cc:290] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:55.858187 24790 raft_consensus.cc:2468] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.860026 24791 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:55.855836 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:55.862687 24607 leader_election.cc:304] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:55.863330 24716 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.864092 24878 raft_consensus.cc:2804] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.864681 24878 raft_consensus.cc:697] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Becoming Leader. State: Replica: 023415e53632418788805b558a25eaaf, State: Running, Role: LEADER
I20260709 13:09:55.864928 24832 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
W20260709 13:09:55.857170 24757 leader_election.cc:343] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.847471 24877 raft_consensus.cc:697] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Becoming Leader. State: Replica: 023415e53632418788805b558a25eaaf, State: Running, Role: LEADER
I20260709 13:09:55.862629 24833 tablet_bootstrap.cc:654] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.873339 24877 consensus_queue.cc:237] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:55.865542 24878 consensus_queue.cc:237] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.865952 24832 ts_tablet_manager.cc:1403] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.008s
I20260709 13:09:55.876566 24716 raft_consensus.cc:2468] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 1.
I20260709 13:09:55.877173 24539 catalog_manager.cc:5697] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.877970 24757 leader_election.cc:304] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:55.879490 24840 raft_consensus.cc:2804] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.880024 24840 raft_consensus.cc:697] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:09:55.881448 24840 consensus_queue.cc:237] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.848803 24834 ts_tablet_manager.cc:1403] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.010s
I20260709 13:09:55.896201 24539 catalog_manager.cc:5697] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 023415e53632418788805b558a25eaaf (127.14.45.1). New cstate: current_term: 1 leader_uuid: "023415e53632418788805b558a25eaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.896987 24541 catalog_manager.cc:5697] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.899351 24833 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006: No bootstrap required, opened a new log
I20260709 13:09:55.879933 24832 raft_consensus.cc:359] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.899964 24839 raft_consensus.cc:493] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.900539 24833 ts_tablet_manager.cc:1403] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.009s
I20260709 13:09:55.900938 24832 raft_consensus.cc:385] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.900784 24839 raft_consensus.cc:515] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.889012 24834 raft_consensus.cc:359] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.905524 24834 raft_consensus.cc:385] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.905864 24834 raft_consensus.cc:740] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.906335 24839 leader_election.cc:290] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.906909 24832 raft_consensus.cc:740] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.907634 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:55.907989 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:55.907852 24832 consensus_queue.cc:260] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.908325 24791 raft_consensus.cc:2468] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 0.
W20260709 13:09:55.909572 24683 leader_election.cc:343] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.903580 24833 raft_consensus.cc:359] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.910526 24682 leader_election.cc:304] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:55.910889 24833 raft_consensus.cc:385] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.910369 24834 consensus_queue.cc:260] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.911213 24833 raft_consensus.cc:740] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.911796 24839 raft_consensus.cc:2804] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.912245 24839 raft_consensus.cc:493] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.912062 24833 consensus_queue.cc:260] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.912631 24839 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.912812 24834 ts_tablet_manager.cc:1434] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:55.910369 24832 ts_tablet_manager.cc:1434] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:09:55.914570 24832 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.921135 24832 tablet_bootstrap.cc:654] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.922045 24833 ts_tablet_manager.cc:1434] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:09:55.922274 24839 raft_consensus.cc:515] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.922478 24540 catalog_manager.cc:5697] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 023415e53632418788805b558a25eaaf (127.14.45.1). New cstate: current_term: 1 leader_uuid: "023415e53632418788805b558a25eaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.924474 24540 catalog_manager.cc:5697] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 023415e53632418788805b558a25eaaf (127.14.45.1). New cstate: current_term: 1 leader_uuid: "023415e53632418788805b558a25eaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.925709 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf"
W20260709 13:09:55.928857 24683 leader_election.cc:343] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.931236 24839 leader_election.cc:290] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:55.931459 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:55.932119 24791 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.936115 24832 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.936661 24832 ts_tablet_manager.cc:1403] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:09:55.938954 24791 raft_consensus.cc:2468] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 1.
I20260709 13:09:55.940129 24682 leader_election.cc:304] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:55.939640 24832 raft_consensus.cc:359] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.941042 24832 raft_consensus.cc:385] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.941169 24839 raft_consensus.cc:2804] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.941380 24832 raft_consensus.cc:740] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.941915 24839 raft_consensus.cc:697] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:09:55.942373 24832 consensus_queue.cc:260] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.942879 24839 consensus_queue.cc:237] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.944662 24832 ts_tablet_manager.cc:1434] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:55.945676 24832 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.951880 24832 tablet_bootstrap.cc:654] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.952520 24539 catalog_manager.cc:5697] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.956367 24832 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.956962 24832 ts_tablet_manager.cc:1403] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:09:55.959453 24832 raft_consensus.cc:359] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.959973 24832 raft_consensus.cc:385] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.960246 24832 raft_consensus.cc:740] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.960983 24832 consensus_queue.cc:260] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.962986 24832 ts_tablet_manager.cc:1434] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:55.963828 24832 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.968900 24832 tablet_bootstrap.cc:654] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.973282 24832 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.973839 24832 ts_tablet_manager.cc:1403] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:09:55.976879 24832 raft_consensus.cc:359] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.977574 24832 raft_consensus.cc:385] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.977921 24832 raft_consensus.cc:740] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.978601 24832 consensus_queue.cc:260] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.980722 24832 ts_tablet_manager.cc:1434] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:55.981983 24832 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:09:55.986512 24832 tablet_bootstrap.cc:654] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.991101 24832 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: No bootstrap required, opened a new log
I20260709 13:09:55.991532 24832 ts_tablet_manager.cc:1403] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:55.993980 24832 raft_consensus.cc:359] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.994572 24832 raft_consensus.cc:385] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.994783 24832 raft_consensus.cc:740] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.995409 24832 consensus_queue.cc:260] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:55.997251 24832 ts_tablet_manager.cc:1434] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:56.031620 24878 raft_consensus.cc:493] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.032176 24878 raft_consensus.cc:515] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:56.035037 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:56.035296 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:56.035748 24716 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:56.035766 24878 leader_election.cc:290] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:56.035969 24791 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 0.
I20260709 13:09:56.036612 24643 raft_consensus.cc:3060] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.037006 24608 leader_election.cc:304] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:09:56.037972 24878 raft_consensus.cc:2804] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:56.038367 24878 raft_consensus.cc:493] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.038702 24878 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.046103 24839 consensus_queue.cc:1048] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.046027 24878 raft_consensus.cc:515] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:56.048699 24878 leader_election.cc:290] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Requested vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:56.049038 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:56.049440 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:56.049777 24716 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.050227 24791 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.059317 24716 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:56.060873 24840 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.061054 24608 leader_election.cc:304] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:09:56.061535 24840 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:56.062129 24838 raft_consensus.cc:2804] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.062687 24838 raft_consensus.cc:697] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Becoming Leader. State: Replica: 023415e53632418788805b558a25eaaf, State: Running, Role: LEADER
I20260709 13:09:56.063637 24838 consensus_queue.cc:237] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:56.063956 24840 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:56.065043 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "023415e53632418788805b558a25eaaf" is_pre_election: true
I20260709 13:09:56.065909 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:56.067338 24716 raft_consensus.cc:2393] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed07f5ad4144a3a9888449359ff9223 in current term 1: Already voted for candidate 023415e53632418788805b558a25eaaf in this term.
I20260709 13:09:56.068663 24757 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:09:56.069509 24839 consensus_queue.cc:1048] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.069852 24840 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.071713 24791 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 023415e53632418788805b558a25eaaf in term 1.
I20260709 13:09:56.081298 24840 raft_consensus.cc:2749] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.089129 24539 catalog_manager.cc:5697] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 023415e53632418788805b558a25eaaf (127.14.45.1). New cstate: current_term: 1 leader_uuid: "023415e53632418788805b558a25eaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.167346 14516 ts_manager.cc:295] Set tserver state for 023415e53632418788805b558a25eaaf to MAINTENANCE_MODE
I20260709 13:09:56.168138 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
I20260709 13:09:56.189929 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.190929 14516 tablet_replica.cc:333] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.191540 14516 raft_consensus.cc:2243] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.191980 14516 raft_consensus.cc:2272] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.194896 14516 tablet_replica.cc:333] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.195479 14516 raft_consensus.cc:2243] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.195837 14516 raft_consensus.cc:2272] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.197952 14516 tablet_replica.cc:333] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.198733 14516 raft_consensus.cc:2243] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.199566 14516 pending_rounds.cc:70] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Trying to abort 1 pending ops.
I20260709 13:09:56.199863 14516 pending_rounds.cc:77] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636233513897984 op_type: NO_OP noop_request { }
I20260709 13:09:56.200260 14516 raft_consensus.cc:2889] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.200603 14516 raft_consensus.cc:2272] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.202890 24838 consensus_queue.cc:1048] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.204233 14516 tablet_replica.cc:333] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.204891 14516 raft_consensus.cc:2243] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.205281 14516 raft_consensus.cc:2272] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.207319 14516 tablet_replica.cc:333] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.208062 14516 raft_consensus.cc:2243] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.208570 14516 raft_consensus.cc:2272] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.210824 14516 tablet_replica.cc:333] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.211561 14516 raft_consensus.cc:2243] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.217424 14516 raft_consensus.cc:2272] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.219826 14516 tablet_replica.cc:333] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.220407 14516 raft_consensus.cc:2243] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.221017 14516 pending_rounds.cc:70] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Trying to abort 1 pending ops.
I20260709 13:09:56.221256 14516 pending_rounds.cc:77] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636232720723968 op_type: NO_OP noop_request { }
I20260709 13:09:56.221632 14516 raft_consensus.cc:2889] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.221997 14516 raft_consensus.cc:2272] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.224191 14516 tablet_replica.cc:333] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.224738 14516 raft_consensus.cc:2243] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.225212 14516 raft_consensus.cc:2272] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.227506 14516 tablet_replica.cc:333] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.228036 14516 raft_consensus.cc:2243] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.228609 14516 pending_rounds.cc:70] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Trying to abort 1 pending ops.
I20260709 13:09:56.228852 14516 pending_rounds.cc:77] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636232621289472 op_type: NO_OP noop_request { }
I20260709 13:09:56.229136 14516 raft_consensus.cc:2889] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.229400 14516 raft_consensus.cc:2272] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.231649 14516 tablet_replica.cc:333] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: stopping tablet replica
I20260709 13:09:56.232225 14516 raft_consensus.cc:2243] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.232813 14516 pending_rounds.cc:70] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Trying to abort 1 pending ops.
I20260709 13:09:56.233017 14516 pending_rounds.cc:77] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636232708251648 op_type: NO_OP noop_request { }
I20260709 13:09:56.233289 14516 raft_consensus.cc:2889] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.233606 14516 raft_consensus.cc:2272] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.265604 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
W20260709 13:09:56.268976 24683 consensus_peers.cc:597] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.273597 24840 consensus_queue.cc:1048] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.287060 24839 consensus_queue.cc:1048] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:56.296519 24757 consensus_peers.cc:597] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.331562 24840 consensus_queue.cc:1048] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:56.346485 24757 consensus_peers.cc:597] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.405804 24683 consensus_peers.cc:597] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.434556 24839 consensus_queue.cc:1048] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:56.452533 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:56.454428 24683 consensus_peers.cc:597] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:57.453606 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:57.453667 24856 raft_consensus.cc:493] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.454461 24856 raft_consensus.cc:515] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:57.456857 24856 leader_election.cc:290] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597), 023415e53632418788805b558a25eaaf (127.14.45.1:32783)
I20260709 13:09:57.457588 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc350e72f943f1ae6af73fc73eb048" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:57.458455 24790 raft_consensus.cc:2468] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 1.
I20260709 13:09:57.459851 24682 leader_election.cc:304] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:57.460767 24856 raft_consensus.cc:2804] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:57.461261 24856 raft_consensus.cc:493] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.461683 24856 raft_consensus.cc:3060] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:57.462347 24683 leader_election.cc:336] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.467973 24856 raft_consensus.cc:515] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:57.470136 24856 leader_election.cc:290] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Requested vote from peers bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597), 023415e53632418788805b558a25eaaf (127.14.45.1:32783)
I20260709 13:09:57.470988 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc350e72f943f1ae6af73fc73eb048" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:57.471858 24790 raft_consensus.cc:3060] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:57.476017 24683 leader_election.cc:336] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.479112 24790 raft_consensus.cc:2468] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 2.
I20260709 13:09:57.480250 24682 leader_election.cc:304] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:57.480949 24856 raft_consensus.cc:2804] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:57.481387 24856 raft_consensus.cc:697] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:09:57.482257 24840 raft_consensus.cc:493] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.482175 24856 consensus_queue.cc:237] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:09:57.482861 24840 raft_consensus.cc:515] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.484790 24840 leader_election.cc:290] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:57.486729 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:57.487428 24716 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 1.
I20260709 13:09:57.489246 24757 leader_election.cc:304] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:57.490149 24840 raft_consensus.cc:2804] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:57.490207 24757 leader_election.cc:336] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.490701 24840 raft_consensus.cc:493] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.491128 24840 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.491302 24540 catalog_manager.cc:5697] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 1 to 2, leader changed from 023415e53632418788805b558a25eaaf (127.14.45.1) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:57.496892 24840 raft_consensus.cc:515] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.499560 24840 leader_election.cc:290] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:57.501127 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:57.501974 24716 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:57.503850 24757 leader_election.cc:336] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.508224 24716 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:09:57.509582 24757 leader_election.cc:304] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:57.510365 24840 raft_consensus.cc:2804] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:57.511445 24840 raft_consensus.cc:697] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:09:57.512193 24840 consensus_queue.cc:237] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.519528 24540 catalog_manager.cc:5697] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 1 to 2, leader changed from 023415e53632418788805b558a25eaaf (127.14.45.1) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.623054 24840 raft_consensus.cc:493] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.623657 24840 raft_consensus.cc:515] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.625434 24840 leader_election.cc:290] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:57.627087 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:57.627849 24716 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 1.
I20260709 13:09:57.628975 24757 leader_election.cc:304] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:57.629644 24840 raft_consensus.cc:2804] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:57.629702 24757 leader_election.cc:336] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.630111 24840 raft_consensus.cc:493] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.630487 24840 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.635453 24840 raft_consensus.cc:515] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.637122 24840 leader_election.cc:290] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
W20260709 13:09:57.638644 24757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111) [suppressed 132 similar messages]
I20260709 13:09:57.638705 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:57.639482 24716 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:57.641489 24757 leader_election.cc:336] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.645517 24716 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:09:57.646732 24757 leader_election.cc:304] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:57.647511 24840 raft_consensus.cc:2804] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:57.647994 24840 raft_consensus.cc:697] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:09:57.648747 24840 consensus_queue.cc:237] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.656749 24540 catalog_manager.cc:5697] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 1 to 2, leader changed from 023415e53632418788805b558a25eaaf (127.14.45.1) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.670351 24840 raft_consensus.cc:493] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.670837 24840 raft_consensus.cc:515] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.672621 24840 leader_election.cc:290] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:57.674165 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:09:57.674887 24716 raft_consensus.cc:2468] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 1.
I20260709 13:09:57.675834 24757 leader_election.cc:304] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:09:57.676623 24840 raft_consensus.cc:2804] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:57.676620 24757 leader_election.cc:336] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.677026 24840 raft_consensus.cc:493] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.677436 24840 raft_consensus.cc:3060] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.682809 24840 raft_consensus.cc:515] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.684425 24840 leader_election.cc:290] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:09:57.686139 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f17ee7e91c4908a9d1428edaa8c110" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:09:57.686703 24716 raft_consensus.cc:3060] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:57.688071 24757 leader_election.cc:336] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.691654 24716 raft_consensus.cc:2468] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:09:57.692811 24757 leader_election.cc:304] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:57.693593 24840 raft_consensus.cc:2804] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:57.694041 24840 raft_consensus.cc:697] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:09:57.694805 24840 consensus_queue.cc:237] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.703259 24540 catalog_manager.cc:5697] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 1 to 2, leader changed from 023415e53632418788805b558a25eaaf (127.14.45.1) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.715369 24856 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 023415e53632418788805b558a25eaaf)
I20260709 13:09:57.715925 24856 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.717900 24856 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:57.719031 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:09:57.719738 24790 raft_consensus.cc:2468] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 1.
I20260709 13:09:57.720737 24682 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
W20260709 13:09:57.721339 24683 leader_election.cc:336] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.721558 24856 raft_consensus.cc:2804] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:57.722039 24856 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 023415e53632418788805b558a25eaaf)
I20260709 13:09:57.722365 24856 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.727414 24856 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.729072 24856 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:09:57.730234 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:09:57.730789 24790 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:57.732997 24683 leader_election.cc:336] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111)
I20260709 13:09:57.735878 24790 raft_consensus.cc:2468] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 2.
I20260709 13:09:57.736919 24682 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 023415e53632418788805b558a25eaaf
I20260709 13:09:57.737632 24856 raft_consensus.cc:2804] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:57.738125 24856 raft_consensus.cc:697] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:09:57.738907 24856 consensus_queue.cc:237] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:09:57.746690 24540 catalog_manager.cc:5697] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 1 to 2, leader changed from 023415e53632418788805b558a25eaaf (127.14.45.1) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:57.919924 24683 consensus_peers.cc:597] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:57.958317 24757 consensus_peers.cc:597] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.074455 24790 raft_consensus.cc:1275] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:58.075863 24856 consensus_queue.cc:1048] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.104033 24716 raft_consensus.cc:1275] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:58.105248 24840 consensus_queue.cc:1048] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:58.124073 24757 consensus_peers.cc:597] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:58.153103 24683 consensus_peers.cc:597] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.165457 24716 raft_consensus.cc:1275] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:58.166879 24927 consensus_queue.cc:1048] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:58.205785 24757 consensus_peers.cc:597] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.224360 24790 raft_consensus.cc:1275] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.225980 24912 consensus_queue.cc:1048] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.273180 24716 raft_consensus.cc:1275] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:58.274703 24840 consensus_queue.cc:1048] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:58.454905 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:58.714448 24683 consensus_peers.cc:597] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.805115 24757 consensus_peers.cc:597] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.856565 24757 consensus_peers.cc:597] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.906955 24683 consensus_peers.cc:597] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:59.151969 24683 consensus_peers.cc:597] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:59.455984 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:00.347937 24757 consensus_peers.cc:597] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:00.457221 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:00.461301 24683 consensus_peers.cc:597] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:00.642122 24683 consensus_peers.cc:597] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:00.714143 24757 consensus_peers.cc:597] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:00.854697 24757 consensus_peers.cc:597] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:00.995083 24757 consensus_peers.cc:597] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:01.198698 24683 consensus_peers.cc:597] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:01.252796 24683 consensus_peers.cc:597] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:01.289397 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:01.290635 24757 consensus_peers.cc:597] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:01.295603 24934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:01.297183 24935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:01.298584 24937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:01.301002 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:01.302819 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:01.303109 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:01.303315 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602601303299 us; error 0 us; skew 500 ppm
I20260709 13:10:01.303959 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:01.306607 14516 webserver.cc:533] Webserver started at http://127.14.45.1:37655/ using document root <none> and password file <none>
I20260709 13:10:01.307121 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:01.307304 14516 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:01.310755 14516 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:01.314818 24942 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:01.315749 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:10:01.316126 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "023415e53632418788805b558a25eaaf"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-lfdf"
I20260709 13:10:01.316501 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:01.342394 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:01.343670 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:01.345314 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:01.349184 24949 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:10:01.408668 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:10:01.409047 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:10:01.409425 14516 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:10:01.414942 24949 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.428239 24949 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:01.429106 24949 tablet_bootstrap.cc:492] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.429658 24949 ts_tablet_manager.cc:1403] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:10:01.431684 24949 raft_consensus.cc:359] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:10:01.432369 24949 raft_consensus.cc:740] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.433100 24949 consensus_queue.cc:260] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } } peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } }
I20260709 13:10:01.437001 24949 ts_tablet_manager.cc:1434] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:01.437978 24949 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.450297 24949 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:01.451143 24949 tablet_bootstrap.cc:492] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.451718 24949 ts_tablet_manager.cc:1403] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:10:01.453661 24949 raft_consensus.cc:359] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.454056 14516 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:10:01.454452 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.045s	user 0.045s	sys 0.000s
I20260709 13:10:01.454350 24949 raft_consensus.cc:740] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.455322 24949 consensus_queue.cc:260] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.456998 24949 ts_tablet_manager.cc:1434] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:01.457836 24949 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Bootstrap starting.
W20260709 13:10:01.458498 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:01.474710 24949 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.476001 24949 tablet_bootstrap.cc:492] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.476766 24949 ts_tablet_manager.cc:1403] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:10:01.479539 24949 raft_consensus.cc:359] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.480315 24949 raft_consensus.cc:740] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.481055 24949 consensus_queue.cc:260] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.482707 24949 ts_tablet_manager.cc:1434] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:10:01.483371 24949 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.494220 24949 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.495189 24949 tablet_bootstrap.cc:492] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.495748 24949 ts_tablet_manager.cc:1403] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:10:01.497941 24949 raft_consensus.cc:359] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.498627 24949 raft_consensus.cc:740] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.499243 24949 consensus_queue.cc:260] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.500722 24949 ts_tablet_manager.cc:1434] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:01.501356 24949 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.513603 24949 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:01.514420 24949 tablet_bootstrap.cc:492] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.514974 24949 ts_tablet_manager.cc:1403] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:10:01.515851 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:32783
I20260709 13:10:01.516013 25011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:32783 every 8 connection(s)
I20260709 13:10:01.517208 24949 raft_consensus.cc:359] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.517939 24949 raft_consensus.cc:740] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.518671 24949 consensus_queue.cc:260] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.520354 24949 ts_tablet_manager.cc:1434] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:10:01.520639 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.521222 24949 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.544915 24949 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:01.545701 24949 tablet_bootstrap.cc:492] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.546365 24949 ts_tablet_manager.cc:1403] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.010s
I20260709 13:10:01.549243 24949 raft_consensus.cc:359] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.549942 24949 raft_consensus.cc:740] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.550506 24949 consensus_queue.cc:260] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.552476 24949 ts_tablet_manager.cc:1434] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:01.553339 24949 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.555202 24790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
mode: GRACEFUL
new_leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:10:01.555967 24790 raft_consensus.cc:606] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Received request to transfer leadership to TS bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:10:01.557325 25012 heartbeater.cc:344] Connected to a master server at 127.14.45.62:40661
I20260709 13:10:01.557984 25012 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:01.559206 25012 heartbeater.cc:507] Master 127.14.45.62:40661 requested a full tablet report, sending...
I20260709 13:10:01.569221 24540 ts_manager.cc:194] Re-registered known tserver with Master: 023415e53632418788805b558a25eaaf (127.14.45.1:32783)
I20260709 13:10:01.585143 24540 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35978
I20260709 13:10:01.589720 25012 heartbeater.cc:499] Master 127.14.45.62:40661 was elected leader, sending a full tablet report...
I20260709 13:10:01.597028 24986 raft_consensus.cc:3060] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.602144 24949 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.605583 24949 tablet_bootstrap.cc:492] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.605675 24986 pending_rounds.cc:85] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Aborting all ops after (but not including) 0
I20260709 13:10:01.606345 24949 ts_tablet_manager.cc:1403] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.023s
I20260709 13:10:01.608232 24983 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.608825 24949 raft_consensus.cc:359] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.609385 24949 raft_consensus.cc:385] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.609609 24949 raft_consensus.cc:740] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.610215 24986 pending_rounds.cc:107] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:01.610432 24949 consensus_queue.cc:260] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.611044 24986 raft_consensus.cc:2889] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.613550 24949 ts_tablet_manager.cc:1434] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:01.614650 24949 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.616142 24983 pending_rounds.cc:85] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Aborting all ops after (but not including) 0
I20260709 13:10:01.616482 24983 pending_rounds.cc:107] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:01.616714 24983 raft_consensus.cc:2889] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.627336 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
mode: GRACEFUL
new_leader_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:10:01.628252 24717 raft_consensus.cc:606] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Received request to transfer leadership to TS bed07f5ad4144a3a9888449359ff9223
I20260709 13:10:01.630281 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:01.631153 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:01.632189 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.653129 24949 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.654096 24949 tablet_bootstrap.cc:492] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.654843 24949 ts_tablet_manager.cc:1403] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.014s
I20260709 13:10:01.657335 24949 raft_consensus.cc:359] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.658169 24949 raft_consensus.cc:385] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.658465 24949 raft_consensus.cc:740] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.659113 24949 consensus_queue.cc:260] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.661087 24949 ts_tablet_manager.cc:1434] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:01.661793 24949 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.673925 24949 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.674670 24949 tablet_bootstrap.cc:492] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.675276 24949 ts_tablet_manager.cc:1403] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:01.676959 24949 raft_consensus.cc:359] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.677424 24949 raft_consensus.cc:385] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.677614 24949 raft_consensus.cc:740] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.678233 24949 consensus_queue.cc:260] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.680007 24949 ts_tablet_manager.cc:1434] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:01.680759 24949 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Bootstrap starting.
I20260709 13:10:01.682499 24986 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.695827 24949 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.696576 24949 tablet_bootstrap.cc:492] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Bootstrap complete.
I20260709 13:10:01.697260 24949 ts_tablet_manager.cc:1403] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:10:01.699137 24949 raft_consensus.cc:359] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.699705 24949 raft_consensus.cc:740] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 023415e53632418788805b558a25eaaf, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.700523 24949 consensus_queue.cc:260] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.702117 24949 ts_tablet_manager.cc:1434] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:10:01.781723 24983 raft_consensus.cc:3060] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.781724 24986 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.785418 25023 raft_consensus.cc:493] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.786710 25023 raft_consensus.cc:515] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.797042 25023 leader_election.cc:290] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:10:01.813273 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" is_pre_election: true
I20260709 13:10:01.818969 24986 raft_consensus.cc:3060] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.815117 24983 pending_rounds.cc:85] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Aborting all ops after (but not including) 0
I20260709 13:10:01.823308 24983 pending_rounds.cc:107] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:01.825043 24983 raft_consensus.cc:2889] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.842927 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "023415e53632418788805b558a25eaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed07f5ad4144a3a9888449359ff9223" is_pre_election: true
I20260709 13:10:01.845057 24944 leader_election.cc:304] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 023415e53632418788805b558a25eaaf; no voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223
I20260709 13:10:01.846585 24951 raft_consensus.cc:2749] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.924896 24856 raft_consensus.cc:993] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: : Instructing follower bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:01.925700 24856 raft_consensus.cc:1081] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Signalling peer bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:01.927815 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:56036
I20260709 13:10:01.928449 24791 raft_consensus.cc:493] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.928803 24791 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.936331 24791 raft_consensus.cc:515] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.938230 24791 leader_election.cc:290] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 3 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:10:01.939210 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:01.939397 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b68c3cfcd6c45e5b77b07c39025395b" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:10:01.940035 24986 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.940140 24717 raft_consensus.cc:3055] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.940609 24717 raft_consensus.cc:740] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:01.941633 24717 consensus_queue.cc:260] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.943303 24717 raft_consensus.cc:3060] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.947050 24986 raft_consensus.cc:2468] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 3.
I20260709 13:10:01.949009 24757 leader_election.cc:304] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:10:01.950323 24933 raft_consensus.cc:2804] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.950937 24933 raft_consensus.cc:697] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 3 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:01.952414 24717 raft_consensus.cc:2468] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 3.
I20260709 13:10:01.952266 24933 consensus_queue.cc:237] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:01.962332 24540 catalog_manager.cc:5697] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 2 to 3, leader changed from bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.974138 24986 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.014376 24986 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.020658 24986 pending_rounds.cc:85] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Aborting all ops after (but not including) 0
I20260709 13:10:02.020903 24986 pending_rounds.cc:107] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:02.021178 24986 raft_consensus.cc:2889] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.148934 24927 raft_consensus.cc:993] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: : Instructing follower bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:02.149648 25046 raft_consensus.cc:1081] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Signalling peer bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:02.151384 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:43936
I20260709 13:10:02.152031 24717 raft_consensus.cc:493] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.152410 24717 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.160250 24717 raft_consensus.cc:515] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.162274 24717 leader_election.cc:290] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 3 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:10:02.163089 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:02.163661 24986 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.163499 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530b1eb6da54447ead123d0f8e1568b9" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:10:02.164243 24791 raft_consensus.cc:3055] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.164593 24791 raft_consensus.cc:740] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:02.165613 24791 consensus_queue.cc:260] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.167002 24791 raft_consensus.cc:3060] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.171519 24986 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 3.
I20260709 13:10:02.173033 24683 leader_election.cc:304] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:10:02.173916 24856 raft_consensus.cc:2804] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.174396 24856 raft_consensus.cc:697] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:02.174635 24791 raft_consensus.cc:2468] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 3.
I20260709 13:10:02.175587 24856 consensus_queue.cc:237] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.183739 24540 catalog_manager.cc:5697] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 2 to 3, leader changed from bed07f5ad4144a3a9888449359ff9223 (127.14.45.3) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.421437 24717 raft_consensus.cc:1275] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.422832 24933 consensus_queue.cc:1048] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.428951 24986 raft_consensus.cc:1275] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.433164 24933 consensus_queue.cc:1048] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:02.459930 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:02.569953 24791 raft_consensus.cc:1275] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:02.571430 25028 consensus_queue.cc:1048] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.582324 24986 raft_consensus.cc:1275] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:02.583683 25028 consensus_queue.cc:1048] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.648344 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.657056 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
mode: GRACEFUL
new_leader_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:10:02.657677 24717 raft_consensus.cc:606] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Received request to transfer leadership to TS bed07f5ad4144a3a9888449359ff9223
I20260709 13:10:02.660527 24791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
mode: GRACEFUL
new_leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:10:02.660981 24791 raft_consensus.cc:606] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Received request to transfer leadership to TS bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:10:02.662303 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:02.662725 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.663349 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.806416 25046 raft_consensus.cc:993] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: : Instructing follower bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:02.806999 25046 raft_consensus.cc:1081] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Signalling peer bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:02.808645 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:43936
I20260709 13:10:02.809196 24717 raft_consensus.cc:493] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.809499 24717 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.815352 24717 raft_consensus.cc:515] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.817015 24717 leader_election.cc:290] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 3 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:10:02.817924 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:02.818240 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a07e68dc2e48f5b7b5a3c443a1394a" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:10:02.818894 24986 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.818950 24791 raft_consensus.cc:3055] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.819386 24791 raft_consensus.cc:740] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:02.820216 24791 consensus_queue.cc:260] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.821280 24791 raft_consensus.cc:3060] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.824501 24986 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 3.
I20260709 13:10:02.825729 24683 leader_election.cc:304] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:10:02.826615 25038 raft_consensus.cc:2804] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.826906 24791 raft_consensus.cc:2468] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 3.
I20260709 13:10:02.827019 25038 raft_consensus.cc:697] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:02.828153 25038 consensus_queue.cc:237] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.835812 24539 catalog_manager.cc:5697] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 2 to 3, leader changed from bed07f5ad4144a3a9888449359ff9223 (127.14.45.3) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.931366 25028 raft_consensus.cc:993] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: : Instructing follower bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:02.931900 25038 raft_consensus.cc:1081] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Signalling peer bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:02.933671 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:56036
I20260709 13:10:02.934257 24791 raft_consensus.cc:493] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.934743 24791 raft_consensus.cc:3060] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.940505 24791 raft_consensus.cc:515] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.942272 24791 leader_election.cc:290] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:10:02.943164 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:02.943974 24986 raft_consensus.cc:3060] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.943749 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c486139d9604f188afcf0e39972c43e" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:10:02.944621 24717 raft_consensus.cc:3055] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.945147 24717 raft_consensus.cc:740] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:02.946108 24717 consensus_queue.cc:260] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.947147 24717 raft_consensus.cc:3060] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.950858 24986 raft_consensus.cc:2468] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:10:02.952381 24757 leader_election.cc:304] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:10:02.953091 25046 raft_consensus.cc:2804] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.953505 25046 raft_consensus.cc:697] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:02.954421 24717 raft_consensus.cc:2468] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:10:02.954818 25046 consensus_queue.cc:237] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:02.962710 24539 catalog_manager.cc:5697] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 1 to 2, leader changed from bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.339936 24717 raft_consensus.cc:1275] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.341328 24927 consensus_queue.cc:1048] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.354733 24986 raft_consensus.cc:1275] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.356753 25046 consensus_queue.cc:1048] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.429672 24791 raft_consensus.cc:1275] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:03.430950 25028 consensus_queue.cc:1048] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.434122 24986 raft_consensus.cc:1275] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:03.435573 25038 consensus_queue.cc:1048] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:03.460966 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:03.671064 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.680529 24791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
mode: GRACEFUL
new_leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:10:03.681071 24791 raft_consensus.cc:606] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Received request to transfer leadership to TS bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:10:03.683713 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
mode: GRACEFUL
new_leader_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:10:03.684262 24717 raft_consensus.cc:606] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Received request to transfer leadership to TS bed07f5ad4144a3a9888449359ff9223
I20260709 13:10:03.685539 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:03.686036 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:03.686585 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.891492 25067 raft_consensus.cc:993] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: : Instructing follower bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:03.892081 25060 raft_consensus.cc:1081] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Signalling peer bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:03.893913 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:43936
I20260709 13:10:03.894604 24717 raft_consensus.cc:493] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.895061 24717 raft_consensus.cc:3060] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.905615 24717 raft_consensus.cc:515] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:03.908420 24717 leader_election.cc:290] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:10:03.909142 24983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:03.909520 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c4fceafd3f438e9c1f030c8cdb055d" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:10:03.909853 24983 raft_consensus.cc:3060] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.910323 24791 raft_consensus.cc:3055] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.910674 24791 raft_consensus.cc:740] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:03.911607 24791 consensus_queue.cc:260] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:03.912747 24791 raft_consensus.cc:3060] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.916723 24983 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 2.
I20260709 13:10:03.917971 24683 leader_election.cc:304] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:10:03.918785 24856 raft_consensus.cc:2804] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.918970 24791 raft_consensus.cc:2468] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 2.
I20260709 13:10:03.919202 24856 raft_consensus.cc:697] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:03.920359 24856 consensus_queue.cc:237] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:03.927119 24540 catalog_manager.cc:5697] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 1 to 2, leader changed from bed07f5ad4144a3a9888449359ff9223 (127.14.45.3) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.985150 25038 raft_consensus.cc:993] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: : Instructing follower bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:03.985652 24856 raft_consensus.cc:1081] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Signalling peer bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:03.987349 24790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:56036
I20260709 13:10:03.987848 24790 raft_consensus.cc:493] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.988103 24790 raft_consensus.cc:3060] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.993984 24790 raft_consensus.cc:515] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:03.995600 24790 leader_election.cc:290] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:10:03.996546 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:03.996912 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bbd82cb3084db3b112637f07bfe6e7" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:10:03.997414 24986 raft_consensus.cc:3060] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.997632 24717 raft_consensus.cc:3055] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.998092 24717 raft_consensus.cc:740] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:03.999091 24717 consensus_queue.cc:260] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:04.000578 24717 raft_consensus.cc:3060] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.005563 24986 raft_consensus.cc:2468] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:10:04.007000 24757 leader_election.cc:304] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:10:04.007910 25067 raft_consensus.cc:2804] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.008369 25067 raft_consensus.cc:697] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:04.008739 24717 raft_consensus.cc:2468] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:10:04.009431 25067 consensus_queue.cc:237] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:04.017201 24540 catalog_manager.cc:5697] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 1 to 2, leader changed from bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.400309 24790 raft_consensus.cc:1275] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.402053 24856 consensus_queue.cc:1048] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.403697 24717 raft_consensus.cc:1275] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.405182 25067 consensus_queue.cc:1048] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.416684 24986 raft_consensus.cc:1275] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.418325 24856 consensus_queue.cc:1048] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.430822 24985 raft_consensus.cc:1275] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.438916 25067 consensus_queue.cc:1048] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:04.461862 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:04.692667 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.700424 24790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
mode: GRACEFUL
new_leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:10:04.701272 24790 raft_consensus.cc:606] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Received request to transfer leadership to TS bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:10:04.704005 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
mode: GRACEFUL
new_leader_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:10:04.704418 24717 raft_consensus.cc:606] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Received request to transfer leadership to TS bed07f5ad4144a3a9888449359ff9223
I20260709 13:10:04.705680 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:04.706140 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:04.706640 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.851728 24856 raft_consensus.cc:993] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: : Instructing follower bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:04.852214 25038 raft_consensus.cc:1081] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Signalling peer bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:04.854123 24790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:56036
I20260709 13:10:04.854576 24790 raft_consensus.cc:493] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.854825 24790 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.860857 24790 raft_consensus.cc:515] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:04.862560 24790 leader_election.cc:290] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:10:04.863241 24985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:04.863494 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:10:04.863911 24985 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.864013 24717 raft_consensus.cc:3055] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:04.864405 24717 raft_consensus.cc:740] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:04.865267 24717 consensus_queue.cc:260] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:04.866598 24717 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.871889 24985 raft_consensus.cc:2468] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:10:04.873275 24757 leader_election.cc:304] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:10:04.873340 24717 raft_consensus.cc:2468] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 2.
I20260709 13:10:04.874187 25067 raft_consensus.cc:2804] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.874728 25067 raft_consensus.cc:697] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:04.875633 25067 consensus_queue.cc:237] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:04.884763 24541 catalog_manager.cc:5697] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 1 to 2, leader changed from bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.145177 25077 raft_consensus.cc:993] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: : Instructing follower bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:05.145712 25067 raft_consensus.cc:1081] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Signalling peer bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:05.147388 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:43936
I20260709 13:10:05.147903 24717 raft_consensus.cc:493] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.148205 24717 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.153539 24717 raft_consensus.cc:515] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.155504 24717 leader_election.cc:290] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:10:05.156029 24985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:05.156141 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:10:05.156860 24985 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.156975 24790 raft_consensus.cc:3055] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:05.157491 24790 raft_consensus.cc:740] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:05.158427 24790 consensus_queue.cc:260] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.159775 24790 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.164302 24985 raft_consensus.cc:2468] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 2.
I20260709 13:10:05.165560 24683 leader_election.cc:304] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bd8b1ab6ea684497bd734dd2aa1a1006; no voters: 
I20260709 13:10:05.166376 25038 raft_consensus.cc:2804] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:05.166648 24790 raft_consensus.cc:2468] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 2.
I20260709 13:10:05.166879 25038 raft_consensus.cc:697] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:05.167985 25038 consensus_queue.cc:237] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.175060 24541 catalog_manager.cc:5697] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 1 to 2, leader changed from bed07f5ad4144a3a9888449359ff9223 (127.14.45.3) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.351596 24985 raft_consensus.cc:1275] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.352861 25067 consensus_queue.cc:1048] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.363799 24717 raft_consensus.cc:1275] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.365401 25077 consensus_queue.cc:1048] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:05.462898 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:05.713235 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.721063 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
mode: GRACEFUL
new_leader_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:10:05.721783 24717 raft_consensus.cc:606] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Received request to transfer leadership to TS bed07f5ad4144a3a9888449359ff9223
I20260709 13:10:05.724680 24790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
mode: GRACEFUL
new_leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:10:05.725214 24790 raft_consensus.cc:606] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Received request to transfer leadership to TS bd8b1ab6ea684497bd734dd2aa1a1006
I20260709 13:10:05.726589 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:05.727257 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:05.727933 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.728487 24985 raft_consensus.cc:1275] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.729890 25038 consensus_queue.cc:1048] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.741499 24790 raft_consensus.cc:1275] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.743506 25095 consensus_queue.cc:1048] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:05.751672 25094 raft_consensus.cc:993] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: : Instructing follower bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:05.752161 25095 raft_consensus.cc:1081] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Signalling peer bed07f5ad4144a3a9888449359ff9223 to start an election
I20260709 13:10:05.753841 24790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0"
dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
 from {username='slave'} at 127.0.0.1:56036
I20260709 13:10:05.754431 24790 raft_consensus.cc:493] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.754801 24790 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.760515 24790 raft_consensus.cc:515] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.762290 24790 leader_election.cc:290] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 3 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675)
I20260709 13:10:05.763142 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:05.763885 24986 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.763862 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ad2439738a422da8589c93809ff9c0" candidate_uuid: "bed07f5ad4144a3a9888449359ff9223" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
I20260709 13:10:05.766997 24717 raft_consensus.cc:3055] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:05.767387 24717 raft_consensus.cc:740] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:05.768119 24717 consensus_queue.cc:260] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.769258 24717 raft_consensus.cc:3060] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.771363 25067 raft_consensus.cc:993] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: : Instructing follower bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:05.771960 25077 raft_consensus.cc:1081] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Signalling peer bd8b1ab6ea684497bd734dd2aa1a1006 to start an election
I20260709 13:10:05.773749 24716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45"
dest_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006"
 from {username='slave'} at 127.0.0.1:43936
I20260709 13:10:05.774374 24716 raft_consensus.cc:493] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.774726 24716 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.778124 24986 raft_consensus.cc:2468] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 3.
I20260709 13:10:05.779460 24757 leader_election.cc:304] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 023415e53632418788805b558a25eaaf, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:10:05.779474 24717 raft_consensus.cc:2468] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed07f5ad4144a3a9888449359ff9223 in term 3.
I20260709 13:10:05.780158 25067 raft_consensus.cc:2804] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:05.780588 25067 raft_consensus.cc:697] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 3 LEADER]: Becoming Leader. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:05.781342 25067 consensus_queue.cc:237] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.782788 24716 raft_consensus.cc:515] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.785689 24986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "023415e53632418788805b558a25eaaf"
I20260709 13:10:05.785915 24716 leader_election.cc:290] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 3 election: Requested vote from peers 023415e53632418788805b558a25eaaf (127.14.45.1:32783), bed07f5ad4144a3a9888449359ff9223 (127.14.45.3:42597)
I20260709 13:10:05.786108 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb08a9bfaad94e1f8d880be3bb057c45" candidate_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bed07f5ad4144a3a9888449359ff9223"
I20260709 13:10:05.786407 24986 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.786810 24790 raft_consensus.cc:3055] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:05.787217 24790 raft_consensus.cc:740] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bed07f5ad4144a3a9888449359ff9223, State: Running, Role: LEADER
I20260709 13:10:05.787971 24790 consensus_queue.cc:260] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.789021 24790 raft_consensus.cc:3060] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.788856 24541 catalog_manager.cc:5697] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 reported cstate change: term changed from 2 to 3, leader changed from bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2) to bed07f5ad4144a3a9888449359ff9223 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "bed07f5ad4144a3a9888449359ff9223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.793625 24986 raft_consensus.cc:2468] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 3.
I20260709 13:10:05.795535 24985 raft_consensus.cc:1240] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Rejecting Update request from peer bed07f5ad4144a3a9888449359ff9223 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:05.795850 24790 raft_consensus.cc:2468] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8b1ab6ea684497bd734dd2aa1a1006 in term 3.
I20260709 13:10:05.797577 24682 leader_election.cc:304] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd8b1ab6ea684497bd734dd2aa1a1006, bed07f5ad4144a3a9888449359ff9223; no voters: 
I20260709 13:10:05.798731 25095 raft_consensus.cc:2804] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:05.799281 25095 raft_consensus.cc:697] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 LEADER]: Becoming Leader. State: Replica: bd8b1ab6ea684497bd734dd2aa1a1006, State: Running, Role: LEADER
I20260709 13:10:05.800514 25095 consensus_queue.cc:237] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } }
I20260709 13:10:05.808241 24540 catalog_manager.cc:5697] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 reported cstate change: term changed from 2 to 3, leader changed from bed07f5ad4144a3a9888449359ff9223 (127.14.45.3) to bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.204197 24716 raft_consensus.cc:1275] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.205673 25067 consensus_queue.cc:1048] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8b1ab6ea684497bd734dd2aa1a1006" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.213392 24986 raft_consensus.cc:1275] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Refusing update from remote peer bed07f5ad4144a3a9888449359ff9223: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.215214 25097 consensus_queue.cc:1048] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.276645 24986 raft_consensus.cc:1275] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.278110 25095 consensus_queue.cc:1048] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "023415e53632418788805b558a25eaaf" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.287024 24790 raft_consensus.cc:1275] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Refusing update from remote peer bd8b1ab6ea684497bd734dd2aa1a1006: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.288767 25095 consensus_queue.cc:1048] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed07f5ad4144a3a9888449359ff9223" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:06.463805 24589 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:06.737424 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.771260 14516 tablet_server.cc:179] TabletServer@127.14.45.1:32783 shutting down...
I20260709 13:10:06.801653 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.802860 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.803766 14516 raft_consensus.cc:2243] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.804256 14516 raft_consensus.cc:2272] T 4c486139d9604f188afcf0e39972c43e P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.806553 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.807134 14516 raft_consensus.cc:2243] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.807698 14516 raft_consensus.cc:2272] T 530b1eb6da54447ead123d0f8e1568b9 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.810422 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.811110 14516 raft_consensus.cc:2243] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.811558 14516 raft_consensus.cc:2272] T 46ad2439738a422da8589c93809ff9c0 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.814539 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.815323 14516 raft_consensus.cc:2243] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.815845 14516 raft_consensus.cc:2272] T e9bbd82cb3084db3b112637f07bfe6e7 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.819154 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.819717 14516 raft_consensus.cc:2243] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.820250 14516 raft_consensus.cc:2272] T 57c4fceafd3f438e9c1f030c8cdb055d P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.822467 24757 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
I20260709 13:10:06.823163 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.823975 14516 raft_consensus.cc:2243] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.824524 14516 raft_consensus.cc:2272] T 6b68c3cfcd6c45e5b77b07c39025395b P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.826036 24757 consensus_peers.cc:597] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.827749 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.828722 14516 raft_consensus.cc:2243] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.829295 14516 raft_consensus.cc:2272] T d3a07e68dc2e48f5b7b5a3c443a1394a P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.830354 24683 consensus_peers.cc:597] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.831755 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.832360 14516 raft_consensus.cc:2243] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.832791 14516 raft_consensus.cc:2272] T eb08a9bfaad94e1f8d880be3bb057c45 P 023415e53632418788805b558a25eaaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.835351 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.835923 14516 raft_consensus.cc:2243] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.836364 14516 raft_consensus.cc:2272] T 37f17ee7e91c4908a9d1428edaa8c110 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.838514 14516 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.839010 14516 raft_consensus.cc:2243] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.839478 14516 raft_consensus.cc:2272] T 5acc350e72f943f1ae6af73fc73eb048 P 023415e53632418788805b558a25eaaf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.844412 24683 consensus_peers.cc:597] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.873167 14516 tablet_server.cc:196] TabletServer@127.14.45.1:32783 shutdown complete.
W20260709 13:10:06.876791 24683 consensus_peers.cc:597] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.896039 24683 consensus_peers.cc:597] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.906013 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
I20260709 13:10:06.934904 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.935614 14516 tablet_replica.cc:333] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.936507 14516 raft_consensus.cc:2243] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.937314 14516 raft_consensus.cc:2272] T d3a07e68dc2e48f5b7b5a3c443a1394a P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.939567 14516 tablet_replica.cc:333] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.940141 14516 raft_consensus.cc:2243] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.940948 14516 raft_consensus.cc:2272] T eb08a9bfaad94e1f8d880be3bb057c45 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.944271 14516 tablet_replica.cc:333] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.944841 14516 raft_consensus.cc:2243] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.945307 14516 raft_consensus.cc:2272] T 37f17ee7e91c4908a9d1428edaa8c110 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.947408 14516 tablet_replica.cc:333] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.947929 14516 raft_consensus.cc:2243] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.948709 14516 raft_consensus.cc:2272] T 5acc350e72f943f1ae6af73fc73eb048 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.950973 14516 tablet_replica.cc:333] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.951525 14516 raft_consensus.cc:2243] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.951942 14516 raft_consensus.cc:2272] T e9bbd82cb3084db3b112637f07bfe6e7 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.953939 14516 tablet_replica.cc:333] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.954502 14516 raft_consensus.cc:2243] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.954934 14516 raft_consensus.cc:2272] T 46ad2439738a422da8589c93809ff9c0 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.957229 14516 tablet_replica.cc:333] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.957729 14516 raft_consensus.cc:2243] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.958195 14516 raft_consensus.cc:2272] T 4c486139d9604f188afcf0e39972c43e P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.960125 14516 tablet_replica.cc:333] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.961102 14516 raft_consensus.cc:2243] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.961882 14516 raft_consensus.cc:2272] T 530b1eb6da54447ead123d0f8e1568b9 P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.964519 14516 tablet_replica.cc:333] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.965034 14516 raft_consensus.cc:2243] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.965731 14516 raft_consensus.cc:2272] T 57c4fceafd3f438e9c1f030c8cdb055d P bd8b1ab6ea684497bd734dd2aa1a1006 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.967818 14516 tablet_replica.cc:333] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006: stopping tablet replica
I20260709 13:10:06.968304 14516 raft_consensus.cc:2243] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.968717 14516 raft_consensus.cc:2272] T 6b68c3cfcd6c45e5b77b07c39025395b P bd8b1ab6ea684497bd734dd2aa1a1006 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.002285 24757 consensus_peers.cc:597] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.003718 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
W20260709 13:10:07.014421 24757 consensus_peers.cc:597] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 -> Peer bd8b1ab6ea684497bd734dd2aa1a1006 (127.14.45.2:46675): Couldn't send request to peer bd8b1ab6ea684497bd734dd2aa1a1006. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:46675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.030561 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
I20260709 13:10:07.058434 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:07.059176 14516 tablet_replica.cc:333] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.060376 14516 raft_consensus.cc:2243] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.060992 14516 raft_consensus.cc:2272] T d3a07e68dc2e48f5b7b5a3c443a1394a P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.063177 14516 tablet_replica.cc:333] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.063700 14516 raft_consensus.cc:2243] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.064077 14516 raft_consensus.cc:2272] T 530b1eb6da54447ead123d0f8e1568b9 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.066111 14516 tablet_replica.cc:333] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.066627 14516 raft_consensus.cc:2243] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.067325 14516 raft_consensus.cc:2272] T 46ad2439738a422da8589c93809ff9c0 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.070070 14516 tablet_replica.cc:333] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.070626 14516 raft_consensus.cc:2243] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.071313 14516 raft_consensus.cc:2272] T e9bbd82cb3084db3b112637f07bfe6e7 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.073330 14516 tablet_replica.cc:333] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.074190 14516 raft_consensus.cc:2243] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.074919 14516 raft_consensus.cc:2272] T 6b68c3cfcd6c45e5b77b07c39025395b P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.076869 14516 tablet_replica.cc:333] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.077399 14516 raft_consensus.cc:2243] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.077839 14516 raft_consensus.cc:2272] T 57c4fceafd3f438e9c1f030c8cdb055d P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.079893 14516 tablet_replica.cc:333] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.080361 14516 raft_consensus.cc:2243] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.081058 14516 raft_consensus.cc:2272] T 4c486139d9604f188afcf0e39972c43e P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.083240 14516 tablet_replica.cc:333] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.083706 14516 raft_consensus.cc:2243] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.084118 14516 raft_consensus.cc:2272] T 5acc350e72f943f1ae6af73fc73eb048 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.086692 14516 tablet_replica.cc:333] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.087430 14516 raft_consensus.cc:2243] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.087967 14516 raft_consensus.cc:2272] T eb08a9bfaad94e1f8d880be3bb057c45 P bed07f5ad4144a3a9888449359ff9223 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.090546 24757 consensus_peers.cc:597] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 -> Peer 023415e53632418788805b558a25eaaf (127.14.45.1:32783): Couldn't send request to peer 023415e53632418788805b558a25eaaf. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.090932 14516 tablet_replica.cc:333] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223: stopping tablet replica
I20260709 13:10:07.091533 14516 raft_consensus.cc:2243] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.092377 14516 raft_consensus.cc:2272] T 37f17ee7e91c4908a9d1428edaa8c110 P bed07f5ad4144a3a9888449359ff9223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.127132 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
I20260709 13:10:07.152220 14516 master.cc:562] Master@127.14.45.62:40661 shutting down...
I20260709 13:10:07.173942 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.174620 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.175010 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 317146c988a840aa980a5d84b0f57e77: stopping tablet replica
I20260709 13:10:07.196395 14516 master.cc:584] Master@127.14.45.62:40661 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12925 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:07.241140 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:37143
I20260709 13:10:07.242367 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.248926 25109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.248987 25110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.249589 25112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.249662 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:07.250976 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.251159 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.251374 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602607251337 us; error 0 us; skew 500 ppm
I20260709 13:10:07.251945 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.254464 14516 webserver.cc:533] Webserver started at http://127.14.45.62:36301/ using document root <none> and password file <none>
I20260709 13:10:07.254997 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.255192 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.255483 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.256680 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "4d296787fcd44d44b63ea362a5923880"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.261252 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:07.264716 25117 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.265421 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:07.265782 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "4d296787fcd44d44b63ea362a5923880"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.266115 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.276540 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.277783 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.316721 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:37143
I20260709 13:10:07.316815 25168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:37143 every 8 connection(s)
I20260709 13:10:07.321010 25169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.333763 25169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880: Bootstrap starting.
I20260709 13:10:07.339072 25169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.343748 25169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880: No bootstrap required, opened a new log
I20260709 13:10:07.346200 25169 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d296787fcd44d44b63ea362a5923880" member_type: VOTER }
I20260709 13:10:07.346607 25169 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.346805 25169 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d296787fcd44d44b63ea362a5923880, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.347410 25169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d296787fcd44d44b63ea362a5923880" member_type: VOTER }
I20260709 13:10:07.347882 25169 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:07.348095 25169 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:07.348325 25169 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.353245 25169 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d296787fcd44d44b63ea362a5923880" member_type: VOTER }
I20260709 13:10:07.353801 25169 leader_election.cc:304] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d296787fcd44d44b63ea362a5923880; no voters: 
I20260709 13:10:07.354928 25169 leader_election.cc:290] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:07.355343 25172 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.356989 25172 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 1 LEADER]: Becoming Leader. State: Replica: 4d296787fcd44d44b63ea362a5923880, State: Running, Role: LEADER
I20260709 13:10:07.357729 25172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d296787fcd44d44b63ea362a5923880" member_type: VOTER }
I20260709 13:10:07.358284 25169 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:07.362767 25173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d296787fcd44d44b63ea362a5923880" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d296787fcd44d44b63ea362a5923880" member_type: VOTER } }
I20260709 13:10:07.362767 25174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d296787fcd44d44b63ea362a5923880. Latest consensus state: current_term: 1 leader_uuid: "4d296787fcd44d44b63ea362a5923880" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d296787fcd44d44b63ea362a5923880" member_type: VOTER } }
I20260709 13:10:07.363673 25173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:07.363845 25174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:07.367345 25179 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:07.376715 25179 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:07.377897 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:07.386404 25179 catalog_manager.cc:1383] Generated new cluster ID: 145ef86e1a194b588b7d897f4f4ee189
I20260709 13:10:07.386687 25179 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:07.409593 25179 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:07.411178 25179 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:07.423285 25179 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880: Generated new TSK 0
I20260709 13:10:07.424002 25179 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:07.444758 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.451706 25190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.452467 25191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.455292 14516 server_base.cc:1061] running on GCE node
W20260709 13:10:07.455490 25193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.456600 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.456820 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.457015 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602607456997 us; error 0 us; skew 500 ppm
I20260709 13:10:07.457561 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.460209 14516 webserver.cc:533] Webserver started at http://127.14.45.1:33355/ using document root <none> and password file <none>
I20260709 13:10:07.460764 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.460939 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.461181 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.462512 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "9044d84096d14885b75d43103163e4ef"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.467433 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:10:07.471320 25198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.472280 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:07.472579 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "9044d84096d14885b75d43103163e4ef"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.472842 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.487376 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.488683 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.490303 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.492888 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.493100 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.493454 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.493631 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.540846 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:40217
I20260709 13:10:07.540999 25260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:40217 every 8 connection(s)
I20260709 13:10:07.546789 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.554445 25265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.556881 25266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.558316 14516 server_base.cc:1061] running on GCE node
W20260709 13:10:07.559290 25268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.560700 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.561012 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.561244 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602607561223 us; error 0 us; skew 500 ppm
I20260709 13:10:07.561631 25261 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37143
I20260709 13:10:07.562072 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.562130 25261 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:07.563362 25261 heartbeater.cc:507] Master 127.14.45.62:37143 requested a full tablet report, sending...
I20260709 13:10:07.565383 14516 webserver.cc:533] Webserver started at http://127.14.45.2:36559/ using document root <none> and password file <none>
I20260709 13:10:07.565969 25134 ts_manager.cc:194] Registered new tserver with Master: 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217)
I20260709 13:10:07.566226 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.566546 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.566882 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.568588 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "eb93945400f746d98db9cba714f5ca62"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.568833 25134 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59266
I20260709 13:10:07.573872 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:10:07.577695 25273 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.578636 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:07.579002 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "eb93945400f746d98db9cba714f5ca62"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.579324 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.622378 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.623883 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.625651 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.628317 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.628577 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.628855 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.629055 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.672281 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:37137
I20260709 13:10:07.672418 25335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:37137 every 8 connection(s)
I20260709 13:10:07.677662 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.686164 25339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.686288 25340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.693493 25336 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37143
I20260709 13:10:07.694089 25336 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:07.695106 25336 heartbeater.cc:507] Master 127.14.45.62:37143 requested a full tablet report, sending...
I20260709 13:10:07.695290 14516 server_base.cc:1061] running on GCE node
W20260709 13:10:07.695585 25342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.696884 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.697187 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.697417 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602607697394 us; error 0 us; skew 500 ppm
I20260709 13:10:07.697705 25134 ts_manager.cc:194] Registered new tserver with Master: eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137)
I20260709 13:10:07.698231 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.699951 25134 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59270
I20260709 13:10:07.701905 14516 webserver.cc:533] Webserver started at http://127.14.45.3:42515/ using document root <none> and password file <none>
I20260709 13:10:07.702661 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.702901 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.703121 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.704241 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "11d786e8d64740cf9ca346ba94316989"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.708801 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:07.712625 25347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.713714 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:07.714129 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "11d786e8d64740cf9ca346ba94316989"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-lfdf"
I20260709 13:10:07.714497 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.760859 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.762173 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.763693 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.766012 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.766194 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.766381 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.766503 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.810866 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:41457
I20260709 13:10:07.811049 25409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:41457 every 8 connection(s)
I20260709 13:10:07.826200 25410 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37143
I20260709 13:10:07.826685 25410 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:07.827504 25410 heartbeater.cc:507] Master 127.14.45.62:37143 requested a full tablet report, sending...
I20260709 13:10:07.829684 25134 ts_manager.cc:194] Registered new tserver with Master: 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:07.830265 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01615465s
I20260709 13:10:07.831581 25134 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59282
I20260709 13:10:07.857012 25134 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59290:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:07.859217 25134 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:07.912055 25301 tablet_service.cc:1511] Processing CreateTablet for tablet 27414958a6454f7fa19679122d59adfa (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1f76d9929a1e4631bfaf602aa973231f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:07.912335 25300 tablet_service.cc:1511] Processing CreateTablet for tablet 32c6812830684e3099cab3d5e3f3b153 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1f76d9929a1e4631bfaf602aa973231f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:07.913573 25301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27414958a6454f7fa19679122d59adfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.914273 25300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c6812830684e3099cab3d5e3f3b153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.918859 25225 tablet_service.cc:1511] Processing CreateTablet for tablet 32c6812830684e3099cab3d5e3f3b153 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1f76d9929a1e4631bfaf602aa973231f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:07.920213 25375 tablet_service.cc:1511] Processing CreateTablet for tablet 27414958a6454f7fa19679122d59adfa (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1f76d9929a1e4631bfaf602aa973231f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:07.920746 25226 tablet_service.cc:1511] Processing CreateTablet for tablet 27414958a6454f7fa19679122d59adfa (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1f76d9929a1e4631bfaf602aa973231f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:07.921025 25374 tablet_service.cc:1511] Processing CreateTablet for tablet 32c6812830684e3099cab3d5e3f3b153 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1f76d9929a1e4631bfaf602aa973231f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:07.921646 25375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27414958a6454f7fa19679122d59adfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.920284 25225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c6812830684e3099cab3d5e3f3b153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.922497 25374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c6812830684e3099cab3d5e3f3b153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.925462 25226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27414958a6454f7fa19679122d59adfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.948719 25426 tablet_bootstrap.cc:492] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: Bootstrap starting.
I20260709 13:10:07.956066 25425 tablet_bootstrap.cc:492] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62: Bootstrap starting.
I20260709 13:10:07.959069 25426 tablet_bootstrap.cc:654] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.962684 25427 tablet_bootstrap.cc:492] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef: Bootstrap starting.
I20260709 13:10:07.964807 25425 tablet_bootstrap.cc:654] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.965660 25426 tablet_bootstrap.cc:492] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: No bootstrap required, opened a new log
I20260709 13:10:07.966239 25426 ts_tablet_manager.cc:1403] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:10:07.969580 25426 raft_consensus.cc:359] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:07.970515 25426 raft_consensus.cc:385] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.970932 25426 raft_consensus.cc:740] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.970642 25427 tablet_bootstrap.cc:654] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.971796 25426 consensus_queue.cc:260] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:07.973366 25425 tablet_bootstrap.cc:492] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62: No bootstrap required, opened a new log
I20260709 13:10:07.974027 25425 ts_tablet_manager.cc:1403] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:10:07.980075 25426 ts_tablet_manager.cc:1434] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.006s
I20260709 13:10:07.979897 25425 raft_consensus.cc:359] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:07.980841 25425 raft_consensus.cc:385] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.981357 25410 heartbeater.cc:499] Master 127.14.45.62:37143 was elected leader, sending a full tablet report...
I20260709 13:10:07.981640 25426 tablet_bootstrap.cc:492] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989: Bootstrap starting.
I20260709 13:10:07.984244 25427 tablet_bootstrap.cc:492] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef: No bootstrap required, opened a new log
I20260709 13:10:07.984673 25425 raft_consensus.cc:740] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.984827 25427 ts_tablet_manager.cc:1403] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:10:07.985659 25425 consensus_queue.cc:260] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:07.988442 25336 heartbeater.cc:499] Master 127.14.45.62:37143 was elected leader, sending a full tablet report...
I20260709 13:10:07.988574 25427 raft_consensus.cc:359] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:07.989480 25427 raft_consensus.cc:385] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.989863 25427 raft_consensus.cc:740] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.990832 25425 ts_tablet_manager.cc:1434] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:07.990882 25427 consensus_queue.cc:260] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:07.992198 25425 tablet_bootstrap.cc:492] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62: Bootstrap starting.
I20260709 13:10:07.999655 25425 tablet_bootstrap.cc:654] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.004124 25426 tablet_bootstrap.cc:654] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.009670 25261 heartbeater.cc:499] Master 127.14.45.62:37143 was elected leader, sending a full tablet report...
I20260709 13:10:08.010494 25427 ts_tablet_manager.cc:1434] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef: Time spent starting tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:10:08.012261 25427 tablet_bootstrap.cc:492] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef: Bootstrap starting.
I20260709 13:10:08.012673 25425 tablet_bootstrap.cc:492] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62: No bootstrap required, opened a new log
I20260709 13:10:08.013355 25425 ts_tablet_manager.cc:1403] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:10:08.017016 25425 raft_consensus.cc:359] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.017958 25425 raft_consensus.cc:385] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.017990 25426 tablet_bootstrap.cc:492] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989: No bootstrap required, opened a new log
I20260709 13:10:08.018420 25425 raft_consensus.cc:740] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.018858 25426 ts_tablet_manager.cc:1403] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.010s
I20260709 13:10:08.019467 25425 consensus_queue.cc:260] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.020354 25427 tablet_bootstrap.cc:654] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.022118 25425 ts_tablet_manager.cc:1434] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:08.022558 25426 raft_consensus.cc:359] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.023455 25426 raft_consensus.cc:385] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.023923 25426 raft_consensus.cc:740] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.025230 25426 consensus_queue.cc:260] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.032040 25426 ts_tablet_manager.cc:1434] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:08.032474 25427 tablet_bootstrap.cc:492] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef: No bootstrap required, opened a new log
I20260709 13:10:08.033149 25427 ts_tablet_manager.cc:1403] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:10:08.036362 25427 raft_consensus.cc:359] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.037138 25427 raft_consensus.cc:385] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.037467 25427 raft_consensus.cc:740] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.038285 25427 consensus_queue.cc:260] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.040445 25427 ts_tablet_manager.cc:1434] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:08.180570 25430 raft_consensus.cc:493] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.181275 25430 raft_consensus.cc:515] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.184023 25430 leader_election.cc:290] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137)
I20260709 13:10:08.194900 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27414958a6454f7fa19679122d59adfa" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9044d84096d14885b75d43103163e4ef" is_pre_election: true
I20260709 13:10:08.195741 25236 raft_consensus.cc:2468] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 0.
I20260709 13:10:08.196278 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27414958a6454f7fa19679122d59adfa" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb93945400f746d98db9cba714f5ca62" is_pre_election: true
I20260709 13:10:08.196933 25349 leader_election.cc:304] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d786e8d64740cf9ca346ba94316989, 9044d84096d14885b75d43103163e4ef; no voters: 
I20260709 13:10:08.197178 25311 raft_consensus.cc:2468] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 0.
I20260709 13:10:08.198058 25430 raft_consensus.cc:2804] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.198464 25430 raft_consensus.cc:493] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.198863 25430 raft_consensus.cc:3060] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.204653 25430 raft_consensus.cc:515] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.206457 25430 leader_election.cc:290] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 election: Requested vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137)
I20260709 13:10:08.207325 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27414958a6454f7fa19679122d59adfa" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9044d84096d14885b75d43103163e4ef"
I20260709 13:10:08.207634 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27414958a6454f7fa19679122d59adfa" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb93945400f746d98db9cba714f5ca62"
I20260709 13:10:08.207934 25236 raft_consensus.cc:3060] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.208338 25311 raft_consensus.cc:3060] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.213402 25236 raft_consensus.cc:2468] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 1.
I20260709 13:10:08.214207 25311 raft_consensus.cc:2468] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 1.
I20260709 13:10:08.214781 25349 leader_election.cc:304] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d786e8d64740cf9ca346ba94316989, 9044d84096d14885b75d43103163e4ef; no voters: 
I20260709 13:10:08.215698 25430 raft_consensus.cc:2804] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.217115 25430 raft_consensus.cc:697] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Becoming Leader. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Running, Role: LEADER
I20260709 13:10:08.218039 25430 consensus_queue.cc:237] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.226269 25132 catalog_manager.cc:5697] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d786e8d64740cf9ca346ba94316989 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "11d786e8d64740cf9ca346ba94316989" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.254943 25430 raft_consensus.cc:493] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.255545 25430 raft_consensus.cc:515] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.257320 25430 leader_election.cc:290] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137)
I20260709 13:10:08.258266 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c6812830684e3099cab3d5e3f3b153" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9044d84096d14885b75d43103163e4ef" is_pre_election: true
I20260709 13:10:08.258419 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c6812830684e3099cab3d5e3f3b153" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb93945400f746d98db9cba714f5ca62" is_pre_election: true
I20260709 13:10:08.258949 25236 raft_consensus.cc:2468] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 0.
I20260709 13:10:08.259075 25311 raft_consensus.cc:2468] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 0.
I20260709 13:10:08.259961 25349 leader_election.cc:304] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d786e8d64740cf9ca346ba94316989, 9044d84096d14885b75d43103163e4ef; no voters: 
I20260709 13:10:08.261201 25430 raft_consensus.cc:2804] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.261894 25430 raft_consensus.cc:493] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.262498 25430 raft_consensus.cc:3060] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.268573 25430 raft_consensus.cc:515] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.270329 25430 leader_election.cc:290] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 election: Requested vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137)
I20260709 13:10:08.271166 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c6812830684e3099cab3d5e3f3b153" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9044d84096d14885b75d43103163e4ef"
I20260709 13:10:08.271302 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c6812830684e3099cab3d5e3f3b153" candidate_uuid: "11d786e8d64740cf9ca346ba94316989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb93945400f746d98db9cba714f5ca62"
I20260709 13:10:08.271783 25236 raft_consensus.cc:3060] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.271970 25311 raft_consensus.cc:3060] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.277034 25236 raft_consensus.cc:2468] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 1.
I20260709 13:10:08.277163 25311 raft_consensus.cc:2468] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d786e8d64740cf9ca346ba94316989 in term 1.
I20260709 13:10:08.278223 25349 leader_election.cc:304] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d786e8d64740cf9ca346ba94316989, 9044d84096d14885b75d43103163e4ef; no voters: 
I20260709 13:10:08.278987 25430 raft_consensus.cc:2804] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.279460 25430 raft_consensus.cc:697] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Becoming Leader. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Running, Role: LEADER
I20260709 13:10:08.280256 25430 consensus_queue.cc:237] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.287046 25132 catalog_manager.cc:5697] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d786e8d64740cf9ca346ba94316989 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "11d786e8d64740cf9ca346ba94316989" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.327876 25132 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59306:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:08.329967 25132 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:08.352795 25226 tablet_service.cc:1511] Processing CreateTablet for tablet 877a35a0d987470dac698fa7852649c7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=446a1379683143f981fd58594f3d2544]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:08.354322 25226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877a35a0d987470dac698fa7852649c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.354115 25300 tablet_service.cc:1511] Processing CreateTablet for tablet 877a35a0d987470dac698fa7852649c7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=446a1379683143f981fd58594f3d2544]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:08.355566 25300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877a35a0d987470dac698fa7852649c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.355494 25374 tablet_service.cc:1511] Processing CreateTablet for tablet 877a35a0d987470dac698fa7852649c7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=446a1379683143f981fd58594f3d2544]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:08.356874 25374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877a35a0d987470dac698fa7852649c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.357285 25225 tablet_service.cc:1511] Processing CreateTablet for tablet 099357c913f5416698de1c604bc4306c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=446a1379683143f981fd58594f3d2544]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:08.358696 25225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099357c913f5416698de1c604bc4306c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.361275 25301 tablet_service.cc:1511] Processing CreateTablet for tablet 099357c913f5416698de1c604bc4306c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=446a1379683143f981fd58594f3d2544]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:08.362026 25375 tablet_service.cc:1511] Processing CreateTablet for tablet 099357c913f5416698de1c604bc4306c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=446a1379683143f981fd58594f3d2544]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:08.362845 25301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099357c913f5416698de1c604bc4306c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.363413 25375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099357c913f5416698de1c604bc4306c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:08.370910 25182 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:08.376482 25426 tablet_bootstrap.cc:492] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989: Bootstrap starting.
I20260709 13:10:08.382206 25425 tablet_bootstrap.cc:492] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62: Bootstrap starting.
I20260709 13:10:08.386732 25426 tablet_bootstrap.cc:654] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.389016 25425 tablet_bootstrap.cc:654] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.396828 25426 tablet_bootstrap.cc:492] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989: No bootstrap required, opened a new log
I20260709 13:10:08.397501 25426 ts_tablet_manager.cc:1403] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 13:10:08.398715 25427 tablet_bootstrap.cc:492] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: Bootstrap starting.
I20260709 13:10:08.401175 25426 raft_consensus.cc:359] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.402150 25426 raft_consensus.cc:385] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.402562 25426 raft_consensus.cc:740] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.403704 25426 consensus_queue.cc:260] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.406642 25426 ts_tablet_manager.cc:1434] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:08.407456 25427 tablet_bootstrap.cc:654] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.409899 25426 tablet_bootstrap.cc:492] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989: Bootstrap starting.
I20260709 13:10:08.411151 25425 tablet_bootstrap.cc:492] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62: No bootstrap required, opened a new log
I20260709 13:10:08.411799 25425 ts_tablet_manager.cc:1403] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.014s
I20260709 13:10:08.418082 25426 tablet_bootstrap.cc:654] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.417884 25425 raft_consensus.cc:359] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.418892 25425 raft_consensus.cc:385] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.419335 25425 raft_consensus.cc:740] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.420301 25425 consensus_queue.cc:260] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.421341 25427 tablet_bootstrap.cc:492] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: No bootstrap required, opened a new log
I20260709 13:10:08.421989 25427 ts_tablet_manager.cc:1403] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.010s
I20260709 13:10:08.425302 25425 ts_tablet_manager.cc:1434] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:10:08.425840 25426 tablet_bootstrap.cc:492] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989: No bootstrap required, opened a new log
I20260709 13:10:08.425568 25427 raft_consensus.cc:359] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.426496 25426 ts_tablet_manager.cc:1403] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 13:10:08.426658 25425 tablet_bootstrap.cc:492] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: Bootstrap starting.
I20260709 13:10:08.426630 25427 raft_consensus.cc:385] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.427362 25427 raft_consensus.cc:740] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.428416 25427 consensus_queue.cc:260] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.429867 25426 raft_consensus.cc:359] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.432111 25426 raft_consensus.cc:385] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.432440 25426 raft_consensus.cc:740] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.433248 25426 consensus_queue.cc:260] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.436159 25425 tablet_bootstrap.cc:654] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.438136 25426 ts_tablet_manager.cc:1434] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:08.439482 25427 ts_tablet_manager.cc:1434] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:10:08.440979 25427 tablet_bootstrap.cc:492] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef: Bootstrap starting.
I20260709 13:10:08.442977 25425 tablet_bootstrap.cc:492] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: No bootstrap required, opened a new log
I20260709 13:10:08.443565 25425 ts_tablet_manager.cc:1403] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:10:08.446993 25425 raft_consensus.cc:359] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.447795 25425 raft_consensus.cc:385] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.448135 25425 raft_consensus.cc:740] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.449088 25425 consensus_queue.cc:260] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.450649 25427 tablet_bootstrap.cc:654] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.451786 25425 ts_tablet_manager.cc:1434] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:08.455721 25427 tablet_bootstrap.cc:492] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef: No bootstrap required, opened a new log
I20260709 13:10:08.456305 25427 ts_tablet_manager.cc:1403] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:10:08.458705 25427 raft_consensus.cc:359] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.459271 25427 raft_consensus.cc:385] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.459520 25427 raft_consensus.cc:740] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.460276 25427 consensus_queue.cc:260] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.462330 25427 ts_tablet_manager.cc:1434] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:08.527355 25432 raft_consensus.cc:493] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.528079 25432 raft_consensus.cc:515] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.530562 25432 leader_election.cc:290] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:08.541141 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "eb93945400f746d98db9cba714f5ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9044d84096d14885b75d43103163e4ef" is_pre_election: true
I20260709 13:10:08.541956 25236 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb93945400f746d98db9cba714f5ca62 in term 0.
I20260709 13:10:08.542816 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "eb93945400f746d98db9cba714f5ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d786e8d64740cf9ca346ba94316989" is_pre_election: true
I20260709 13:10:08.542989 25275 leader_election.cc:304] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9044d84096d14885b75d43103163e4ef, eb93945400f746d98db9cba714f5ca62; no voters: 
I20260709 13:10:08.543455 25385 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb93945400f746d98db9cba714f5ca62 in term 0.
I20260709 13:10:08.543831 25432 raft_consensus.cc:2804] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.544157 25432 raft_consensus.cc:493] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.544500 25432 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.550688 25432 raft_consensus.cc:515] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.552486 25432 leader_election.cc:290] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [CANDIDATE]: Term 1 election: Requested vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:08.553277 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "eb93945400f746d98db9cba714f5ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9044d84096d14885b75d43103163e4ef"
I20260709 13:10:08.553550 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "eb93945400f746d98db9cba714f5ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d786e8d64740cf9ca346ba94316989"
I20260709 13:10:08.553929 25236 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.554275 25385 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.559459 25236 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb93945400f746d98db9cba714f5ca62 in term 1.
I20260709 13:10:08.560158 25385 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb93945400f746d98db9cba714f5ca62 in term 1.
I20260709 13:10:08.560760 25275 leader_election.cc:304] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9044d84096d14885b75d43103163e4ef, eb93945400f746d98db9cba714f5ca62; no voters: 
I20260709 13:10:08.561892 25432 raft_consensus.cc:2804] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.562804 25432 raft_consensus.cc:697] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 LEADER]: Becoming Leader. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Running, Role: LEADER
I20260709 13:10:08.563650 25432 consensus_queue.cc:237] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.571408 25132 catalog_manager.cc:5697] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb93945400f746d98db9cba714f5ca62 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "eb93945400f746d98db9cba714f5ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.663669 25430 consensus_queue.cc:1048] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.677331 25438 consensus_queue.cc:1048] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.769534 25438 consensus_queue.cc:1048] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.775666 25433 raft_consensus.cc:493] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.776245 25433 raft_consensus.cc:515] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.782117 25433 leader_election.cc:290] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:08.794582 25438 consensus_queue.cc:1048] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.808575 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877a35a0d987470dac698fa7852649c7" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d786e8d64740cf9ca346ba94316989" is_pre_election: true
I20260709 13:10:08.809518 25385 raft_consensus.cc:2468] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 0.
I20260709 13:10:08.811430 25200 leader_election.cc:304] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d786e8d64740cf9ca346ba94316989, 9044d84096d14885b75d43103163e4ef; no voters: 
I20260709 13:10:08.812410 25433 raft_consensus.cc:2804] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.812808 25433 raft_consensus.cc:493] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.813138 25433 raft_consensus.cc:3060] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.816262 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877a35a0d987470dac698fa7852649c7" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb93945400f746d98db9cba714f5ca62" is_pre_election: true
I20260709 13:10:08.817144 25311 raft_consensus.cc:2468] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 0.
I20260709 13:10:08.821557 25433 raft_consensus.cc:515] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.824075 25433 leader_election.cc:290] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 1 election: Requested vote from peers eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:08.824602 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877a35a0d987470dac698fa7852649c7" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb93945400f746d98db9cba714f5ca62"
I20260709 13:10:08.824661 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877a35a0d987470dac698fa7852649c7" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d786e8d64740cf9ca346ba94316989"
I20260709 13:10:08.825182 25311 raft_consensus.cc:3060] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.825657 25385 raft_consensus.cc:3060] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.830528 25311 raft_consensus.cc:2468] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 1.
I20260709 13:10:08.830770 25385 raft_consensus.cc:2468] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 1.
I20260709 13:10:08.831835 25199 leader_election.cc:304] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9044d84096d14885b75d43103163e4ef, eb93945400f746d98db9cba714f5ca62; no voters: 
I20260709 13:10:08.832681 25433 raft_consensus.cc:2804] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.833587 25433 raft_consensus.cc:697] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 1 LEADER]: Becoming Leader. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Running, Role: LEADER
I20260709 13:10:08.834446 25433 consensus_queue.cc:237] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:08.841135 25132 catalog_manager.cc:5697] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9044d84096d14885b75d43103163e4ef (127.14.45.1). New cstate: current_term: 1 leader_uuid: "9044d84096d14885b75d43103163e4ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.883396 25385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27414958a6454f7fa19679122d59adfa"
dest_uuid: "11d786e8d64740cf9ca346ba94316989"
mode: GRACEFUL
new_leader_uuid: "9044d84096d14885b75d43103163e4ef"
 from {username='slave'} at 127.0.0.1:57872
I20260709 13:10:08.883955 25385 raft_consensus.cc:606] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Received request to transfer leadership to TS 9044d84096d14885b75d43103163e4ef
I20260709 13:10:08.903648 25311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099357c913f5416698de1c604bc4306c"
dest_uuid: "eb93945400f746d98db9cba714f5ca62"
mode: GRACEFUL
new_leader_uuid: "9044d84096d14885b75d43103163e4ef"
 from {username='slave'} at 127.0.0.1:46560
I20260709 13:10:08.904139 25311 raft_consensus.cc:606] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 LEADER]: Received request to transfer leadership to TS 9044d84096d14885b75d43103163e4ef
I20260709 13:10:08.986323 25432 consensus_queue.cc:1048] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.998445 25432 consensus_queue.cc:1048] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.006278 25455 raft_consensus.cc:993] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: : Instructing follower 9044d84096d14885b75d43103163e4ef to start an election
I20260709 13:10:09.006745 25432 raft_consensus.cc:1081] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 LEADER]: Signalling peer 9044d84096d14885b75d43103163e4ef to start an election
I20260709 13:10:09.008325 25236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "099357c913f5416698de1c604bc4306c"
dest_uuid: "9044d84096d14885b75d43103163e4ef"
 from {username='slave'} at 127.0.0.1:38842
I20260709 13:10:09.008842 25236 raft_consensus.cc:493] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.009166 25236 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.014901 25236 raft_consensus.cc:515] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.017889 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb93945400f746d98db9cba714f5ca62"
I20260709 13:10:09.018256 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d786e8d64740cf9ca346ba94316989"
I20260709 13:10:09.018489 25236 leader_election.cc:290] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 2 election: Requested vote from peers eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:09.018561 25311 raft_consensus.cc:3055] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.018927 25385 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.019119 25311 raft_consensus.cc:740] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Running, Role: LEADER
I20260709 13:10:09.020030 25311 consensus_queue.cc:260] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.021379 25311 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.026809 25385 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 2.
I20260709 13:10:09.028057 25200 leader_election.cc:304] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d786e8d64740cf9ca346ba94316989, 9044d84096d14885b75d43103163e4ef; no voters: 
I20260709 13:10:09.028470 25311 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 2.
I20260709 13:10:09.028821 25433 raft_consensus.cc:2804] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.029428 25433 raft_consensus.cc:697] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Becoming Leader. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Running, Role: LEADER
I20260709 13:10:09.030335 25433 consensus_queue.cc:237] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.037065 25133 catalog_manager.cc:5697] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef reported cstate change: term changed from 1 to 2, leader changed from eb93945400f746d98db9cba714f5ca62 (127.14.45.2) to 9044d84096d14885b75d43103163e4ef (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9044d84096d14885b75d43103163e4ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.256793 25430 raft_consensus.cc:993] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: : Instructing follower 9044d84096d14885b75d43103163e4ef to start an election
I20260709 13:10:09.257279 25464 raft_consensus.cc:1081] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Signalling peer 9044d84096d14885b75d43103163e4ef to start an election
I20260709 13:10:09.258867 25236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27414958a6454f7fa19679122d59adfa"
dest_uuid: "9044d84096d14885b75d43103163e4ef"
 from {username='slave'} at 127.0.0.1:38834
I20260709 13:10:09.259440 25236 raft_consensus.cc:493] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.259828 25236 raft_consensus.cc:3060] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.266006 25236 raft_consensus.cc:515] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.267647 25236 leader_election.cc:290] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 2 election: Requested vote from peers eb93945400f746d98db9cba714f5ca62 (127.14.45.2:37137), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:09.268740 25311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27414958a6454f7fa19679122d59adfa" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb93945400f746d98db9cba714f5ca62"
I20260709 13:10:09.268740 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27414958a6454f7fa19679122d59adfa" candidate_uuid: "9044d84096d14885b75d43103163e4ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d786e8d64740cf9ca346ba94316989"
I20260709 13:10:09.269622 25311 raft_consensus.cc:3060] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.269675 25385 raft_consensus.cc:3055] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.270123 25385 raft_consensus.cc:740] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d786e8d64740cf9ca346ba94316989, State: Running, Role: LEADER
I20260709 13:10:09.270963 25385 consensus_queue.cc:260] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.272217 25385 raft_consensus.cc:3060] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.277150 25311 raft_consensus.cc:2468] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 2.
I20260709 13:10:09.278815 25199 leader_election.cc:304] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9044d84096d14885b75d43103163e4ef, eb93945400f746d98db9cba714f5ca62; no voters: 
I20260709 13:10:09.279295 25385 raft_consensus.cc:2468] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9044d84096d14885b75d43103163e4ef in term 2.
I20260709 13:10:09.279543 25433 raft_consensus.cc:2804] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.280072 25433 raft_consensus.cc:697] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Becoming Leader. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Running, Role: LEADER
I20260709 13:10:09.280998 25433 consensus_queue.cc:237] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.287317 25133 catalog_manager.cc:5697] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef reported cstate change: term changed from 1 to 2, leader changed from 11d786e8d64740cf9ca346ba94316989 (127.14.45.3) to 9044d84096d14885b75d43103163e4ef (127.14.45.1). New cstate: current_term: 2 leader_uuid: "9044d84096d14885b75d43103163e4ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.364867 14516 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:09.366565 14516 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:09.367039 14516 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:09.370401 25433 consensus_queue.cc:1048] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.387820 25236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099357c913f5416698de1c604bc4306c"
dest_uuid: "9044d84096d14885b75d43103163e4ef"
mode: GRACEFUL
new_leader_uuid: "eb93945400f746d98db9cba714f5ca62"
 from {username='slave'} at 127.0.0.1:38844
I20260709 13:10:09.387768 25433 consensus_queue.cc:1048] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.388540 25236 raft_consensus.cc:606] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Received request to transfer leadership to TS eb93945400f746d98db9cba714f5ca62
I20260709 13:10:09.389889 14516 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:09.576356 25311 raft_consensus.cc:1275] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Refusing update from remote peer 9044d84096d14885b75d43103163e4ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.577556 25433 consensus_queue.cc:1048] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.582921 25478 raft_consensus.cc:993] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: : Instructing follower eb93945400f746d98db9cba714f5ca62 to start an election
I20260709 13:10:09.583518 25477 raft_consensus.cc:1081] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Signalling peer eb93945400f746d98db9cba714f5ca62 to start an election
I20260709 13:10:09.585304 25310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "099357c913f5416698de1c604bc4306c"
dest_uuid: "eb93945400f746d98db9cba714f5ca62"
 from {username='slave'} at 127.0.0.1:46552
I20260709 13:10:09.585927 25310 raft_consensus.cc:493] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.586305 25310 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.588027 25385 raft_consensus.cc:1275] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Refusing update from remote peer 9044d84096d14885b75d43103163e4ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.589704 25433 consensus_queue.cc:1048] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.594010 25310 raft_consensus.cc:515] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.596455 25310 leader_election.cc:290] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [CANDIDATE]: Term 3 election: Requested vote from peers 9044d84096d14885b75d43103163e4ef (127.14.45.1:40217), 11d786e8d64740cf9ca346ba94316989 (127.14.45.3:41457)
I20260709 13:10:09.598100 25236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "eb93945400f746d98db9cba714f5ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9044d84096d14885b75d43103163e4ef"
I20260709 13:10:09.598724 25236 raft_consensus.cc:3055] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:09.599062 25236 raft_consensus.cc:740] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9044d84096d14885b75d43103163e4ef, State: Running, Role: LEADER
I20260709 13:10:09.599852 25236 consensus_queue.cc:260] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.601181 25236 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.598026 25385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099357c913f5416698de1c604bc4306c" candidate_uuid: "eb93945400f746d98db9cba714f5ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11d786e8d64740cf9ca346ba94316989"
I20260709 13:10:09.606647 25385 raft_consensus.cc:3060] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.609294 25236 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb93945400f746d98db9cba714f5ca62 in term 3.
I20260709 13:10:09.610600 25275 leader_election.cc:304] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9044d84096d14885b75d43103163e4ef, eb93945400f746d98db9cba714f5ca62; no voters: 
I20260709 13:10:09.611572 25432 raft_consensus.cc:2804] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:09.614146 25385 raft_consensus.cc:2468] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb93945400f746d98db9cba714f5ca62 in term 3.
I20260709 13:10:09.615216 25432 raft_consensus.cc:697] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 3 LEADER]: Becoming Leader. State: Replica: eb93945400f746d98db9cba714f5ca62, State: Running, Role: LEADER
I20260709 13:10:09.616237 25432 consensus_queue.cc:237] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } }
I20260709 13:10:09.623054 25133 catalog_manager.cc:5697] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 reported cstate change: term changed from 2 to 3, leader changed from 9044d84096d14885b75d43103163e4ef (127.14.45.1) to eb93945400f746d98db9cba714f5ca62 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "eb93945400f746d98db9cba714f5ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9044d84096d14885b75d43103163e4ef" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.752930 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
I20260709 13:10:09.774729 25385 raft_consensus.cc:1275] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Refusing update from remote peer 9044d84096d14885b75d43103163e4ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.776579 25433 consensus_queue.cc:1048] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d786e8d64740cf9ca346ba94316989" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.777027 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:09.778080 14516 tablet_replica.cc:333] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef: stopping tablet replica
I20260709 13:10:09.778746 14516 raft_consensus.cc:2243] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.779551 14516 raft_consensus.cc:2272] T 877a35a0d987470dac698fa7852649c7 P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.782265 14516 tablet_replica.cc:333] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef: stopping tablet replica
I20260709 13:10:09.783380 14516 raft_consensus.cc:2243] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.783970 14516 raft_consensus.cc:2272] T 099357c913f5416698de1c604bc4306c P 9044d84096d14885b75d43103163e4ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.786569 25310 raft_consensus.cc:1275] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Refusing update from remote peer 9044d84096d14885b75d43103163e4ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.788290 25433 consensus_queue.cc:1048] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb93945400f746d98db9cba714f5ca62" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.789642 14516 tablet_replica.cc:333] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef: stopping tablet replica
I20260709 13:10:09.790576 14516 raft_consensus.cc:2243] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.791172 14516 raft_consensus.cc:2272] T 32c6812830684e3099cab3d5e3f3b153 P 9044d84096d14885b75d43103163e4ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.793720 14516 tablet_replica.cc:333] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef: stopping tablet replica
I20260709 13:10:09.794467 14516 raft_consensus.cc:2243] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.795429 14516 raft_consensus.cc:2272] T 27414958a6454f7fa19679122d59adfa P 9044d84096d14885b75d43103163e4ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.824244 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
I20260709 13:10:09.837668 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
I20260709 13:10:09.857197 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:09.857942 14516 tablet_replica.cc:333] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62: stopping tablet replica
I20260709 13:10:09.858528 14516 raft_consensus.cc:2243] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.859027 14516 raft_consensus.cc:2272] T 877a35a0d987470dac698fa7852649c7 P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.861533 14516 tablet_replica.cc:333] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: stopping tablet replica
I20260709 13:10:09.862138 14516 raft_consensus.cc:2243] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.862758 14516 pending_rounds.cc:70] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: Trying to abort 1 pending ops.
I20260709 13:10:09.862967 14516 pending_rounds.cc:77] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636288996622336 op_type: NO_OP noop_request { }
I20260709 13:10:09.863265 14516 raft_consensus.cc:2889] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:09.863544 14516 raft_consensus.cc:2272] T 099357c913f5416698de1c604bc4306c P eb93945400f746d98db9cba714f5ca62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.865826 14516 tablet_replica.cc:333] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62: stopping tablet replica
I20260709 13:10:09.866365 14516 raft_consensus.cc:2243] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.866778 14516 raft_consensus.cc:2272] T 32c6812830684e3099cab3d5e3f3b153 P eb93945400f746d98db9cba714f5ca62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.868598 14516 tablet_replica.cc:333] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62: stopping tablet replica
I20260709 13:10:09.869066 14516 raft_consensus.cc:2243] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.869483 14516 raft_consensus.cc:2272] T 27414958a6454f7fa19679122d59adfa P eb93945400f746d98db9cba714f5ca62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.892997 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
I20260709 13:10:09.905198 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
I20260709 13:10:09.924926 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:09.925595 14516 tablet_replica.cc:333] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989: stopping tablet replica
I20260709 13:10:09.926205 14516 raft_consensus.cc:2243] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.926653 14516 raft_consensus.cc:2272] T 877a35a0d987470dac698fa7852649c7 P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.928834 14516 tablet_replica.cc:333] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989: stopping tablet replica
I20260709 13:10:09.929352 14516 raft_consensus.cc:2243] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.929823 14516 raft_consensus.cc:2272] T 099357c913f5416698de1c604bc4306c P 11d786e8d64740cf9ca346ba94316989 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.932552 14516 tablet_replica.cc:333] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989: stopping tablet replica
I20260709 13:10:09.933104 14516 raft_consensus.cc:2243] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.933982 14516 raft_consensus.cc:2272] T 32c6812830684e3099cab3d5e3f3b153 P 11d786e8d64740cf9ca346ba94316989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.935844 14516 tablet_replica.cc:333] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989: stopping tablet replica
I20260709 13:10:09.936338 14516 raft_consensus.cc:2243] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.936746 14516 raft_consensus.cc:2272] T 27414958a6454f7fa19679122d59adfa P 11d786e8d64740cf9ca346ba94316989 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.948846 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
I20260709 13:10:09.961145 14516 master.cc:562] Master@127.14.45.62:37143 shutting down...
I20260709 13:10:09.986073 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.986991 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.987485 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4d296787fcd44d44b63ea362a5923880: stopping tablet replica
I20260709 13:10:10.008224 14516 master.cc:584] Master@127.14.45.62:37143 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2799 ms)
[----------] 6 tests from LeaderRebalancerTest (317744 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:10.041221 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:37821
I20260709 13:10:10.042412 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:10.047547 25482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.047722 25483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.048834 25485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:10.050287 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:10.051173 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:10.051355 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:10.051472 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602610051461 us; error 0 us; skew 500 ppm
I20260709 13:10:10.051961 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:10.054316 14516 webserver.cc:533] Webserver started at http://127.14.45.62:35025/ using document root <none> and password file <none>
I20260709 13:10:10.054783 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:10.054958 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:10.055186 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:10.058333 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "4ffc5d067cd049b79395a9e38ce32b44"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.062960 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:10.066532 25490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.067353 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:10.067615 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "4ffc5d067cd049b79395a9e38ce32b44"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.067852 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:10.079383 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:10.080399 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:10.120254 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:37821
I20260709 13:10:10.120347 25541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:37821 every 8 connection(s)
I20260709 13:10:10.124358 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.135342 25542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44: Bootstrap starting.
I20260709 13:10:10.139742 25542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.144021 25542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44: No bootstrap required, opened a new log
I20260709 13:10:10.146121 25542 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffc5d067cd049b79395a9e38ce32b44" member_type: VOTER }
I20260709 13:10:10.146512 25542 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.146745 25542 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffc5d067cd049b79395a9e38ce32b44, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.147437 25542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffc5d067cd049b79395a9e38ce32b44" member_type: VOTER }
I20260709 13:10:10.147931 25542 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:10.148149 25542 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:10.148418 25542 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.153293 25542 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffc5d067cd049b79395a9e38ce32b44" member_type: VOTER }
I20260709 13:10:10.153875 25542 leader_election.cc:304] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ffc5d067cd049b79395a9e38ce32b44; no voters: 
I20260709 13:10:10.155040 25542 leader_election.cc:290] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:10.155391 25545 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.156884 25545 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 1 LEADER]: Becoming Leader. State: Replica: 4ffc5d067cd049b79395a9e38ce32b44, State: Running, Role: LEADER
I20260709 13:10:10.157575 25545 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffc5d067cd049b79395a9e38ce32b44" member_type: VOTER }
I20260709 13:10:10.157985 25542 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:10.160573 25546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ffc5d067cd049b79395a9e38ce32b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffc5d067cd049b79395a9e38ce32b44" member_type: VOTER } }
I20260709 13:10:10.160597 25547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ffc5d067cd049b79395a9e38ce32b44. Latest consensus state: current_term: 1 leader_uuid: "4ffc5d067cd049b79395a9e38ce32b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffc5d067cd049b79395a9e38ce32b44" member_type: VOTER } }
I20260709 13:10:10.161461 25547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:10.161450 25546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:10.164419 25550 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:10.169528 25550 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:10.174393 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:10.178424 25550 catalog_manager.cc:1383] Generated new cluster ID: c3e8123a9c5e4cc2bb00df91bf6b2c77
I20260709 13:10:10.178719 25550 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:10.196710 25550 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:10.198107 25550 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:10.210928 25550 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44: Generated new TSK 0
I20260709 13:10:10.211548 25550 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:10.242151 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:10.248342 25563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.249640 25564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:10.251391 14516 server_base.cc:1061] running on GCE node
W20260709 13:10:10.251837 25566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:10.252810 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:10.253042 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:10.253262 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602610253242 us; error 0 us; skew 500 ppm
I20260709 13:10:10.253969 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:10.256325 14516 webserver.cc:533] Webserver started at http://127.14.45.1:42935/ using document root <none> and password file <none>
I20260709 13:10:10.256826 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:10.257025 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:10.257298 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:10.258448 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "3be37a832a2343ed8f586df2bb091991"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.263104 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:10:10.266525 25571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.267529 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:10.267875 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "3be37a832a2343ed8f586df2bb091991"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.268200 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:10.302928 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:10.304185 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:10.305783 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:10.308260 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:10.308533 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.308804 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:10.308979 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.352346 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:38065
I20260709 13:10:10.352644 25633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:38065 every 8 connection(s)
I20260709 13:10:10.357583 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:10.364516 25638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.365855 25639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.371029 25641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:10.371227 25634 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37821
I20260709 13:10:10.371834 25634 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:10.371922 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:10.372812 25634 heartbeater.cc:507] Master 127.14.45.62:37821 requested a full tablet report, sending...
I20260709 13:10:10.372910 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:10.373224 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:10.373410 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602610373392 us; error 0 us; skew 500 ppm
I20260709 13:10:10.374119 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:10.375339 25507 ts_manager.cc:194] Registered new tserver with Master: 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065)
I20260709 13:10:10.376916 14516 webserver.cc:533] Webserver started at http://127.14.45.2:34949/ using document root <none> and password file <none>
I20260709 13:10:10.377521 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:10.377725 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:10.377832 25507 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55638
I20260709 13:10:10.378044 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:10.379426 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "8ee23bc024b44f419ece505101f72977"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.383801 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:10.387297 25646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.388219 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:10.388705 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "8ee23bc024b44f419ece505101f72977"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.389029 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:10.412629 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:10.413854 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:10.415313 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:10.417573 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:10.417814 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:10.418059 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:10.418224 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.458994 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:41755
I20260709 13:10:10.459091 25708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:41755 every 8 connection(s)
I20260709 13:10:10.463932 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:10.472060 25712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.472640 25713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:10.476200 25715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:10.476464 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:10.477635 25709 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37821
I20260709 13:10:10.477638 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:10.478232 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:10.478264 25709 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:10.478437 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602610478411 us; error 0 us; skew 500 ppm
I20260709 13:10:10.479116 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:10.479195 25709 heartbeater.cc:507] Master 127.14.45.62:37821 requested a full tablet report, sending...
I20260709 13:10:10.481508 25507 ts_manager.cc:194] Registered new tserver with Master: 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:10.481976 14516 webserver.cc:533] Webserver started at http://127.14.45.3:41953/ using document root <none> and password file <none>
I20260709 13:10:10.482514 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:10.482720 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:10.482997 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:10.483093 25507 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55644
I20260709 13:10:10.484108 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "c8630952f9e84d32b0406fa391901bcf"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.488997 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:10.492756 25720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.493631 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:10.494007 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "c8630952f9e84d32b0406fa391901bcf"
format_stamp: "Formatted at 2026-07-09 13:10:10 on dist-test-slave-lfdf"
I20260709 13:10:10.494289 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:10.526697 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:10.527841 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:10.529261 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:10.531563 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:10.531810 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.532053 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:10.532224 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.576862 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:45905
I20260709 13:10:10.577261 25782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:45905 every 8 connection(s)
I20260709 13:10:10.590870 25783 heartbeater.cc:344] Connected to a master server at 127.14.45.62:37821
I20260709 13:10:10.591426 25783 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:10.592224 25783 heartbeater.cc:507] Master 127.14.45.62:37821 requested a full tablet report, sending...
I20260709 13:10:10.594347 25507 ts_manager.cc:194] Registered new tserver with Master: c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:10.594877 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014743304s
I20260709 13:10:10.596108 25507 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55648
I20260709 13:10:10.620257 25507 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55656:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:10.623071 25507 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:10.697130 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 65e31358a4b64d779e89d4029a7161aa (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.698556 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e31358a4b64d779e89d4029a7161aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.700646 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 65e31358a4b64d779e89d4029a7161aa (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.702106 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e31358a4b64d779e89d4029a7161aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.702417 25595 tablet_service.cc:1511] Processing CreateTablet for tablet f87ef76e38824eb39fb6e7d442c8d89f (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:10.703868 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87ef76e38824eb39fb6e7d442c8d89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.707165 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea769177a384320ad501d87ce229221 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:10.708590 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea769177a384320ad501d87ce229221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.710834 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea769177a384320ad501d87ce229221 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:10.711644 25594 tablet_service.cc:1511] Processing CreateTablet for tablet b04aee67a4664365aa0bfb44a5ce8420 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:10.712298 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea769177a384320ad501d87ce229221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.713049 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04aee67a4664365aa0bfb44a5ce8420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.717010 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 0f074e6849ac4a0b99df84f26fe15072 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.718387 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f074e6849ac4a0b99df84f26fe15072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.718793 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 09e87e2309b84161ac6c20a13561d4d4 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.720126 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e87e2309b84161ac6c20a13561d4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.722641 25591 tablet_service.cc:1511] Processing CreateTablet for tablet d83306074cc9408baf3602d8eba574b2 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:10.723500 25744 tablet_service.cc:1511] Processing CreateTablet for tablet f87ef76e38824eb39fb6e7d442c8d89f (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:10.724042 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83306074cc9408baf3602d8eba574b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.724805 25744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87ef76e38824eb39fb6e7d442c8d89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.726670 25743 tablet_service.cc:1511] Processing CreateTablet for tablet b04aee67a4664365aa0bfb44a5ce8420 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:10.726881 25592 tablet_service.cc:1511] Processing CreateTablet for tablet 86ed59ba18e64316853c58eb1fe8ad5c (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:10.728093 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04aee67a4664365aa0bfb44a5ce8420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.729223 25598 tablet_service.cc:1511] Processing CreateTablet for tablet 09e87e2309b84161ac6c20a13561d4d4 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.714860 25597 tablet_service.cc:1511] Processing CreateTablet for tablet 0f074e6849ac4a0b99df84f26fe15072 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.714866 25593 tablet_service.cc:1511] Processing CreateTablet for tablet df8a849878604c938fb5b2981c1d029a (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:10.728093 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ed59ba18e64316853c58eb1fe8ad5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.733568 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e87e2309b84161ac6c20a13561d4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.735996 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8a849878604c938fb5b2981c1d029a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.739953 25742 tablet_service.cc:1511] Processing CreateTablet for tablet df8a849878604c938fb5b2981c1d029a (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:10.743466 25741 tablet_service.cc:1511] Processing CreateTablet for tablet 86ed59ba18e64316853c58eb1fe8ad5c (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:10.742120 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f074e6849ac4a0b99df84f26fe15072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.744303 25740 tablet_service.cc:1511] Processing CreateTablet for tablet d83306074cc9408baf3602d8eba574b2 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:10.754077 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8a849878604c938fb5b2981c1d029a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.755026 25741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ed59ba18e64316853c58eb1fe8ad5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.758250 25740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83306074cc9408baf3602d8eba574b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.802528 25798 tablet_bootstrap.cc:492] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:10.813541 25798 tablet_bootstrap.cc:654] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.815909 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 65e31358a4b64d779e89d4029a7161aa (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.843071 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e31358a4b64d779e89d4029a7161aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.817968 25669 tablet_service.cc:1511] Processing CreateTablet for tablet b04aee67a4664365aa0bfb44a5ce8420 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:10.847008 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04aee67a4664365aa0bfb44a5ce8420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.818457 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 09e87e2309b84161ac6c20a13561d4d4 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.851047 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e87e2309b84161ac6c20a13561d4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.819686 25668 tablet_service.cc:1511] Processing CreateTablet for tablet df8a849878604c938fb5b2981c1d029a (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:10.854951 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8a849878604c938fb5b2981c1d029a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.820832 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 0f074e6849ac4a0b99df84f26fe15072 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.821506 25667 tablet_service.cc:1511] Processing CreateTablet for tablet 86ed59ba18e64316853c58eb1fe8ad5c (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:10.823709 25666 tablet_service.cc:1511] Processing CreateTablet for tablet d83306074cc9408baf3602d8eba574b2 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:10.823531 25670 tablet_service.cc:1511] Processing CreateTablet for tablet f87ef76e38824eb39fb6e7d442c8d89f (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:10.826092 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea769177a384320ad501d87ce229221 (DEFAULT_TABLE table=test-workload [id=51af12a7c1104750a67cc4e7b755803b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:10.859815 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f074e6849ac4a0b99df84f26fe15072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.862990 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83306074cc9408baf3602d8eba574b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.866604 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ed59ba18e64316853c58eb1fe8ad5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.870661 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea769177a384320ad501d87ce229221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.872463 25798 tablet_bootstrap.cc:492] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:10.873003 25798 ts_tablet_manager.cc:1403] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.071s	user 0.003s	sys 0.007s
I20260709 13:10:10.874600 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87ef76e38824eb39fb6e7d442c8d89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.883129 25798 raft_consensus.cc:359] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:10.883893 25798 raft_consensus.cc:385] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.884157 25798 raft_consensus.cc:740] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.884863 25798 consensus_queue.cc:260] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:10.887018 25799 tablet_bootstrap.cc:492] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:10.914916 25798 ts_tablet_manager.cc:1434] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.015s
I20260709 13:10:10.923724 25634 heartbeater.cc:499] Master 127.14.45.62:37821 was elected leader, sending a full tablet report...
I20260709 13:10:10.929509 25798 tablet_bootstrap.cc:492] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:10.936635 25798 tablet_bootstrap.cc:654] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.939121 25799 tablet_bootstrap.cc:654] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.942842 25802 tablet_bootstrap.cc:492] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:10.952386 25802 tablet_bootstrap.cc:654] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.965145 25802 tablet_bootstrap.cc:492] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:10.965978 25802 ts_tablet_manager.cc:1403] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.010s
I20260709 13:10:10.970615 25802 raft_consensus.cc:359] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:10.971714 25802 raft_consensus.cc:385] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.972162 25802 raft_consensus.cc:740] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.973431 25802 consensus_queue.cc:260] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:10.977305 25802 ts_tablet_manager.cc:1434] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:10:10.978142 25709 heartbeater.cc:499] Master 127.14.45.62:37821 was elected leader, sending a full tablet report...
I20260709 13:10:10.978259 25798 tablet_bootstrap.cc:492] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:10.978482 25802 tablet_bootstrap.cc:492] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:10.978905 25798 ts_tablet_manager.cc:1403] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.023s
I20260709 13:10:10.978962 25799 tablet_bootstrap.cc:492] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:10.979588 25799 ts_tablet_manager.cc:1403] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.023s
I20260709 13:10:10.982089 25798 raft_consensus.cc:359] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:10.982589 25799 raft_consensus.cc:359] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:10.983458 25799 raft_consensus.cc:385] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.983012 25798 raft_consensus.cc:385] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.983855 25799 raft_consensus.cc:740] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.984010 25798 raft_consensus.cc:740] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.984747 25802 tablet_bootstrap.cc:654] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.984934 25799 consensus_queue.cc:260] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:10.985234 25798 consensus_queue.cc:260] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:10.991241 25798 ts_tablet_manager.cc:1434] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:10:10.993279 25798 tablet_bootstrap.cc:492] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:10.994570 25799 ts_tablet_manager.cc:1434] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:10:10.995342 25783 heartbeater.cc:499] Master 127.14.45.62:37821 was elected leader, sending a full tablet report...
I20260709 13:10:11.002859 25798 tablet_bootstrap.cc:654] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.010483 25798 tablet_bootstrap.cc:492] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.011646 25798 ts_tablet_manager.cc:1403] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:10:11.013943 25802 tablet_bootstrap.cc:492] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.014557 25802 ts_tablet_manager.cc:1403] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.022s
I20260709 13:10:11.014755 25798 raft_consensus.cc:359] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.015581 25798 raft_consensus.cc:385] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.015880 25798 raft_consensus.cc:740] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.016685 25798 consensus_queue.cc:260] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.010535 25799 tablet_bootstrap.cc:492] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.017679 25802 raft_consensus.cc:359] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.018741 25802 raft_consensus.cc:385] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.019054 25802 raft_consensus.cc:740] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.019915 25802 consensus_queue.cc:260] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.022439 25802 ts_tablet_manager.cc:1434] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:10:11.023504 25802 tablet_bootstrap.cc:492] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.024503 25799 tablet_bootstrap.cc:654] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.029044 25798 ts_tablet_manager.cc:1434] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:10:11.029795 25802 tablet_bootstrap.cc:654] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.030260 25798 tablet_bootstrap.cc:492] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:11.036063 25802 tablet_bootstrap.cc:492] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.036079 25799 tablet_bootstrap.cc:492] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.036952 25802 ts_tablet_manager.cc:1403] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:11.037076 25798 tablet_bootstrap.cc:654] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.037020 25799 ts_tablet_manager.cc:1403] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:10:11.040232 25802 raft_consensus.cc:359] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.041097 25802 raft_consensus.cc:385] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.041606 25802 raft_consensus.cc:740] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.040830 25799 raft_consensus.cc:359] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.042291 25799 raft_consensus.cc:385] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.042760 25799 raft_consensus.cc:740] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.042506 25802 consensus_queue.cc:260] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.043895 25799 consensus_queue.cc:260] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.045116 25802 ts_tablet_manager.cc:1434] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:11.046195 25802 tablet_bootstrap.cc:492] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.052560 25802 tablet_bootstrap.cc:654] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.055181 25799 ts_tablet_manager.cc:1434] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:10:11.057641 25802 tablet_bootstrap.cc:492] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.058259 25802 ts_tablet_manager.cc:1403] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.003s
I20260709 13:10:11.058661 25799 tablet_bootstrap.cc:492] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.061177 25802 raft_consensus.cc:359] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.062119 25802 raft_consensus.cc:385] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.062451 25802 raft_consensus.cc:740] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.063258 25802 consensus_queue.cc:260] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.064890 25798 tablet_bootstrap.cc:492] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.065542 25798 ts_tablet_manager.cc:1403] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.016s
I20260709 13:10:11.065847 25802 ts_tablet_manager.cc:1434] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:11.067010 25802 tablet_bootstrap.cc:492] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.068821 25799 tablet_bootstrap.cc:654] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.068727 25798 raft_consensus.cc:359] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.069886 25798 raft_consensus.cc:385] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.070354 25798 raft_consensus.cc:740] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.071359 25798 consensus_queue.cc:260] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.074345 25802 tablet_bootstrap.cc:654] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.075794 25798 ts_tablet_manager.cc:1434] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:10:11.077021 25798 tablet_bootstrap.cc:492] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:11.085533 25798 tablet_bootstrap.cc:654] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.088733 25802 tablet_bootstrap.cc:492] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.089265 25802 ts_tablet_manager.cc:1403] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:10:11.091276 25799 tablet_bootstrap.cc:492] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.091460 25798 tablet_bootstrap.cc:492] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.092075 25799 ts_tablet_manager.cc:1403] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.005s
I20260709 13:10:11.092108 25798 ts_tablet_manager.cc:1403] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:10:11.092444 25802 raft_consensus.cc:359] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.093307 25802 raft_consensus.cc:385] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.093608 25802 raft_consensus.cc:740] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.094426 25802 consensus_queue.cc:260] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.095032 25798 raft_consensus.cc:359] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.095875 25798 raft_consensus.cc:385] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.095530 25799 raft_consensus.cc:359] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.096355 25798 raft_consensus.cc:740] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.096518 25799 raft_consensus.cc:385] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.096940 25802 ts_tablet_manager.cc:1434] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:10:11.096899 25799 raft_consensus.cc:740] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.097361 25798 consensus_queue.cc:260] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.098146 25802 tablet_bootstrap.cc:492] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.097837 25799 consensus_queue.cc:260] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.100116 25799 ts_tablet_manager.cc:1434] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:11.102020 25807 raft_consensus.cc:493] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.102638 25798 ts_tablet_manager.cc:1434] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:11.102517 25807 raft_consensus.cc:515] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.103008 25799 tablet_bootstrap.cc:492] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.103718 25798 tablet_bootstrap.cc:492] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:11.105439 25802 tablet_bootstrap.cc:654] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.111088 25798 tablet_bootstrap.cc:654] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.111263 25799 tablet_bootstrap.cc:654] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.114468 25807 leader_election.cc:290] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.118911 25802 tablet_bootstrap.cc:492] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.127164 25802 ts_tablet_manager.cc:1403] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.010s
I20260709 13:10:11.122786 25798 tablet_bootstrap.cc:492] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.129305 25798 ts_tablet_manager.cc:1403] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.002s
I20260709 13:10:11.132181 25802 raft_consensus.cc:359] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.133105 25802 raft_consensus.cc:385] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.132799 25798 raft_consensus.cc:359] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.133412 25802 raft_consensus.cc:740] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.133579 25798 raft_consensus.cc:385] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.125546 25799 tablet_bootstrap.cc:492] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.133945 25798 raft_consensus.cc:740] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.134403 25799 ts_tablet_manager.cc:1403] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
I20260709 13:10:11.134255 25802 consensus_queue.cc:260] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.134743 25798 consensus_queue.cc:260] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.136732 25802 ts_tablet_manager.cc:1434] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:11.137250 25798 ts_tablet_manager.cc:1434] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:10:11.138773 25798 tablet_bootstrap.cc:492] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:11.137619 25799 raft_consensus.cc:359] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.140285 25799 raft_consensus.cc:385] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.140595 25799 raft_consensus.cc:740] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.141409 25799 consensus_queue.cc:260] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.143245 25802 tablet_bootstrap.cc:492] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.146209 25799 ts_tablet_manager.cc:1434] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:11.146727 25798 tablet_bootstrap.cc:654] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.147363 25799 tablet_bootstrap.cc:492] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.151239 25801 raft_consensus.cc:493] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.151799 25801 raft_consensus.cc:515] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.156230 25801 leader_election.cc:290] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.156952 25799 tablet_bootstrap.cc:654] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:11.169247 25555 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:11.183311 25802 tablet_bootstrap.cc:654] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.208649 25806 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.209461 25806 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.222613 25806 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.234459 25801 raft_consensus.cc:493] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.235286 25801 raft_consensus.cc:515] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:11.238616 25801 leader_election.cc:290] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.246690 25801 raft_consensus.cc:493] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.247354 25801 raft_consensus.cc:515] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.249892 25801 leader_election.cc:290] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.300194 25802 tablet_bootstrap.cc:492] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.300912 25802 ts_tablet_manager.cc:1403] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.158s	user 0.047s	sys 0.049s
I20260709 13:10:11.302066 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
W20260709 13:10:11.304418 25724 leader_election.cc:343] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.304795 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.305186 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e31358a4b64d779e89d4029a7161aa" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.305775 25684 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.306583 25802 raft_consensus.cc:359] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.306942 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83306074cc9408baf3602d8eba574b2" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
W20260709 13:10:11.307830 25575 leader_election.cc:343] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.308005 25802 raft_consensus.cc:385] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.308430 25802 raft_consensus.cc:740] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.308918 25575 leader_election.cc:304] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.309278 25802 consensus_queue.cc:260] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.309900 25801 raft_consensus.cc:2804] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.310336 25801 raft_consensus.cc:493] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.310674 25801 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:11.310739 25575 leader_election.cc:343] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.319060 25801 raft_consensus.cc:515] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.329195 25806 raft_consensus.cc:493] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.329774 25806 raft_consensus.cc:515] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.331169 25801 leader_election.cc:290] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.331897 25806 leader_election.cc:290] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.329236 25802 ts_tablet_manager.cc:1434] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:11.338788 25801 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.340847 25801 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.343261 25798 tablet_bootstrap.cc:492] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.343640 25801 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.343844 25798 ts_tablet_manager.cc:1403] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.205s	user 0.085s	sys 0.089s
I20260709 13:10:11.344195 25801 raft_consensus.cc:493] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.344699 25801 raft_consensus.cc:515] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.345288 25807 raft_consensus.cc:493] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.343291 25799 tablet_bootstrap.cc:492] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.345871 25807 raft_consensus.cc:515] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.346503 25799 ts_tablet_manager.cc:1403] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.199s	user 0.095s	sys 0.080s
I20260709 13:10:11.347326 25801 leader_election.cc:290] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.348091 25807 leader_election.cc:290] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.349675 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.350124 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.350740 25609 raft_consensus.cc:2468] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:11.351694 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.351711 25798 raft_consensus.cc:359] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
W20260709 13:10:11.352267 25648 leader_election.cc:343] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.352675 25798 raft_consensus.cc:385] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.352557 25758 raft_consensus.cc:2468] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:11.353137 25798 raft_consensus.cc:740] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.352262 25724 leader_election.cc:304] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.354115 25648 leader_election.cc:304] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.353931 25798 consensus_queue.cc:260] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.354393 25807 raft_consensus.cc:2804] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.363349 25807 raft_consensus.cc:493] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.363894 25807 raft_consensus.cc:3060] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.364120 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.364847 25682 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.351641 25799 raft_consensus.cc:359] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.356855 25798 ts_tablet_manager.cc:1434] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:10:11.365808 25799 raft_consensus.cc:385] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.366159 25799 raft_consensus.cc:740] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.366667 25798 tablet_bootstrap.cc:492] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:11.367547 25799 consensus_queue.cc:260] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.368594 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.369311 25681 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.373646 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.374516 25608 raft_consensus.cc:2468] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:11.357604 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.375172 25835 raft_consensus.cc:493] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.375624 25755 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.374013 25807 raft_consensus.cc:515] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.358491 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e31358a4b64d779e89d4029a7161aa" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.359081 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.377359 25798 tablet_bootstrap.cc:654] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.359448 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83306074cc9408baf3602d8eba574b2" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.377811 25802 tablet_bootstrap.cc:492] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.361805 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.378655 25684 raft_consensus.cc:2468] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:11.357990 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.380129 25724 leader_election.cc:304] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:11.362740 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.355054 25806 raft_consensus.cc:2804] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.377389 25757 raft_consensus.cc:2468] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.361894 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.381558 25806 raft_consensus.cc:493] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.383633 25806 raft_consensus.cc:3060] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.364960 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.386145 25609 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:11.375800 25835 raft_consensus.cc:515] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.387897 25753 raft_consensus.cc:2393] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3be37a832a2343ed8f586df2bb091991 in current term 1: Already voted for candidate c8630952f9e84d32b0406fa391901bcf in this term.
I20260709 13:10:11.387913 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.394944 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.395020 25682 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.402005 25650 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: c8630952f9e84d32b0406fa391901bcf
W20260709 13:10:11.402293 25648 leader_election.cc:343] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.394958 25755 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.407186 25802 tablet_bootstrap.cc:654] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.407692 25807 leader_election.cc:290] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.409425 25799 ts_tablet_manager.cc:1434] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.063s	user 0.025s	sys 0.003s
I20260709 13:10:11.410064 25575 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.410737 25799 tablet_bootstrap.cc:492] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.411157 25832 raft_consensus.cc:2804] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.411643 25832 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.411955 25832 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.414614 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.415954 25833 raft_consensus.cc:493] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.416654 25833 raft_consensus.cc:515] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.418937 25807 raft_consensus.cc:2804] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.420117 25807 raft_consensus.cc:493] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.420928 25807 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.403510 25835 leader_election.cc:290] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.433085 25836 raft_consensus.cc:493] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.433656 25836 raft_consensus.cc:515] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.434834 25798 tablet_bootstrap.cc:492] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.435523 25798 ts_tablet_manager.cc:1403] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.016s
W20260709 13:10:11.428786 25724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.2:41755, user_credentials={real_user=slave}} blocked reactor thread for 48772us
W20260709 13:10:11.438148 25573 leader_election.cc:343] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.442401 25573 leader_election.cc:304] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991; no voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.444037 25801 raft_consensus.cc:2749] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.430840 25835 raft_consensus.cc:2804] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.439735 25807 raft_consensus.cc:515] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.446942 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.447471 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.448100 25609 raft_consensus.cc:3060] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.446973 25835 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.449983 25807 leader_election.cc:290] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.450443 25835 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.456127 25806 raft_consensus.cc:515] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.458065 25683 raft_consensus.cc:2393] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8630952f9e84d32b0406fa391901bcf in current term 1: Already voted for candidate 8ee23bc024b44f419ece505101f72977 in this term.
I20260709 13:10:11.453444 25833 leader_election.cc:290] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.438614 25575 leader_election.cc:304] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
W20260709 13:10:11.458027 25573 leader_election.cc:343] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.460822 25833 raft_consensus.cc:2804] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.461547 25833 raft_consensus.cc:697] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:11.439673 25798 raft_consensus.cc:359] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.463876 25798 raft_consensus.cc:385] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.464289 25798 raft_consensus.cc:740] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.467190 25573 leader_election.cc:304] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 8ee23bc024b44f419ece505101f72977
I20260709 13:10:11.437705 25836 leader_election.cc:290] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
W20260709 13:10:11.468918 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:38065, user_credentials={real_user=slave}} blocked reactor thread for 72807.4us
I20260709 13:10:11.469033 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.469890 25801 raft_consensus.cc:493] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.470469 25801 raft_consensus.cc:515] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.472712 25801 leader_election.cc:290] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.470079 25755 raft_consensus.cc:2393] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ee23bc024b44f419ece505101f72977 in current term 1: Already voted for candidate c8630952f9e84d32b0406fa391901bcf in this term.
I20260709 13:10:11.474864 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.475826 25683 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
W20260709 13:10:11.475068 25650 leader_election.cc:343] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.476882 25798 consensus_queue.cc:260] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.467243 25806 leader_election.cc:290] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.462474 25833 consensus_queue.cc:237] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.483186 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.483448 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.483947 25683 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.484036 25680 raft_consensus.cc:2468] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.479750 25801 raft_consensus.cc:2804] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.490238 25801 raft_consensus.cc:493] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.480492 25806 raft_consensus.cc:493] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.492995 25806 raft_consensus.cc:515] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.488549 25840 raft_consensus.cc:493] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.483242 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.490648 25801 raft_consensus.cc:3060] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.495922 25840 raft_consensus.cc:515] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.485888 25575 leader_election.cc:304] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.497004 25798 ts_tablet_manager.cc:1434] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.013s
I20260709 13:10:11.498070 25798 tablet_bootstrap.cc:492] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:11.497954 25683 raft_consensus.cc:2468] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:11.499665 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.500684 25799 tablet_bootstrap.cc:654] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:11.501192 25648 leader_election.cc:343] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.490870 25802 tablet_bootstrap.cc:492] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.492293 25724 leader_election.cc:304] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.486877 25832 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.494405 25835 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.488147 25573 leader_election.cc:304] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991; no voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.503860 25802 ts_tablet_manager.cc:1403] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.008s
I20260709 13:10:11.505427 25840 leader_election.cc:290] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.507074 25682 raft_consensus.cc:2468] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.479043 25650 leader_election.cc:304] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ee23bc024b44f419ece505101f72977; no voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.510056 25836 raft_consensus.cc:2804] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:11.514782 25836 raft_consensus.cc:493] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.514693 25840 raft_consensus.cc:2749] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.516229 25836 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.517455 25832 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.517665 25575 leader_election.cc:304] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.518208 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.518885 25682 raft_consensus.cc:2393] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3be37a832a2343ed8f586df2bb091991 in current term 1: Already voted for candidate 8ee23bc024b44f419ece505101f72977 in this term.
I20260709 13:10:11.520550 25802 raft_consensus.cc:359] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:11.521341 25802 raft_consensus.cc:385] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.522297 25844 raft_consensus.cc:2804] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.522763 25609 raft_consensus.cc:2468] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:11.522812 25844 raft_consensus.cc:493] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.523449 25844 raft_consensus.cc:3060] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.524326 25832 raft_consensus.cc:2804] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.524189 25836 raft_consensus.cc:515] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.524746 25832 raft_consensus.cc:493] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.525106 25832 raft_consensus.cc:3060] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.526592 25724 leader_election.cc:304] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.527498 25807 raft_consensus.cc:2804] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.527654 25806 leader_election.cc:290] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.528084 25807 raft_consensus.cc:697] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:11.528952 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.529731 25755 raft_consensus.cc:2468] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:11.530428 25835 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.529022 25807 consensus_queue.cc:237] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.536446 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.537130 25753 raft_consensus.cc:2468] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.538208 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.539492 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.539180 25844 raft_consensus.cc:515] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.532660 25798 tablet_bootstrap.cc:654] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.532829 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.541963 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.542562 25682 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.533376 25842 raft_consensus.cc:2749] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.543324 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.544548 25608 raft_consensus.cc:2393] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ee23bc024b44f419ece505101f72977 in current term 1: Already voted for candidate 3be37a832a2343ed8f586df2bb091991 in this term.
I20260709 13:10:11.531364 25648 leader_election.cc:304] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.543372 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
W20260709 13:10:11.546105 25648 leader_election.cc:343] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.546325 25683 raft_consensus.cc:3060] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.546630 25844 leader_election.cc:290] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.547856 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.549877 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.550244 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.550792 25607 raft_consensus.cc:2393] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ee23bc024b44f419ece505101f72977 in current term 1: Already voted for candidate 3be37a832a2343ed8f586df2bb091991 in this term.
I20260709 13:10:11.551026 25609 raft_consensus.cc:2393] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ee23bc024b44f419ece505101f72977 in current term 1: Already voted for candidate c8630952f9e84d32b0406fa391901bcf in this term.
I20260709 13:10:11.550859 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.551939 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.553539 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.555384 25650 leader_election.cc:304] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ee23bc024b44f419ece505101f72977; no voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.556459 25806 raft_consensus.cc:2804] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.556838 25806 raft_consensus.cc:493] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.557209 25682 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 2.
I20260709 13:10:11.557380 25806 raft_consensus.cc:3060] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.537931 25801 raft_consensus.cc:515] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:11.558302 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.559981 25801 leader_election.cc:290] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Requested vote from peers c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.560398 25650 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ee23bc024b44f419ece505101f72977; no voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.521629 25802 raft_consensus.cc:740] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.561050 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e31358a4b64d779e89d4029a7161aa" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.561436 25840 raft_consensus.cc:2749] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.561959 25802 consensus_queue.cc:260] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:11.562330 25724 leader_election.cc:304] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 8ee23bc024b44f419ece505101f72977
I20260709 13:10:11.562948 25680 raft_consensus.cc:3060] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.564136 25650 leader_election.cc:304] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ee23bc024b44f419ece505101f72977; no voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.564674 25802 ts_tablet_manager.cc:1434] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:10:11.565130 25840 raft_consensus.cc:2749] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.566025 25834 raft_consensus.cc:2804] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.566588 25834 raft_consensus.cc:697] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:11.567500 25834 consensus_queue.cc:237] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.571115 25683 raft_consensus.cc:2468] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.571743 25680 raft_consensus.cc:2468] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.572616 25575 leader_election.cc:304] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.572841 25806 raft_consensus.cc:515] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.573894 25801 raft_consensus.cc:2804] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:11.567777 25573 leader_election.cc:343] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.574697 25801 raft_consensus.cc:697] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
W20260709 13:10:11.575187 25573 leader_election.cc:343] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.575683 25573 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991; no voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.575573 25801 consensus_queue.cc:237] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.576700 25844 raft_consensus.cc:2749] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.576870 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
W20260709 13:10:11.577056 25573 leader_election.cc:343] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.577540 25755 raft_consensus.cc:3060] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.535786 25836 leader_election.cc:290] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.580153 25724 leader_election.cc:304] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
W20260709 13:10:11.582965 25724 leader_election.cc:343] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.571753 25835 raft_consensus.cc:2749] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.584928 25806 leader_election.cc:290] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.589465 25802 tablet_bootstrap.cc:492] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:11.585336 25836 raft_consensus.cc:2804] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.590032 25755 raft_consensus.cc:2468] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:11.600023 25648 leader_election.cc:304] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.602200 25835 raft_consensus.cc:2804] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.602928 25835 raft_consensus.cc:697] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:11.594889 25575 leader_election.cc:304] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.604061 25835 consensus_queue.cc:237] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.590941 25505 catalog_manager.cc:5697] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.605993 25798 tablet_bootstrap.cc:492] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:11.606581 25798 ts_tablet_manager.cc:1403] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.005s
I20260709 13:10:11.606427 25833 raft_consensus.cc:2804] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.596964 25836 raft_consensus.cc:697] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:11.607141 25833 raft_consensus.cc:697] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:11.607694 25836 consensus_queue.cc:237] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.608116 25833 consensus_queue.cc:237] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } }
I20260709 13:10:11.556815 25832 raft_consensus.cc:515] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.614832 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e31358a4b64d779e89d4029a7161aa" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.616034 25755 raft_consensus.cc:3060] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.624545 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.627346 25608 raft_consensus.cc:2393] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ee23bc024b44f419ece505101f72977 in current term 1: Already voted for candidate 3be37a832a2343ed8f586df2bb091991 in this term.
I20260709 13:10:11.629004 25506 catalog_manager.cc:5697] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.638077 25832 leader_election.cc:290] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.639334 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.641161 25802 tablet_bootstrap.cc:654] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.643718 25798 raft_consensus.cc:359] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.648399 25798 raft_consensus.cc:385] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.648865 25798 raft_consensus.cc:740] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.649961 25798 consensus_queue.cc:260] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.659535 25755 raft_consensus.cc:2468] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.661276 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.662184 25758 raft_consensus.cc:2393] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3be37a832a2343ed8f586df2bb091991 in current term 1: Already voted for candidate 8ee23bc024b44f419ece505101f72977 in this term.
I20260709 13:10:11.662390 25802 tablet_bootstrap.cc:492] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:11.662989 25802 ts_tablet_manager.cc:1403] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.004s
I20260709 13:10:11.661216 25798 ts_tablet_manager.cc:1434] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:10:11.663329 25573 leader_election.cc:304] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991; no voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:11.664827 25833 raft_consensus.cc:2749] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.666188 25799 tablet_bootstrap.cc:492] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.666877 25799 ts_tablet_manager.cc:1403] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.256s	user 0.019s	sys 0.029s
I20260709 13:10:11.668931 25802 raft_consensus.cc:359] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.669709 25799 raft_consensus.cc:359] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.670230 25802 raft_consensus.cc:385] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.670545 25799 raft_consensus.cc:385] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.670930 25799 raft_consensus.cc:740] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.670701 25802 raft_consensus.cc:740] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.671741 25799 consensus_queue.cc:260] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.672022 25802 consensus_queue.cc:260] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.673792 25799 ts_tablet_manager.cc:1434] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:11.675513 25799 tablet_bootstrap.cc:492] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.677452 25504 catalog_manager.cc:5697] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.682636 25799 tablet_bootstrap.cc:654] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.686296 25506 catalog_manager.cc:5697] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.689136 25505 catalog_manager.cc:5697] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.689218 25506 catalog_manager.cc:5697] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 1 to 2, leader changed from 3be37a832a2343ed8f586df2bb091991 (127.14.45.1) to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.690721 25505 catalog_manager.cc:5697] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.693325 25802 ts_tablet_manager.cc:1434] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 13:10:11.697156 25799 tablet_bootstrap.cc:492] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.697809 25799 ts_tablet_manager.cc:1403] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:10:11.701126 25799 raft_consensus.cc:359] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.701794 25799 raft_consensus.cc:385] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.702047 25799 raft_consensus.cc:740] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.702776 25799 consensus_queue.cc:260] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.705070 25799 ts_tablet_manager.cc:1434] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:11.706211 25799 tablet_bootstrap.cc:492] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.712723 25799 tablet_bootstrap.cc:654] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.718253 25799 tablet_bootstrap.cc:492] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.718626 25799 ts_tablet_manager.cc:1403] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:10:11.720548 25799 raft_consensus.cc:359] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.721032 25799 raft_consensus.cc:385] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.721212 25799 raft_consensus.cc:740] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.721868 25799 consensus_queue.cc:260] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.723837 25799 ts_tablet_manager.cc:1434] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:11.724901 25799 tablet_bootstrap.cc:492] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:11.725116 25836 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.725663 25836 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.727569 25836 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.728708 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.728708 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.729792 25680 raft_consensus.cc:2393] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8630952f9e84d32b0406fa391901bcf in current term 1: Already voted for candidate 8ee23bc024b44f419ece505101f72977 in this term.
I20260709 13:10:11.730185 25608 raft_consensus.cc:2393] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8630952f9e84d32b0406fa391901bcf in current term 1: Already voted for candidate 3be37a832a2343ed8f586df2bb091991 in this term.
I20260709 13:10:11.731297 25724 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8630952f9e84d32b0406fa391901bcf; no voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977
I20260709 13:10:11.732160 25799 tablet_bootstrap.cc:654] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.732481 25836 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.737836 25799 tablet_bootstrap.cc:492] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:11.738451 25799 ts_tablet_manager.cc:1403] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:11.739391 25836 raft_consensus.cc:2749] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.740700 25799 raft_consensus.cc:359] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.741324 25799 raft_consensus.cc:385] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.741544 25799 raft_consensus.cc:740] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.742235 25799 consensus_queue.cc:260] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.744352 25799 ts_tablet_manager.cc:1434] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:11.789366 25836 raft_consensus.cc:493] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.789927 25836 raft_consensus.cc:515] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.791806 25836 leader_election.cc:290] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.792913 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83306074cc9408baf3602d8eba574b2" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.793138 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83306074cc9408baf3602d8eba574b2" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.793681 25608 raft_consensus.cc:2468] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:11.793955 25680 raft_consensus.cc:2468] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:11.794950 25724 leader_election.cc:304] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.795739 25836 raft_consensus.cc:2804] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.796058 25836 raft_consensus.cc:493] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.796521 25836 raft_consensus.cc:3060] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.803989 25836 raft_consensus.cc:515] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.806107 25836 leader_election.cc:290] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.838385 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83306074cc9408baf3602d8eba574b2" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.838359 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83306074cc9408baf3602d8eba574b2" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:11.840682 25680 raft_consensus.cc:3060] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.840739 25608 raft_consensus.cc:3060] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.840029 25836 raft_consensus.cc:493] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.843039 25836 raft_consensus.cc:515] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.847144 25836 leader_election.cc:290] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:11.848896 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.850673 25683 raft_consensus.cc:2393] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8630952f9e84d32b0406fa391901bcf in current term 1: Already voted for candidate 3be37a832a2343ed8f586df2bb091991 in this term.
I20260709 13:10:11.848862 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:11.855158 25724 leader_election.cc:304] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8630952f9e84d32b0406fa391901bcf; no voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977
I20260709 13:10:11.856822 25836 raft_consensus.cc:3060] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.858067 25680 raft_consensus.cc:2468] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:11.860273 25608 raft_consensus.cc:2468] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:11.859798 25724 leader_election.cc:304] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:11.862658 25834 raft_consensus.cc:2804] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.863268 25834 raft_consensus.cc:697] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:11.865041 25834 consensus_queue.cc:237] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.869024 25836 raft_consensus.cc:2749] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.875921 25506 catalog_manager.cc:5697] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.878525 25833 raft_consensus.cc:493] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.879315 25833 raft_consensus.cc:515] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.883574 25833 leader_election.cc:290] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.883993 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:11.884819 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:11.885026 25680 raft_consensus.cc:2468] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.886116 25758 raft_consensus.cc:2468] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 0.
I20260709 13:10:11.888319 25575 leader_election.cc:304] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.889432 25833 raft_consensus.cc:2804] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.890010 25833 raft_consensus.cc:493] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.890547 25833 raft_consensus.cc:3060] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.899263 25833 raft_consensus.cc:515] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.901172 25833 leader_election.cc:290] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:11.901782 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:11.902143 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:11.902351 25680 raft_consensus.cc:3060] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.902721 25758 raft_consensus.cc:3060] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.907869 25680 raft_consensus.cc:2468] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.909117 25575 leader_election.cc:304] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:11.909440 25758 raft_consensus.cc:2468] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:11.909883 25833 raft_consensus.cc:2804] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.910477 25833 raft_consensus.cc:697] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:11.911983 25833 consensus_queue.cc:237] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:11.921064 25506 catalog_manager.cc:5697] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.999531 25608 raft_consensus.cc:3055] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.999923 25608 raft_consensus.cc:740] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:12.000797 25608 consensus_queue.cc:260] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:12.001776 25608 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.007721 25608 raft_consensus.cc:1275] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:10:12.008001 25608 pending_rounds.cc:85] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: Aborting all ops after (but not including) 0
I20260709 13:10:12.008163 25608 pending_rounds.cc:107] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:12.008358 25608 raft_consensus.cc:2889] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.010095 25836 consensus_queue.cc:1048] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.013911 25835 consensus_queue.cc:1048] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.020246 25833 consensus_queue.cc:1048] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.028380 25680 raft_consensus.cc:1275] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:12.031284 25807 consensus_queue.cc:1048] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.052109 25833 consensus_queue.cc:1048] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.062355 25840 consensus_queue.cc:1048] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.106563 25833 consensus_queue.cc:1048] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.107556 25844 consensus_queue.cc:1048] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.117342 25833 raft_consensus.cc:493] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.118185 25833 raft_consensus.cc:515] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:12.123608 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:12.123656 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:12.125164 25680 raft_consensus.cc:2393] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3be37a832a2343ed8f586df2bb091991 in current term 1: Already voted for candidate c8630952f9e84d32b0406fa391901bcf in this term.
I20260709 13:10:12.126544 25575 leader_election.cc:304] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991; no voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:12.127619 25832 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.128422 25833 leader_election.cc:290] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:12.136327 25832 raft_consensus.cc:2749] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.151798 25807 consensus_queue.cc:1048] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.158090 25807 consensus_queue.cc:1048] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.167652 25834 consensus_queue.cc:1048] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.173009 25880 consensus_queue.cc:1048] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:12.179116 25555 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:12.290485 25838 consensus_queue.cc:1048] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.303937 25834 consensus_queue.cc:1048] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.358083 25833 consensus_queue.cc:1048] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.371753 25842 consensus_queue.cc:1048] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:13.184309 25555 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:13.408138 25833 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.408790 25833 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:13.410650 25833 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:13.411580 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:13.411759 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:13.412292 25683 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:13.412591 25755 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 1.
I20260709 13:10:13.413614 25575 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:13.414577 25833 raft_consensus.cc:2804] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:13.414958 25833 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.415299 25833 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.423463 25833 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:13.425981 25833 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:13.426831 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:13.427038 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:13.427477 25683 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.427788 25755 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.433115 25683 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:13.434316 25755 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:13.434361 25575 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:13.435444 25833 raft_consensus.cc:2804] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.435968 25833 raft_consensus.cc:697] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:13.436935 25833 consensus_queue.cc:237] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:13.444845 25505 catalog_manager.cc:5697] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.842722 25755 raft_consensus.cc:1275] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:13.844058 25833 consensus_queue.cc:1048] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.855928 25683 raft_consensus.cc:1275] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:13.857334 25833 consensus_queue.cc:1048] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.062994 25755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:10:14.063625 25755 raft_consensus.cc:606] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:14.069257 25755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:10:14.070087 25755 raft_consensus.cc:606] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:14.085018 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea769177a384320ad501d87ce229221"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:10:14.085566 25683 raft_consensus.cc:606] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:14.100461 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:60282
I20260709 13:10:14.100981 25608 raft_consensus.cc:606] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:14.107026 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:60282
I20260709 13:10:14.107627 25608 raft_consensus.cc:606] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:14.112147 25842 raft_consensus.cc:993] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.112651 25833 raft_consensus.cc:1081] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.113076 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:60282
I20260709 13:10:14.113900 25608 raft_consensus.cc:606] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:14.114495 25683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45020
I20260709 13:10:14.115268 25683 raft_consensus.cc:493] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.115713 25683 raft_consensus.cc:3060] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.120059 25755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:10:14.120779 25755 raft_consensus.cc:606] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:14.123535 25683 raft_consensus.cc:515] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.126008 25683 leader_election.cc:290] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.126613 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:14.127161 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04aee67a4664365aa0bfb44a5ce8420" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.127313 25608 raft_consensus.cc:3055] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.127799 25608 raft_consensus.cc:740] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:14.127861 25755 raft_consensus.cc:3060] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.128902 25608 consensus_queue.cc:260] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.130316 25608 raft_consensus.cc:3060] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.135217 25755 raft_consensus.cc:2468] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:14.136507 25648 leader_election.cc:304] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:14.137396 25889 raft_consensus.cc:2804] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.137547 25608 raft_consensus.cc:2468] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:14.138758 25889 raft_consensus.cc:697] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:14.139830 25889 consensus_queue.cc:237] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.148097 25506 catalog_manager.cc:5697] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 1 to 2, leader changed from 3be37a832a2343ed8f586df2bb091991 (127.14.45.1) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.163762 25842 raft_consensus.cc:993] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.164280 25833 raft_consensus.cc:1081] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.165879 25683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45020
I20260709 13:10:14.166390 25683 raft_consensus.cc:493] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.166738 25683 raft_consensus.cc:3060] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.172410 25683 raft_consensus.cc:515] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.174221 25683 leader_election.cc:290] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.174975 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:14.175349 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a849878604c938fb5b2981c1d029a" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.175774 25608 raft_consensus.cc:3055] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.175915 25755 raft_consensus.cc:3060] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.176158 25608 raft_consensus.cc:740] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:14.177039 25608 consensus_queue.cc:260] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.178323 25608 raft_consensus.cc:3060] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.183525 25755 raft_consensus.cc:2468] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:14.184962 25648 leader_election.cc:304] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:14.185801 25608 raft_consensus.cc:2468] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:14.186133 25905 raft_consensus.cc:2804] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.186853 25905 raft_consensus.cc:697] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:14.188071 25905 consensus_queue.cc:237] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.197139 25506 catalog_manager.cc:5697] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 1 to 2, leader changed from 3be37a832a2343ed8f586df2bb091991 (127.14.45.1) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.351470 25900 raft_consensus.cc:993] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.351994 25834 raft_consensus.cc:1081] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.353420 25683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45018
I20260709 13:10:14.353973 25683 raft_consensus.cc:493] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.354394 25683 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.360641 25683 raft_consensus.cc:515] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.362433 25683 leader_election.cc:290] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.363525 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:14.363566 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.364280 25608 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.364450 25755 raft_consensus.cc:3055] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.364917 25755 raft_consensus.cc:740] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:14.365656 25755 consensus_queue.cc:260] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.366787 25755 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.370888 25608 raft_consensus.cc:2468] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:14.372424 25650 leader_election.cc:304] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:14.372891 25755 raft_consensus.cc:2468] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:14.373378 25905 raft_consensus.cc:2804] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.373950 25905 raft_consensus.cc:697] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:14.375000 25905 consensus_queue.cc:237] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.381392 25506 catalog_manager.cc:5697] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 1 to 2, leader changed from c8630952f9e84d32b0406fa391901bcf (127.14.45.3) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.394505 25842 raft_consensus.cc:993] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.395090 25912 raft_consensus.cc:1081] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:14.396813 25683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45020
I20260709 13:10:14.397410 25683 raft_consensus.cc:493] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.397794 25683 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.403097 25683 raft_consensus.cc:515] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.404686 25683 leader_election.cc:290] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 3 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.405692 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:14.405906 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87ef76e38824eb39fb6e7d442c8d89f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.406386 25608 raft_consensus.cc:3055] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.406423 25755 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.406786 25608 raft_consensus.cc:740] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:14.407624 25608 consensus_queue.cc:260] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.408571 25608 raft_consensus.cc:3060] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.411857 25755 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 3.
I20260709 13:10:14.413101 25648 leader_election.cc:304] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:14.413990 25905 raft_consensus.cc:2804] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.414188 25608 raft_consensus.cc:2468] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 3.
I20260709 13:10:14.414535 25905 raft_consensus.cc:697] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 3 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:14.416293 25905 consensus_queue.cc:237] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.418934 25900 raft_consensus.cc:993] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:14.419543 25834 raft_consensus.cc:1081] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:14.421166 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60278
I20260709 13:10:14.421833 25608 raft_consensus.cc:493] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.422204 25608 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.423799 25506 catalog_manager.cc:5697] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 2 to 3, leader changed from 3be37a832a2343ed8f586df2bb091991 (127.14.45.1) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 3 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.429657 25608 raft_consensus.cc:515] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.431113 25900 raft_consensus.cc:993] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:14.431634 25900 raft_consensus.cc:1081] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:14.431960 25608 leader_election.cc:290] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 3 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.433195 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.433199 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:14.433907 25755 raft_consensus.cc:3055] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.434036 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60278
I20260709 13:10:14.434113 25683 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.434279 25755 raft_consensus.cc:740] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:14.435001 25608 raft_consensus.cc:493] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.435443 25608 raft_consensus.cc:3060] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.435570 25755 consensus_queue.cc:260] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.436896 25755 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.442220 25683 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 3.
I20260709 13:10:14.442456 25755 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 3.
I20260709 13:10:14.442744 25608 raft_consensus.cc:515] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.443868 25573 leader_election.cc:304] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:14.444626 25912 raft_consensus.cc:2804] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.445142 25912 raft_consensus.cc:697] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:14.445148 25608 leader_election.cc:290] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.445927 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:14.446511 25683 raft_consensus.cc:3060] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.446050 25912 consensus_queue.cc:237] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.447168 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f074e6849ac4a0b99df84f26fe15072" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.447860 25755 raft_consensus.cc:3055] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.448486 25755 raft_consensus.cc:740] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:14.449589 25755 consensus_queue.cc:260] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.451352 25755 raft_consensus.cc:3060] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.452381 25683 raft_consensus.cc:2468] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:14.453572 25575 leader_election.cc:304] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:14.454416 25842 raft_consensus.cc:2804] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.454973 25842 raft_consensus.cc:697] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:14.456054 25842 consensus_queue.cc:237] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.459481 25889 raft_consensus.cc:993] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:14.460008 25889 raft_consensus.cc:1081] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:14.459995 25506 catalog_manager.cc:5697] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 2 to 3, leader changed from c8630952f9e84d32b0406fa391901bcf (127.14.45.3) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 3 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.462419 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ea769177a384320ad501d87ce229221"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60280
I20260709 13:10:14.463120 25608 raft_consensus.cc:493] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.463377 25608 raft_consensus.cc:3060] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.465627 25755 raft_consensus.cc:2468] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:14.470779 25608 raft_consensus.cc:515] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.472836 25608 leader_election.cc:290] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:14.473594 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:14.474211 25683 raft_consensus.cc:3055] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.474457 25683 raft_consensus.cc:740] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:14.474601 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea769177a384320ad501d87ce229221" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:14.475268 25755 raft_consensus.cc:3060] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.475277 25683 consensus_queue.cc:260] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.476707 25683 raft_consensus.cc:3060] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.476254 25506 catalog_manager.cc:5697] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 1 to 2, leader changed from c8630952f9e84d32b0406fa391901bcf (127.14.45.3) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.482761 25755 raft_consensus.cc:2468] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:14.484192 25573 leader_election.cc:304] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:14.485071 25842 raft_consensus.cc:2804] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.485569 25842 raft_consensus.cc:697] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:14.486604 25842 consensus_queue.cc:237] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:14.485538 25683 raft_consensus.cc:2468] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:14.494058 25506 catalog_manager.cc:5697] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 1 to 2, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.697966 25608 raft_consensus.cc:1275] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.699369 25889 consensus_queue.cc:1048] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.711458 25755 raft_consensus.cc:1275] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.712922 25889 consensus_queue.cc:1048] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.718847 25758 raft_consensus.cc:1275] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.720134 25889 consensus_queue.cc:1048] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.731110 25608 raft_consensus.cc:1275] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.732401 25922 consensus_queue.cc:1048] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.822515 25608 raft_consensus.cc:1275] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.824059 25922 consensus_queue.cc:1048] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.833344 25755 raft_consensus.cc:1275] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.835048 25889 consensus_queue.cc:1048] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.871853 25683 raft_consensus.cc:1275] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.873111 25912 consensus_queue.cc:1048] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.882339 25755 raft_consensus.cc:1275] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.884089 25928 consensus_queue.cc:1048] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.953531 25755 raft_consensus.cc:1275] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:14.954879 25925 consensus_queue.cc:1048] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.963675 25608 raft_consensus.cc:1275] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:14.965548 25922 consensus_queue.cc:1048] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.976063 25755 raft_consensus.cc:1275] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.977259 25928 consensus_queue.cc:1048] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.986537 25683 raft_consensus.cc:1275] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.988082 25912 consensus_queue.cc:1048] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.007629 25755 raft_consensus.cc:1275] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:15.008865 25842 consensus_queue.cc:1048] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.018366 25683 raft_consensus.cc:1275] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:15.020741 25912 consensus_queue.cc:1048] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.153666 25505 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48990:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:17.156210 25505 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:17.213526 25592 tablet_service.cc:1511] Processing CreateTablet for tablet 14779ce5d070401ea05aa8aba2cff11d (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:17.214646 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 14779ce5d070401ea05aa8aba2cff11d (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:17.215741 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 14779ce5d070401ea05aa8aba2cff11d (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:17.216375 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14779ce5d070401ea05aa8aba2cff11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.217350 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14779ce5d070401ea05aa8aba2cff11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.219851 25666 tablet_service.cc:1511] Processing CreateTablet for tablet 1384e872d3384c91bfcbe6bb3a58417c (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:17.221367 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1384e872d3384c91bfcbe6bb3a58417c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.221444 25591 tablet_service.cc:1511] Processing CreateTablet for tablet 1384e872d3384c91bfcbe6bb3a58417c (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:17.223073 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1384e872d3384c91bfcbe6bb3a58417c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:17.226542 25555 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:17.231261 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14779ce5d070401ea05aa8aba2cff11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.232075 25740 tablet_service.cc:1511] Processing CreateTablet for tablet 1384e872d3384c91bfcbe6bb3a58417c (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:17.233590 25740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1384e872d3384c91bfcbe6bb3a58417c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.234335 25593 tablet_service.cc:1511] Processing CreateTablet for tablet fd6861693b9d49f9b76bad4f3bf87557 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:17.235707 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6861693b9d49f9b76bad4f3bf87557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.250249 25667 tablet_service.cc:1511] Processing CreateTablet for tablet fd6861693b9d49f9b76bad4f3bf87557 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:17.252046 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6861693b9d49f9b76bad4f3bf87557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.270438 25594 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb42cab73d414c8cbda1ee10a4c84e (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:17.271130 25742 tablet_service.cc:1511] Processing CreateTablet for tablet fd6861693b9d49f9b76bad4f3bf87557 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:17.272020 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb42cab73d414c8cbda1ee10a4c84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.272506 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6861693b9d49f9b76bad4f3bf87557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.291920 25948 tablet_bootstrap.cc:492] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
W20260709 13:10:17.286569 25648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:45905, user_credentials={real_user=slave}} blocked reactor thread for 57852us
I20260709 13:10:17.295454 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 20fceb11e2a04d6693fd7b1f74782b68 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:17.295861 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb42cab73d414c8cbda1ee10a4c84e (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:17.297325 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fceb11e2a04d6693fd7b1f74782b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.298774 25949 tablet_bootstrap.cc:492] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.297323 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb42cab73d414c8cbda1ee10a4c84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.297197 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb42cab73d414c8cbda1ee10a4c84e (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:17.301859 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb42cab73d414c8cbda1ee10a4c84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.312100 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 20fceb11e2a04d6693fd7b1f74782b68 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:17.314152 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fceb11e2a04d6693fd7b1f74782b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.321645 25591 tablet_service.cc:1511] Processing CreateTablet for tablet 6f159fe0d9aa499ebf56e97f7bd3dae7 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:17.322540 25667 tablet_service.cc:1511] Processing CreateTablet for tablet 20fceb11e2a04d6693fd7b1f74782b68 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:17.323066 25949 tablet_bootstrap.cc:654] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.323153 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f159fe0d9aa499ebf56e97f7bd3dae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.325006 25948 tablet_bootstrap.cc:654] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.332095 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fceb11e2a04d6693fd7b1f74782b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.336514 25740 tablet_service.cc:1511] Processing CreateTablet for tablet 6f159fe0d9aa499ebf56e97f7bd3dae7 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:17.337898 25740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f159fe0d9aa499ebf56e97f7bd3dae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.329358 25666 tablet_service.cc:1511] Processing CreateTablet for tablet 6f159fe0d9aa499ebf56e97f7bd3dae7 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:17.342761 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f159fe0d9aa499ebf56e97f7bd3dae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.353076 25671 tablet_service.cc:1511] Processing CreateTablet for tablet a0069be48410429892a99600cd6c46ee (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:17.354718 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0069be48410429892a99600cd6c46ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.355113 25746 tablet_service.cc:1511] Processing CreateTablet for tablet a0069be48410429892a99600cd6c46ee (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:17.356762 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0069be48410429892a99600cd6c46ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.358832 25594 tablet_service.cc:1511] Processing CreateTablet for tablet a0069be48410429892a99600cd6c46ee (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:17.366777 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0069be48410429892a99600cd6c46ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.369429 25950 tablet_bootstrap.cc:492] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.376010 25592 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:17.386583 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.377527 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:17.388250 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.394889 25591 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffe2f80fb374bcc8f404843a334d5f4 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:17.396273 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffe2f80fb374bcc8f404843a334d5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.380285 25949 tablet_bootstrap.cc:492] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.398135 25949 ts_tablet_manager.cc:1403] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.004s
I20260709 13:10:17.413246 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffe2f80fb374bcc8f404843a334d5f4 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:17.414659 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffe2f80fb374bcc8f404843a334d5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.407958 25949 raft_consensus.cc:359] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.417033 25949 raft_consensus.cc:385] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.417552 25949 raft_consensus.cc:740] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.418028 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:17.419442 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.418529 25949 consensus_queue.cc:260] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.416738 25742 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffe2f80fb374bcc8f404843a334d5f4 (DEFAULT_TABLE table=soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:17.426448 25950 tablet_bootstrap.cc:654] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.431075 25949 ts_tablet_manager.cc:1434] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:10:17.432906 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffe2f80fb374bcc8f404843a334d5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.423628 25948 tablet_bootstrap.cc:492] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.446334 25949 tablet_bootstrap.cc:492] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.455698 25949 tablet_bootstrap.cc:654] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.458494 25948 ts_tablet_manager.cc:1403] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.007s
I20260709 13:10:17.466044 25950 tablet_bootstrap.cc:492] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.466732 25950 ts_tablet_manager.cc:1403] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.007s
I20260709 13:10:17.467170 25948 raft_consensus.cc:359] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.468313 25948 raft_consensus.cc:385] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.468698 25948 raft_consensus.cc:740] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.470454 25948 consensus_queue.cc:260] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.472540 25950 raft_consensus.cc:359] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.473238 25948 ts_tablet_manager.cc:1434] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:17.473377 25950 raft_consensus.cc:385] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.473842 25950 raft_consensus.cc:740] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.474646 25948 tablet_bootstrap.cc:492] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.480798 25949 tablet_bootstrap.cc:492] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.481537 25949 ts_tablet_manager.cc:1403] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.003s
I20260709 13:10:17.483531 25948 tablet_bootstrap.cc:654] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.485175 25949 raft_consensus.cc:359] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.486151 25949 raft_consensus.cc:385] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.486496 25949 raft_consensus.cc:740] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.474597 25950 consensus_queue.cc:260] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.487571 25949 consensus_queue.cc:260] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.492290 25949 ts_tablet_manager.cc:1434] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:10:17.493413 25949 tablet_bootstrap.cc:492] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.494729 25950 ts_tablet_manager.cc:1434] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:10:17.495837 25950 tablet_bootstrap.cc:492] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.504791 25949 tablet_bootstrap.cc:654] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.510500 25950 tablet_bootstrap.cc:654] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.512246 25948 tablet_bootstrap.cc:492] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.512827 25948 ts_tablet_manager.cc:1403] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.023s
I20260709 13:10:17.516039 25950 tablet_bootstrap.cc:492] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.515920 25948 raft_consensus.cc:359] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.516597 25950 ts_tablet_manager.cc:1403] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:10:17.516675 25948 raft_consensus.cc:385] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.517205 25948 raft_consensus.cc:740] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.517956 25948 consensus_queue.cc:260] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.518806 25949 tablet_bootstrap.cc:492] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.519376 25949 ts_tablet_manager.cc:1403] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:10:17.519897 25950 raft_consensus.cc:359] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.520377 25948 ts_tablet_manager.cc:1434] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:17.520741 25950 raft_consensus.cc:385] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.521121 25950 raft_consensus.cc:740] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.521842 25948 tablet_bootstrap.cc:492] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.521958 25950 consensus_queue.cc:260] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.522635 25949 raft_consensus.cc:359] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.523442 25949 raft_consensus.cc:385] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.523738 25949 raft_consensus.cc:740] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.524693 25950 ts_tablet_manager.cc:1434] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:17.524540 25949 consensus_queue.cc:260] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.525760 25950 tablet_bootstrap.cc:492] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.531008 25948 tablet_bootstrap.cc:654] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.533340 25950 tablet_bootstrap.cc:654] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.534813 25949 ts_tablet_manager.cc:1434] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:17.541616 25889 raft_consensus.cc:493] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.542490 25889 raft_consensus.cc:515] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.544413 25949 tablet_bootstrap.cc:492] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.552093 25948 tablet_bootstrap.cc:492] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.552757 25948 ts_tablet_manager.cc:1403] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.004s
I20260709 13:10:17.553264 25949 tablet_bootstrap.cc:654] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.554399 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:17.555032 25755 raft_consensus.cc:2468] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.556326 25648 leader_election.cc:304] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:17.552714 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.557116 25947 raft_consensus.cc:2804] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.557507 25947 raft_consensus.cc:493] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.557904 25947 raft_consensus.cc:3060] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:17.558241 25650 leader_election.cc:343] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.558758 25950 tablet_bootstrap.cc:492] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.559528 25950 ts_tablet_manager.cc:1403] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.009s
I20260709 13:10:17.560042 25889 leader_election.cc:290] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.563800 25949 tablet_bootstrap.cc:492] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.563372 25950 raft_consensus.cc:359] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.556715 25948 raft_consensus.cc:359] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.564240 25950 raft_consensus.cc:385] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.564393 25949 ts_tablet_manager.cc:1403] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 13:10:17.564465 25948 raft_consensus.cc:385] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.564638 25950 raft_consensus.cc:740] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.565239 25948 raft_consensus.cc:740] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.565937 25950 consensus_queue.cc:260] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.564899 25947 raft_consensus.cc:515] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.566208 25948 consensus_queue.cc:260] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.568595 25950 ts_tablet_manager.cc:1434] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:10:17.569648 25948 ts_tablet_manager.cc:1434] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:17.569675 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:17.571267 25608 raft_consensus.cc:3060] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.571337 25949 raft_consensus.cc:359] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.572209 25949 raft_consensus.cc:385] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.572530 25949 raft_consensus.cc:740] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.569774 25950 tablet_bootstrap.cc:492] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.574131 25948 tablet_bootstrap.cc:492] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.573374 25949 consensus_queue.cc:260] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.581761 25948 tablet_bootstrap.cc:654] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.583396 25950 tablet_bootstrap.cc:654] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.592181 25608 raft_consensus.cc:2468] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.593818 25950 tablet_bootstrap.cc:492] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.595872 25950 ts_tablet_manager.cc:1403] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:10:17.594770 25650 leader_election.cc:304] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:17.597760 25948 tablet_bootstrap.cc:492] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.600092 25948 ts_tablet_manager.cc:1403] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.012s
I20260709 13:10:17.601025 25889 raft_consensus.cc:2804] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.603396 25948 raft_consensus.cc:359] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.604116 25948 raft_consensus.cc:385] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.604429 25948 raft_consensus.cc:740] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.605311 25948 consensus_queue.cc:260] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.606978 25947 leader_election.cc:290] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.609588 25950 raft_consensus.cc:359] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.610345 25950 raft_consensus.cc:385] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.610651 25950 raft_consensus.cc:740] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.611205 25947 raft_consensus.cc:493] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.611403 25950 consensus_queue.cc:260] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.611785 25947 raft_consensus.cc:515] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.612207 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:17.613116 25755 raft_consensus.cc:3060] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.614001 25950 ts_tablet_manager.cc:1434] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:17.607822 25948 ts_tablet_manager.cc:1434] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:17.615132 25948 tablet_bootstrap.cc:492] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.616451 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:17.617143 25758 raft_consensus.cc:2468] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.618599 25648 leader_election.cc:304] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:17.615132 25950 tablet_bootstrap.cc:492] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.620807 25947 leader_election.cc:290] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.621562 25947 raft_consensus.cc:2804] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.621969 25947 raft_consensus.cc:493] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.622308 25947 raft_consensus.cc:3060] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.622771 25948 tablet_bootstrap.cc:654] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.627059 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.627786 25608 raft_consensus.cc:2468] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.632725 25950 tablet_bootstrap.cc:654] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.637954 25755 raft_consensus.cc:2468] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.644510 25949 ts_tablet_manager.cc:1434] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.080s	user 0.034s	sys 0.023s
I20260709 13:10:17.644915 25947 raft_consensus.cc:515] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.649024 25949 tablet_bootstrap.cc:492] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.649312 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:17.649588 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:17.649977 25608 raft_consensus.cc:3060] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.650131 25755 raft_consensus.cc:3060] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.656599 25608 raft_consensus.cc:2468] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.657347 25889 raft_consensus.cc:697] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:17.658188 25949 tablet_bootstrap.cc:654] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.658036 25650 leader_election.cc:304] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:17.656599 25755 raft_consensus.cc:2468] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.658954 25961 raft_consensus.cc:2804] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.660567 25961 raft_consensus.cc:697] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:17.658954 25889 consensus_queue.cc:237] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.659576 25947 leader_election.cc:290] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.661927 25961 consensus_queue.cc:237] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.664574 25948 tablet_bootstrap.cc:492] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.664878 25964 raft_consensus.cc:493] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.665166 25948 ts_tablet_manager.cc:1403] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.014s
I20260709 13:10:17.665679 25964 raft_consensus.cc:515] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.667871 25950 tablet_bootstrap.cc:492] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.668479 25950 ts_tablet_manager.cc:1403] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.006s
I20260709 13:10:17.668869 25948 raft_consensus.cc:359] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.669591 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.669884 25948 raft_consensus.cc:385] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.670286 25948 raft_consensus.cc:740] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.670378 25608 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.671473 25948 consensus_queue.cc:260] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.672672 25650 leader_election.cc:304] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:17.674429 25948 ts_tablet_manager.cc:1434] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:17.675827 25948 tablet_bootstrap.cc:492] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.674209 25950 raft_consensus.cc:359] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.676833 25950 raft_consensus.cc:385] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.677606 25950 raft_consensus.cc:740] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.679008 25950 consensus_queue.cc:260] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.674326 25947 raft_consensus.cc:2804] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.681466 25947 raft_consensus.cc:493] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.681541 25964 leader_election.cc:290] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.681967 25947 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.683928 25948 tablet_bootstrap.cc:654] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.690296 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:17.691463 25755 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.696151 25948 tablet_bootstrap.cc:492] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.696352 25842 raft_consensus.cc:493] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.696774 25948 ts_tablet_manager.cc:1403] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:10:17.697191 25842 raft_consensus.cc:515] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.698714 25947 raft_consensus.cc:515] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.700831 25948 raft_consensus.cc:359] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.706516 25948 raft_consensus.cc:385] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.706884 25948 raft_consensus.cc:740] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.702790 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:17.703657 25950 ts_tablet_manager.cc:1434] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.004s
I20260709 13:10:17.705148 25949 tablet_bootstrap.cc:492] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.705750 25842 leader_election.cc:290] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.707423 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:17.707823 25948 consensus_queue.cc:260] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
W20260709 13:10:17.719889 25573 leader_election.cc:343] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:17.721053 25575 leader_election.cc:343] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.721544 25575 leader_election.cc:304] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991; no voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:17.711540 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:17.722674 25608 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.722951 25948 ts_tablet_manager.cc:1434] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:10:17.713652 25949 ts_tablet_manager.cc:1403] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.004s
I20260709 13:10:17.726387 25842 raft_consensus.cc:2749] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.726698 25949 raft_consensus.cc:359] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.727533 25949 raft_consensus.cc:385] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.727903 25949 raft_consensus.cc:740] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.728803 25949 consensus_queue.cc:260] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.713117 25947 leader_election.cc:290] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.714608 25950 tablet_bootstrap.cc:492] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.730625 25948 tablet_bootstrap.cc:492] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.714274 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:17.738463 25755 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.738519 25608 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.739868 25650 leader_election.cc:304] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:17.740748 25961 raft_consensus.cc:2804] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.741263 25961 raft_consensus.cc:697] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:17.742187 25948 tablet_bootstrap.cc:654] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.742156 25961 consensus_queue.cc:237] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.740177 25950 tablet_bootstrap.cc:654] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.745786 25755 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.749850 25949 ts_tablet_manager.cc:1434] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:10:17.751425 25949 tablet_bootstrap.cc:492] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.753594 25504 catalog_manager.cc:5697] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.756465 25950 tablet_bootstrap.cc:492] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.756922 25948 tablet_bootstrap.cc:492] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.757074 25950 ts_tablet_manager.cc:1403] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.009s
I20260709 13:10:17.757479 25948 ts_tablet_manager.cc:1403] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 13:10:17.759721 25949 tablet_bootstrap.cc:654] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.760807 25950 raft_consensus.cc:359] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.761901 25950 raft_consensus.cc:385] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.762320 25950 raft_consensus.cc:740] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.763387 25950 consensus_queue.cc:260] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.769440 25948 raft_consensus.cc:359] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.770315 25948 raft_consensus.cc:385] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.770646 25948 raft_consensus.cc:740] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.771739 25948 consensus_queue.cc:260] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.775451 25948 ts_tablet_manager.cc:1434] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:17.776873 25948 tablet_bootstrap.cc:492] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.782073 25950 ts_tablet_manager.cc:1434] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.004s
I20260709 13:10:17.783746 25950 tablet_bootstrap.cc:492] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.800027 25950 tablet_bootstrap.cc:654] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.804555 25948 tablet_bootstrap.cc:654] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.811753 25949 tablet_bootstrap.cc:492] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.812386 25949 ts_tablet_manager.cc:1403] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.025s
I20260709 13:10:17.818073 25950 tablet_bootstrap.cc:492] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.818595 25948 tablet_bootstrap.cc:492] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.818699 25950 ts_tablet_manager.cc:1403] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.012s
I20260709 13:10:17.819247 25948 ts_tablet_manager.cc:1403] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.005s
I20260709 13:10:17.818699 25949 raft_consensus.cc:359] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.820047 25949 raft_consensus.cc:385] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.820465 25949 raft_consensus.cc:740] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.821436 25949 consensus_queue.cc:260] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.822206 25950 raft_consensus.cc:359] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.822468 25948 raft_consensus.cc:359] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.823118 25950 raft_consensus.cc:385] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.823302 25948 raft_consensus.cc:385] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.823525 25950 raft_consensus.cc:740] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.823722 25948 raft_consensus.cc:740] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.824561 25950 consensus_queue.cc:260] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.824718 25948 consensus_queue.cc:260] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.825424 25504 catalog_manager.cc:5697] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.825462 25949 ts_tablet_manager.cc:1434] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:10:17.829334 25949 tablet_bootstrap.cc:492] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.827219 25950 ts_tablet_manager.cc:1434] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:17.827407 25948 ts_tablet_manager.cc:1434] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:17.827842 25933 raft_consensus.cc:493] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.831154 25933 raft_consensus.cc:515] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.831679 25948 tablet_bootstrap.cc:492] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: Bootstrap starting.
I20260709 13:10:17.832453 25950 tablet_bootstrap.cc:492] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.828483 25504 catalog_manager.cc:5697] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.833607 25933 leader_election.cc:290] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:17.840412 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.841281 25608 raft_consensus.cc:2468] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:17.841560 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:17.842348 25680 raft_consensus.cc:2468] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:17.842921 25950 tablet_bootstrap.cc:654] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.842736 25724 leader_election.cc:304] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:17.844715 25933 raft_consensus.cc:2804] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.845243 25933 raft_consensus.cc:493] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.845664 25933 raft_consensus.cc:3060] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.840509 25948 tablet_bootstrap.cc:654] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.844780 25949 tablet_bootstrap.cc:654] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.879053 25933 raft_consensus.cc:515] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.881923 25983 raft_consensus.cc:493] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.883188 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:17.884080 25608 raft_consensus.cc:3060] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.887455 25948 tablet_bootstrap.cc:492] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: No bootstrap required, opened a new log
I20260709 13:10:17.888275 25948 ts_tablet_manager.cc:1403] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.004s
I20260709 13:10:17.891045 25961 raft_consensus.cc:493] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.891913 25961 raft_consensus.cc:515] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.896245 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.897028 25961 leader_election.cc:290] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:17.897244 25606 raft_consensus.cc:2468] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.900148 25650 leader_election.cc:304] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:17.901582 25961 raft_consensus.cc:2804] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.902127 25961 raft_consensus.cc:493] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.902760 25961 raft_consensus.cc:3060] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.882853 25983 raft_consensus.cc:515] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.904170 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:17.904901 25986 raft_consensus.cc:493] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.905025 25755 raft_consensus.cc:2468] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:17.906481 25986 raft_consensus.cc:515] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.909538 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:17.909937 25949 tablet_bootstrap.cc:492] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:17.910027 25986 leader_election.cc:290] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:17.907768 25608 raft_consensus.cc:2468] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:17.910615 25949 ts_tablet_manager.cc:1403] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.020s
I20260709 13:10:17.912168 25948 raft_consensus.cc:359] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.916484 25948 raft_consensus.cc:385] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.906924 25983 leader_election.cc:290] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
W20260709 13:10:17.914041 25724 leader_election.cc:343] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.914733 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:17.915043 25950 tablet_bootstrap.cc:492] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:17.915450 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:17.910739 25933 leader_election.cc:290] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:17.912307 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.917608 25950 ts_tablet_manager.cc:1403] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.085s	user 0.038s	sys 0.037s
I20260709 13:10:17.917438 25683 raft_consensus.cc:3060] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.917621 25724 leader_election.cc:304] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:17.918184 25606 raft_consensus.cc:2468] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:17.915274 25949 raft_consensus.cc:359] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.919209 25949 raft_consensus.cc:385] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.919567 25949 raft_consensus.cc:740] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.920385 25949 consensus_queue.cc:260] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.920606 25950 raft_consensus.cc:359] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.921298 25950 raft_consensus.cc:385] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.921594 25950 raft_consensus.cc:740] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.921403 25680 raft_consensus.cc:2468] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:17.922361 25950 consensus_queue.cc:260] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.924671 25950 ts_tablet_manager.cc:1434] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:17.925702 25950 tablet_bootstrap.cc:492] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: Bootstrap starting.
I20260709 13:10:17.925530 25961 raft_consensus.cc:515] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.928293 25683 raft_consensus.cc:2468] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:17.928725 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:17.929401 25606 raft_consensus.cc:3060] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.916795 25948 raft_consensus.cc:740] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.929993 25724 leader_election.cc:304] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:17.930328 25948 consensus_queue.cc:260] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.932505 25948 ts_tablet_manager.cc:1434] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:10:17.935564 25950 tablet_bootstrap.cc:654] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.932453 25949 ts_tablet_manager.cc:1434] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:10:17.937292 25949 tablet_bootstrap.cc:492] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:17.945979 25986 raft_consensus.cc:2804] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.946084 25949 tablet_bootstrap.cc:654] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.948268 25933 raft_consensus.cc:2804] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.948722 25933 raft_consensus.cc:493] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.949111 25933 raft_consensus.cc:3060] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.950991 25606 raft_consensus.cc:2468] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:17.952368 25650 leader_election.cc:304] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:17.953229 25889 raft_consensus.cc:2804] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.953773 25889 raft_consensus.cc:697] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:17.953926 25724 leader_election.cc:304] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 8ee23bc024b44f419ece505101f72977
I20260709 13:10:17.916736 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:17.954715 25889 consensus_queue.cc:237] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:17.955470 25608 raft_consensus.cc:2468] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:17.978699 25989 raft_consensus.cc:2804] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.979259 25989 raft_consensus.cc:493] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.979646 25989 raft_consensus.cc:3060] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.996464 25986 raft_consensus.cc:697] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.002595 25986 consensus_queue.cc:237] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
W20260709 13:10:18.004984 25724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.1:38065, user_credentials={real_user=slave}} blocked reactor thread for 51139.4us
I20260709 13:10:18.008240 25961 leader_election.cc:290] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.016068 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.017458 25755 raft_consensus.cc:3060] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.023759 25504 catalog_manager.cc:5697] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.027122 25755 raft_consensus.cc:2468] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:18.029043 25989 raft_consensus.cc:515] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.032198 25949 tablet_bootstrap.cc:492] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:18.032779 25949 ts_tablet_manager.cc:1403] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.051s
I20260709 13:10:18.033022 25989 leader_election.cc:290] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:18.034997 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.035589 25608 raft_consensus.cc:3060] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.037803 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.039021 25933 raft_consensus.cc:515] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.039463 25949 raft_consensus.cc:359] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.039893 25950 tablet_bootstrap.cc:492] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: No bootstrap required, opened a new log
I20260709 13:10:18.040316 25949 raft_consensus.cc:385] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:18.040630 25949 raft_consensus.cc:740] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:18.041456 25949 consensus_queue.cc:260] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.040673 25950 ts_tablet_manager.cc:1403] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: Time spent bootstrapping tablet: real 0.115s	user 0.033s	sys 0.012s
W20260709 13:10:18.042125 25724 leader_election.cc:343] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:18.044193 25949 ts_tablet_manager.cc:1434] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:18.044309 25608 raft_consensus.cc:2468] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:18.045231 25949 tablet_bootstrap.cc:492] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: Bootstrap starting.
I20260709 13:10:18.045805 25724 leader_election.cc:304] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 8ee23bc024b44f419ece505101f72977
I20260709 13:10:18.048677 25933 leader_election.cc:290] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:18.050947 25950 raft_consensus.cc:359] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.051826 25950 raft_consensus.cc:385] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:18.052148 25950 raft_consensus.cc:740] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Initialized, Role: FOLLOWER
I20260709 13:10:18.052559 25949 tablet_bootstrap.cc:654] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:18.052868 25950 consensus_queue.cc:260] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.055384 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.056205 25608 raft_consensus.cc:3060] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.056883 25506 catalog_manager.cc:5697] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.055378 25950 ts_tablet_manager.cc:1434] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:18.061262 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.061964 25683 raft_consensus.cc:3060] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.067938 25683 raft_consensus.cc:2468] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:18.069500 25724 leader_election.cc:304] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:18.047689 25988 raft_consensus.cc:2804] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:18.070699 25933 raft_consensus.cc:2804] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:18.071240 25933 raft_consensus.cc:697] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.072160 25933 consensus_queue.cc:237] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.074416 25988 raft_consensus.cc:697] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.075460 25988 consensus_queue.cc:237] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.084250 25608 raft_consensus.cc:2468] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:18.086284 25961 consensus_queue.cc:1048] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.099557 25949 tablet_bootstrap.cc:492] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: No bootstrap required, opened a new log
I20260709 13:10:18.098850 25506 catalog_manager.cc:5697] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.100210 25949 ts_tablet_manager.cc:1403] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.015s
I20260709 13:10:18.100867 25506 catalog_manager.cc:5697] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.105008 25949 raft_consensus.cc:359] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.105907 25949 raft_consensus.cc:385] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:18.106218 25949 raft_consensus.cc:740] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Initialized, Role: FOLLOWER
I20260709 13:10:18.107095 25949 consensus_queue.cc:260] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.110765 25949 ts_tablet_manager.cc:1434] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:10:18.118093 25961 consensus_queue.cc:1048] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.141163 25961 consensus_queue.cc:1048] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.152454 25967 consensus_queue.cc:1048] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:18.211575 25988 raft_consensus.cc:493] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.212112 25988 raft_consensus.cc:515] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.214063 25988 leader_election.cc:290] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:18.214854 25967 raft_consensus.cc:493] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.215097 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe2f80fb374bcc8f404843a334d5f4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:18.215384 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe2f80fb374bcc8f404843a334d5f4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977" is_pre_election: true
I20260709 13:10:18.215766 25608 raft_consensus.cc:2468] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:18.215463 25967 raft_consensus.cc:515] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.216425 25683 raft_consensus.cc:2468] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 0.
I20260709 13:10:18.217048 25724 leader_election.cc:304] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:18.217908 25988 raft_consensus.cc:2804] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:18.218449 25988 raft_consensus.cc:493] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.218587 25967 leader_election.cc:290] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.218751 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:18.218948 25988 raft_consensus.cc:3060] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.219197 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:18.219451 25608 raft_consensus.cc:2468] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:18.219961 25758 raft_consensus.cc:2468] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 0.
I20260709 13:10:18.220810 25650 leader_election.cc:304] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.221923 25967 raft_consensus.cc:2804] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:18.222327 25967 raft_consensus.cc:493] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.222702 25967 raft_consensus.cc:3060] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.227689 25988 raft_consensus.cc:515] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.230208 25988 leader_election.cc:290] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:18.230971 25967 raft_consensus.cc:515] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
W20260709 13:10:18.232004 25555 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:18.233119 25967 leader_election.cc:290] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.233565 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe2f80fb374bcc8f404843a334d5f4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.233784 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe2f80fb374bcc8f404843a334d5f4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.234205 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.234315 25608 raft_consensus.cc:3060] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.234637 25683 raft_consensus.cc:3060] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.234921 25606 raft_consensus.cc:3060] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.238662 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.239389 25758 raft_consensus.cc:3060] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.240370 25608 raft_consensus.cc:2468] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:18.241590 25724 leader_election.cc:304] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:18.242317 25683 raft_consensus.cc:2468] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 1.
I20260709 13:10:18.242666 25988 raft_consensus.cc:2804] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:18.243367 25988 raft_consensus.cc:697] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.242928 25606 raft_consensus.cc:2468] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:18.244432 25988 consensus_queue.cc:237] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.245045 25650 leader_election.cc:304] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.246050 25967 raft_consensus.cc:2804] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:18.246552 25967 raft_consensus.cc:697] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.247445 25967 consensus_queue.cc:237] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.247912 25758 raft_consensus.cc:2468] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 1.
I20260709 13:10:18.254865 25506 catalog_manager.cc:5697] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 1 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.257321 25504 catalog_manager.cc:5697] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.264889 25889 consensus_queue.cc:1048] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.276408 25889 consensus_queue.cc:1048] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.393344 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:10:18.393872 25683 raft_consensus.cc:606] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:18.394620 25889 raft_consensus.cc:493] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.395277 25889 raft_consensus.cc:515] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.397423 25889 leader_election.cc:290] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.398226 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be37a832a2343ed8f586df2bb091991" is_pre_election: true
I20260709 13:10:18.398732 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8630952f9e84d32b0406fa391901bcf" is_pre_election: true
I20260709 13:10:18.399108 25606 raft_consensus.cc:2393] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ee23bc024b44f419ece505101f72977 in current term 1: Already voted for candidate c8630952f9e84d32b0406fa391901bcf in this term.
I20260709 13:10:18.399430 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:10:18.400000 25683 raft_consensus.cc:606] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:18.401638 25648 leader_election.cc:304] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ee23bc024b44f419ece505101f72977; no voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:18.402455 25889 raft_consensus.cc:3060] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.405360 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:10:18.406067 25683 raft_consensus.cc:606] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:18.409782 25889 raft_consensus.cc:2749] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:18.411811 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:10:18.412266 25683 raft_consensus.cc:606] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Received request to transfer leadership to TS 3be37a832a2343ed8f586df2bb091991
I20260709 13:10:18.417030 25758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:10:18.417512 25758 raft_consensus.cc:606] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:18.425720 25758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0069be48410429892a99600cd6c46ee"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:10:18.426309 25758 raft_consensus.cc:606] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:18.431636 25758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
mode: GRACEFUL
new_leader_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:10:18.432250 25758 raft_consensus.cc:606] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Received request to transfer leadership to TS 8ee23bc024b44f419ece505101f72977
I20260709 13:10:18.470518 25889 consensus_queue.cc:1048] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.480890 25967 consensus_queue.cc:1048] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.515146 25988 consensus_queue.cc:1048] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.526899 25986 consensus_queue.cc:1048] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.534693 25988 raft_consensus.cc:993] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:18.535172 25986 raft_consensus.cc:1081] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:18.536655 25683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0069be48410429892a99600cd6c46ee"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45018
I20260709 13:10:18.537106 25683 raft_consensus.cc:493] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.537390 25683 raft_consensus.cc:3060] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.542071 25683 raft_consensus.cc:515] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.543668 25683 leader_election.cc:290] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.544752 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.544925 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0069be48410429892a99600cd6c46ee" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.545387 25608 raft_consensus.cc:3060] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.545540 25755 raft_consensus.cc:3055] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.546092 25755 raft_consensus.cc:740] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.546844 25755 consensus_queue.cc:260] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.548048 25755 raft_consensus.cc:3060] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.551357 25986 consensus_queue.cc:1048] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.552939 25608 raft_consensus.cc:2468] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:18.554167 25650 leader_election.cc:304] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.554608 25755 raft_consensus.cc:2468] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:18.555047 25967 raft_consensus.cc:2804] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.555727 25967 raft_consensus.cc:697] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.556692 25967 consensus_queue.cc:237] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.567579 25504 catalog_manager.cc:5697] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 1 to 2, leader changed from c8630952f9e84d32b0406fa391901bcf (127.14.45.3) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.569957 25988 consensus_queue.cc:1048] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:18.574986 25988 consensus_queue.cc:1048] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.577951 25986 raft_consensus.cc:993] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:18.578441 25988 raft_consensus.cc:1081] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:18.581930 25683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45018
I20260709 13:10:18.582492 25683 raft_consensus.cc:493] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.582844 25683 raft_consensus.cc:3060] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.590073 25683 raft_consensus.cc:515] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.591992 25933 consensus_queue.cc:1048] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.592994 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.593609 25608 raft_consensus.cc:3060] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.601198 25989 raft_consensus.cc:993] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: : Instructing follower 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:18.601845 25989 raft_consensus.cc:1081] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Signalling peer 8ee23bc024b44f419ece505101f72977 to start an election
I20260709 13:10:18.601257 25608 raft_consensus.cc:2468] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:18.603627 25680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
 from {username='slave'} at 127.0.0.1:45018
I20260709 13:10:18.604147 25680 raft_consensus.cc:493] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.604326 25683 leader_election.cc:290] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.604852 25680 raft_consensus.cc:3060] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.605723 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fceb11e2a04d6693fd7b1f74782b68" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.606331 25755 raft_consensus.cc:3055] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.606639 25755 raft_consensus.cc:740] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.607573 25755 consensus_queue.cc:260] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.606516 25650 leader_election.cc:304] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.610102 25947 raft_consensus.cc:2804] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.610549 25947 raft_consensus.cc:697] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.610666 25889 raft_consensus.cc:993] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.611261 25889 raft_consensus.cc:1081] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.611467 25947 consensus_queue.cc:237] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.612584 25755 raft_consensus.cc:3060] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.612433 25680 raft_consensus.cc:515] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.619776 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60280
I20260709 13:10:18.620123 25755 raft_consensus.cc:2468] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:18.620415 25608 raft_consensus.cc:493] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.620863 25608 raft_consensus.cc:3060] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.623907 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:18.624588 25605 raft_consensus.cc:3060] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.627583 25680 leader_election.cc:290] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.628032 25608 raft_consensus.cc:515] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.630770 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.631304 25683 raft_consensus.cc:3055] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.631632 25683 raft_consensus.cc:740] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.624626 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0b8f7ad6dc4b809c2acd995cd39f5f" candidate_uuid: "8ee23bc024b44f419ece505101f72977" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.632266 25755 raft_consensus.cc:3055] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.632588 25755 raft_consensus.cc:740] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:18.632339 25683 consensus_queue.cc:260] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.633477 25683 raft_consensus.cc:3060] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.634785 25605 raft_consensus.cc:2468] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:18.633296 25755 consensus_queue.cc:260] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.636472 25505 catalog_manager.cc:5697] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 1 to 2, leader changed from c8630952f9e84d32b0406fa391901bcf (127.14.45.3) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.637985 25755 raft_consensus.cc:3060] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.638248 25650 leader_election.cc:304] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.639135 25947 raft_consensus.cc:2804] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.639688 25947 raft_consensus.cc:697] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Leader. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.640364 25947 consensus_queue.cc:237] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.642169 25683 raft_consensus.cc:2468] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.642271 25608 leader_election.cc:290] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.644644 25755 raft_consensus.cc:2468] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ee23bc024b44f419ece505101f72977 in term 2.
I20260709 13:10:18.647531 25575 leader_election.cc:304] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.647845 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384e872d3384c91bfcbe6bb3a58417c" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.648404 25842 raft_consensus.cc:2804] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.648681 25755 raft_consensus.cc:3060] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.649055 25842 raft_consensus.cc:697] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:18.650012 25842 consensus_queue.cc:237] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.655695 25755 raft_consensus.cc:2468] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.657687 25505 catalog_manager.cc:5697] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 reported cstate change: term changed from 1 to 2, leader changed from c8630952f9e84d32b0406fa391901bcf (127.14.45.3) to 8ee23bc024b44f419ece505101f72977 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "8ee23bc024b44f419ece505101f72977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.658344 25504 catalog_manager.cc:5697] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 1 to 2, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.678342 25947 raft_consensus.cc:993] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.678855 25961 raft_consensus.cc:1081] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.680661 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60280
I20260709 13:10:18.681164 25605 raft_consensus.cc:493] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.681501 25605 raft_consensus.cc:3060] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.687266 25605 raft_consensus.cc:515] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.689052 25605 leader_election.cc:290] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.689934 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.690111 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14779ce5d070401ea05aa8aba2cff11d" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.690546 25683 raft_consensus.cc:3055] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.690805 25755 raft_consensus.cc:3060] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.690918 25683 raft_consensus.cc:740] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.691741 25683 consensus_queue.cc:260] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.692598 25683 raft_consensus.cc:3060] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.695897 25755 raft_consensus.cc:2468] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.697019 25573 leader_election.cc:304] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:18.697690 25683 raft_consensus.cc:2468] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.697717 25842 raft_consensus.cc:2804] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.698431 25842 raft_consensus.cc:697] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:18.699182 25842 consensus_queue.cc:237] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.706908 25504 catalog_manager.cc:5697] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 1 to 2, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.736970 25961 consensus_queue.cc:1048] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.744139 25947 raft_consensus.cc:993] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.744630 25889 raft_consensus.cc:1081] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.746299 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60280
I20260709 13:10:18.746843 25608 raft_consensus.cc:493] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.747258 25608 raft_consensus.cc:3060] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.750046 25947 consensus_queue.cc:1048] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.754482 25608 raft_consensus.cc:515] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.757256 25605 raft_consensus.cc:1240] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Rejecting Update request from peer 8ee23bc024b44f419ece505101f72977 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:18.759609 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.760407 25758 raft_consensus.cc:3060] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.757526 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb42cab73d414c8cbda1ee10a4c84e" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.762051 25683 raft_consensus.cc:3055] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.762480 25683 raft_consensus.cc:740] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.762079 25608 leader_election.cc:290] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.763368 25683 consensus_queue.cc:260] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.765689 25683 raft_consensus.cc:3060] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.769196 25758 raft_consensus.cc:2468] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
W20260709 13:10:18.769816 25947 consensus_queue.cc:1175] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3be37a832a2343ed8f586df2bb091991" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8ee23bc024b44f419ece505101f72977 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:18.770720 25573 leader_election.cc:304] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:18.771451 25842 raft_consensus.cc:2804] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.771904 25842 raft_consensus.cc:697] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:18.772717 25842 consensus_queue.cc:237] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.774196 25683 raft_consensus.cc:2468] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.779608 25504 catalog_manager.cc:5697] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 1 to 2, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.784864 25989 consensus_queue.cc:1048] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.795873 25989 consensus_queue.cc:1048] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.798163 25889 raft_consensus.cc:993] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: : Instructing follower 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.798676 25889 raft_consensus.cc:1081] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Signalling peer 3be37a832a2343ed8f586df2bb091991 to start an election
I20260709 13:10:18.800287 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
 from {username='slave'} at 127.0.0.1:60280
I20260709 13:10:18.800776 25608 raft_consensus.cc:493] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.801141 25608 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.808043 25608 raft_consensus.cc:515] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.810371 25608 leader_election.cc:290] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Requested vote from peers 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755), c8630952f9e84d32b0406fa391901bcf (127.14.45.3:45905)
I20260709 13:10:18.810766 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:18.810933 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "3be37a832a2343ed8f586df2bb091991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
I20260709 13:10:18.811446 25683 raft_consensus.cc:3055] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.811569 25758 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.811820 25683 raft_consensus.cc:740] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:18.812619 25683 consensus_queue.cc:260] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.813786 25683 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.818681 25683 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.818789 25758 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be37a832a2343ed8f586df2bb091991 in term 2.
I20260709 13:10:18.819665 25575 leader_election.cc:304] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, 8ee23bc024b44f419ece505101f72977; no voters: 
I20260709 13:10:18.820473 25842 raft_consensus.cc:2804] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.821031 25842 raft_consensus.cc:697] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Leader. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:18.821728 25842 consensus_queue.cc:237] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:18.828311 25504 catalog_manager.cc:5697] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 reported cstate change: term changed from 1 to 2, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to 3be37a832a2343ed8f586df2bb091991 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "3be37a832a2343ed8f586df2bb091991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.083994 25683 raft_consensus.cc:1275] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.085208 25842 consensus_queue.cc:1048] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.089512 25608 raft_consensus.cc:1275] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.091555 25947 consensus_queue.cc:1048] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.094738 25755 raft_consensus.cc:1275] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.097681 26020 consensus_queue.cc:1048] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:19.106638 25755 raft_consensus.cc:1275] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.107920 25961 consensus_queue.cc:1048] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.117252 25755 raft_consensus.cc:1275] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.118912 25842 consensus_queue.cc:1048] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.133855 25683 raft_consensus.cc:1275] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.135246 26020 consensus_queue.cc:1048] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.138379 25755 raft_consensus.cc:1275] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.139870 25961 consensus_queue.cc:1048] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.148274 25608 raft_consensus.cc:1275] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.150141 25961 consensus_queue.cc:1048] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.179693 25608 raft_consensus.cc:1275] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.180967 25961 consensus_queue.cc:1048] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.188921 25755 raft_consensus.cc:1275] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 8ee23bc024b44f419ece505101f72977: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.191699 25758 raft_consensus.cc:1275] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.191883 25967 consensus_queue.cc:1048] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:19.192857 25683 raft_consensus.cc:1275] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.193331 26022 consensus_queue.cc:1048] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.194274 26020 consensus_queue.cc:1048] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.240274 25683 raft_consensus.cc:1275] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.241756 26020 consensus_queue.cc:1048] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.250203 25755 raft_consensus.cc:1275] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Refusing update from remote peer 3be37a832a2343ed8f586df2bb091991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.251777 25972 consensus_queue.cc:1048] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.439586 25506 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48990:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:21.458724 25506 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48990:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:21.537567 14516 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:21.723747 26064 tablet.cc:1724] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.770462 26073 tablet.cc:1724] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.770327 26071 tablet.cc:1724] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.780732 26076 tablet.cc:1724] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:21.831073 25635 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1384e872d3384c91bfcbe6bb3a58417c)
W20260709 13:10:21.839813 26063 log.cc:927] Time spent T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:10:21.855098 26082 tablet.cc:1724] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:21.859652 25635 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1384e872d3384c91bfcbe6bb3a58417c)
W20260709 13:10:21.867259 25635 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1384e872d3384c91bfcbe6bb3a58417c)
W20260709 13:10:21.878648 26074 log.cc:927] Time spent T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:10:21.881603 26079 log.cc:927] Time spent T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:10:21.886487 26067 log.cc:927] Time spent T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
W20260709 13:10:21.888262 26075 log.cc:927] Time spent T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: Append to log took a long time: real 0.100s	user 0.004s	sys 0.000s
W20260709 13:10:21.891956 26069 log.cc:927] Time spent T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:10:21.889259 26077 tablet.cc:1724] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:21.913800 26084 log.cc:927] Time spent T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
I20260709 13:10:21.909612 26064 tablet.cc:1724] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.917253 26073 tablet.cc:1724] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.914089 26087 tablet.cc:1724] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.924535 26082 tablet.cc:1724] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.912890 26085 tablet.cc:1724] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.937984 26071 tablet.cc:1724] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.946182 26093 tablet.cc:1724] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.946628 26088 tablet.cc:1724] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.925086 26091 tablet.cc:1724] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.951730 26073 tablet.cc:1724] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.953266 26092 tablet.cc:1724] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.961473 26085 tablet.cc:1724] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:21.969602 26088 tablet.cc:1724] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.020197 25684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:51218
I20260709 13:10:22.022239 25684 raft_consensus.cc:606] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Received request to transfer leadership to TS c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:22.037462 26087 tablet.cc:1724] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.040365 26073 tablet.cc:1724] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.055576 26077 tablet.cc:1724] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.065855 26085 tablet.cc:1724] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.080909 26064 tablet.cc:1724] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.086126 26076 tablet.cc:1724] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.089870 25506 catalog_manager.cc:5789] TS 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755) does not have the latest schema for tablet 9a0b8f7ad6dc4b809c2acd995cd39f5f (table soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]). Expected version 1 got 0
I20260709 13:10:22.091084 25506 catalog_manager.cc:5789] TS 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755) does not have the latest schema for tablet 20fceb11e2a04d6693fd7b1f74782b68 (table soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf]). Expected version 1 got 0
I20260709 13:10:22.105942 26091 tablet.cc:1724] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.103746 26088 tablet.cc:1724] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:22.130970 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
mode: GRACEFUL
new_leader_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:53962
I20260709 13:10:22.131815 25608 raft_consensus.cc:606] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Received request to transfer leadership to TS c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:22.133641 14516 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:22.135315 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.147280 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4"
dest_uuid: "3be37a832a2343ed8f586df2bb091991"
mode: GRACEFUL
new_leader_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:53962
I20260709 13:10:22.147958 25608 raft_consensus.cc:606] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 LEADER]: Received request to transfer leadership to TS c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:22.150723 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c"
dest_uuid: "8ee23bc024b44f419ece505101f72977"
mode: GRACEFUL
new_leader_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:51218
I20260709 13:10:22.151401 25683 raft_consensus.cc:606] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Received request to transfer leadership to TS c8630952f9e84d32b0406fa391901bcf
I20260709 13:10:22.153674 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:22.154347 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:22.164381 25504 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44: soft_deleted_table [id=81cc710680af40289a7bb0af7a599ddf] alter complete (version 1)
I20260709 13:10:22.263417 26022 raft_consensus.cc:993] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: : Instructing follower c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.263975 26048 raft_consensus.cc:1081] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 LEADER]: Signalling peer c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.265543 25753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:58380
I20260709 13:10:22.266090 25753 raft_consensus.cc:493] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.266381 25753 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.273219 25753 raft_consensus.cc:515] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.275470 25753 leader_election.cc:290] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 4 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:22.276706 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:22.277345 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e87e2309b84161ac6c20a13561d4d4" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:22.277535 25684 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.278069 25608 raft_consensus.cc:3055] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:22.278447 25608 raft_consensus.cc:740] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:22.279417 25608 consensus_queue.cc:260] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.281904 25608 raft_consensus.cc:3060] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.286513 25684 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 4.
I20260709 13:10:22.288122 25724 leader_election.cc:304] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:22.289126 26024 raft_consensus.cc:2804] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:22.289551 25608 raft_consensus.cc:2468] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 4.
I20260709 13:10:22.289561 26024 raft_consensus.cc:697] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 4 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:22.291019 26024 consensus_queue.cc:237] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.299914 25504 catalog_manager.cc:5697] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 3 to 4, leader changed from 3be37a832a2343ed8f586df2bb091991 (127.14.45.1) to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 4 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.371155 26022 raft_consensus.cc:993] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: : Instructing follower c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.371601 26022 raft_consensus.cc:1081] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Signalling peer c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.373260 25750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:58380
I20260709 13:10:22.373853 25750 raft_consensus.cc:493] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.374171 25750 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.381500 25750 raft_consensus.cc:515] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.383205 25750 leader_election.cc:290] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 3 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:22.384043 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:22.384677 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6861693b9d49f9b76bad4f3bf87557" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:22.385221 25608 raft_consensus.cc:3055] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.385362 25684 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.385618 25608 raft_consensus.cc:740] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3be37a832a2343ed8f586df2bb091991, State: Running, Role: LEADER
I20260709 13:10:22.387156 25608 consensus_queue.cc:260] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.389520 25608 raft_consensus.cc:3060] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.394757 25684 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 3.
I20260709 13:10:22.396399 25724 leader_election.cc:304] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ee23bc024b44f419ece505101f72977, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:22.397337 26024 raft_consensus.cc:2804] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.397573 25608 raft_consensus.cc:2468] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 3.
I20260709 13:10:22.397866 26024 raft_consensus.cc:697] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 3 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:22.398939 26024 consensus_queue.cc:237] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.406330 25504 catalog_manager.cc:5697] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 2 to 3, leader changed from 3be37a832a2343ed8f586df2bb091991 (127.14.45.1) to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.487627 26072 raft_consensus.cc:993] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: : Instructing follower c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.488148 26060 raft_consensus.cc:1081] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Signalling peer c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.489785 25750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:58394
I20260709 13:10:22.490314 25750 raft_consensus.cc:493] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.490640 25750 raft_consensus.cc:3060] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.496354 25750 raft_consensus.cc:515] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.498306 25750 leader_election.cc:290] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 2 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:22.498872 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:22.499339 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f159fe0d9aa499ebf56e97f7bd3dae7" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:22.499538 25608 raft_consensus.cc:3060] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.499923 25684 raft_consensus.cc:3055] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:22.500222 25684 raft_consensus.cc:740] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:22.500959 25684 consensus_queue.cc:260] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.502230 25684 raft_consensus.cc:3060] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.505697 25608 raft_consensus.cc:2468] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 2.
I20260709 13:10:22.506956 25724 leader_election.cc:304] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:22.507743 26024 raft_consensus.cc:2804] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.508177 26024 raft_consensus.cc:697] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:22.508919 25684 raft_consensus.cc:2468] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 2.
I20260709 13:10:22.508965 26024 consensus_queue.cc:237] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.516314 25504 catalog_manager.cc:5697] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 1 to 2, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 2 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.681082 25609 raft_consensus.cc:1275] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 4 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:22.682634 26024 consensus_queue.cc:1048] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.693107 25684 raft_consensus.cc:1275] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 4 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:22.695197 26059 consensus_queue.cc:1048] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.763975 26072 raft_consensus.cc:993] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: : Instructing follower c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.764473 26060 raft_consensus.cc:1081] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Signalling peer c8630952f9e84d32b0406fa391901bcf to start an election
I20260709 13:10:22.766355 25750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c"
dest_uuid: "c8630952f9e84d32b0406fa391901bcf"
 from {username='slave'} at 127.0.0.1:58394
I20260709 13:10:22.766839 25750 raft_consensus.cc:493] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.767156 25750 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.772655 25750 raft_consensus.cc:515] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.774250 25750 leader_election.cc:290] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 3 election: Requested vote from peers 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065), 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755)
I20260709 13:10:22.775559 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be37a832a2343ed8f586df2bb091991"
I20260709 13:10:22.775612 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ed59ba18e64316853c58eb1fe8ad5c" candidate_uuid: "c8630952f9e84d32b0406fa391901bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ee23bc024b44f419ece505101f72977"
I20260709 13:10:22.776252 25609 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.776347 25684 raft_consensus.cc:3055] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.776811 25684 raft_consensus.cc:740] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ee23bc024b44f419ece505101f72977, State: Running, Role: LEADER
I20260709 13:10:22.777705 25684 consensus_queue.cc:260] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.779230 25684 raft_consensus.cc:3060] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.782778 25609 raft_consensus.cc:2468] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 3.
I20260709 13:10:22.783949 25724 leader_election.cc:304] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be37a832a2343ed8f586df2bb091991, c8630952f9e84d32b0406fa391901bcf; no voters: 
I20260709 13:10:22.784807 25684 raft_consensus.cc:2468] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8630952f9e84d32b0406fa391901bcf in term 3.
I20260709 13:10:22.784828 26059 raft_consensus.cc:2804] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.785519 26059 raft_consensus.cc:697] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 3 LEADER]: Becoming Leader. State: Replica: c8630952f9e84d32b0406fa391901bcf, State: Running, Role: LEADER
I20260709 13:10:22.786744 26059 consensus_queue.cc:237] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } }
I20260709 13:10:22.794235 25506 catalog_manager.cc:5697] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf reported cstate change: term changed from 2 to 3, leader changed from 8ee23bc024b44f419ece505101f72977 (127.14.45.2) to c8630952f9e84d32b0406fa391901bcf (127.14.45.3). New cstate: current_term: 3 leader_uuid: "c8630952f9e84d32b0406fa391901bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8630952f9e84d32b0406fa391901bcf" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 45905 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.884634 25684 raft_consensus.cc:1275] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:22.885910 26059 consensus_queue.cc:1048] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:22.897557 25609 raft_consensus.cc:1275] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:22.900388 26107 consensus_queue.cc:1048] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:22.998085 25609 raft_consensus.cc:1275] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:22.999419 26107 consensus_queue.cc:1048] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.008927 25684 raft_consensus.cc:1275] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:23.011328 26106 consensus_queue.cc:1048] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:23.169440 25609 raft_consensus.cc:1275] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.170753 26106 consensus_queue.cc:1048] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be37a832a2343ed8f586df2bb091991" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.185901 25684 raft_consensus.cc:1275] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Refusing update from remote peer c8630952f9e84d32b0406fa391901bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.187551 26106 consensus_queue.cc:1048] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ee23bc024b44f419ece505101f72977" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:23.227159 14516 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:23.233182 14516 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:23.233634 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.238489 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:23.238894 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.272167 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
I20260709 13:10:24.302281 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:24.303285 14516 tablet_replica.cc:333] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.304049 14516 raft_consensus.cc:2243] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.304607 14516 raft_consensus.cc:2272] T 3ffe2f80fb374bcc8f404843a334d5f4 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.306952 14516 tablet_replica.cc:333] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.307646 14516 raft_consensus.cc:2243] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.308156 14516 raft_consensus.cc:2272] T a0069be48410429892a99600cd6c46ee P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.310191 14516 tablet_replica.cc:333] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.310791 14516 raft_consensus.cc:2243] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.311261 14516 raft_consensus.cc:2272] T 20fceb11e2a04d6693fd7b1f74782b68 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.313215 14516 tablet_replica.cc:333] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.313870 14516 raft_consensus.cc:2243] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.314720 14516 raft_consensus.cc:2272] T 87cb42cab73d414c8cbda1ee10a4c84e P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.317044 14516 tablet_replica.cc:333] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.317720 14516 raft_consensus.cc:2243] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.318302 14516 raft_consensus.cc:2272] T 86ed59ba18e64316853c58eb1fe8ad5c P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.320454 14516 tablet_replica.cc:333] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.321063 14516 raft_consensus.cc:2243] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.321602 14516 raft_consensus.cc:2272] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.323979 14516 tablet_replica.cc:333] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.324620 14516 raft_consensus.cc:2243] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.325695 14516 raft_consensus.cc:2272] T 1384e872d3384c91bfcbe6bb3a58417c P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.328104 14516 tablet_replica.cc:333] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.328749 14516 raft_consensus.cc:2243] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.329222 14516 raft_consensus.cc:2272] T df8a849878604c938fb5b2981c1d029a P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.331611 14516 tablet_replica.cc:333] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.332273 14516 raft_consensus.cc:2243] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.332759 14516 raft_consensus.cc:2272] T b04aee67a4664365aa0bfb44a5ce8420 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.335338 14516 tablet_replica.cc:333] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.335965 14516 raft_consensus.cc:2243] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.336397 14516 raft_consensus.cc:2272] T fd6861693b9d49f9b76bad4f3bf87557 P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.339283 14516 tablet_replica.cc:333] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.339854 14516 raft_consensus.cc:2243] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.340276 14516 raft_consensus.cc:2272] T 09e87e2309b84161ac6c20a13561d4d4 P 3be37a832a2343ed8f586df2bb091991 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.343152 14516 tablet_replica.cc:333] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.343750 14516 raft_consensus.cc:2243] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.344260 14516 raft_consensus.cc:2272] T f87ef76e38824eb39fb6e7d442c8d89f P 3be37a832a2343ed8f586df2bb091991 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.346926 14516 tablet_replica.cc:333] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.347668 14516 raft_consensus.cc:2243] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.348661 14516 raft_consensus.cc:2272] T 14779ce5d070401ea05aa8aba2cff11d P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:24.350247 25650 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:10:24.352608 14516 tablet_replica.cc:333] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.353626 14516 raft_consensus.cc:2243] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:24.354075 25650 consensus_peers.cc:597] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.354818 14516 raft_consensus.cc:2272] T 65e31358a4b64d779e89d4029a7161aa P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.357375 14516 tablet_replica.cc:333] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.358068 14516 raft_consensus.cc:2243] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.359032 14516 raft_consensus.cc:2272] T 0f074e6849ac4a0b99df84f26fe15072 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.361485 14516 tablet_replica.cc:333] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.362073 14516 raft_consensus.cc:2243] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.362586 14516 raft_consensus.cc:2272] T d83306074cc9408baf3602d8eba574b2 P 3be37a832a2343ed8f586df2bb091991 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.364835 14516 tablet_replica.cc:333] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.365406 14516 raft_consensus.cc:2243] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.366037 14516 raft_consensus.cc:2272] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.368216 14516 tablet_replica.cc:333] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991: stopping tablet replica
I20260709 13:10:24.368894 14516 raft_consensus.cc:2243] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.370083 14516 raft_consensus.cc:2272] T 5ea769177a384320ad501d87ce229221 P 3be37a832a2343ed8f586df2bb091991 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:24.396862 25650 consensus_peers.cc:597] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.417855 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
W20260709 13:10:24.433135 25650 consensus_peers.cc:597] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.433987 25650 consensus_peers.cc:597] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.440217 25724 consensus_peers.cc:597] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.450022 25724 consensus_peers.cc:597] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.463291 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
W20260709 13:10:24.494854 25724 consensus_peers.cc:597] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf -> Peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Couldn't send request to peer 8ee23bc024b44f419ece505101f72977. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.497205 25724 consensus_peers.cc:597] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.498744 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:24.499696 14516 tablet_replica.cc:333] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.500587 14516 raft_consensus.cc:2243] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.501470 14516 raft_consensus.cc:2272] T a0069be48410429892a99600cd6c46ee P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.503711 14516 tablet_replica.cc:333] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.504379 14516 raft_consensus.cc:2243] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.504830 14516 raft_consensus.cc:2272] T 3ffe2f80fb374bcc8f404843a334d5f4 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.507406 14516 tablet_replica.cc:333] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.507968 14516 raft_consensus.cc:2243] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.508693 14516 raft_consensus.cc:2272] T 87cb42cab73d414c8cbda1ee10a4c84e P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.510979 14516 tablet_replica.cc:333] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.511559 14516 raft_consensus.cc:2243] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.512362 14516 raft_consensus.cc:2272] T 20fceb11e2a04d6693fd7b1f74782b68 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.514595 14516 tablet_replica.cc:333] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.515143 14516 raft_consensus.cc:2243] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.515537 14516 raft_consensus.cc:2272] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.517660 14516 tablet_replica.cc:333] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.518340 14516 raft_consensus.cc:2243] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.519179 14516 raft_consensus.cc:2272] T df8a849878604c938fb5b2981c1d029a P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.521441 14516 tablet_replica.cc:333] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.522117 14516 raft_consensus.cc:2243] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.522617 14516 raft_consensus.cc:2272] T 1384e872d3384c91bfcbe6bb3a58417c P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.524787 14516 tablet_replica.cc:333] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.525324 14516 raft_consensus.cc:2243] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.525728 14516 raft_consensus.cc:2272] T 86ed59ba18e64316853c58eb1fe8ad5c P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.527872 14516 tablet_replica.cc:333] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.528396 14516 raft_consensus.cc:2243] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.528918 14516 raft_consensus.cc:2272] T 14779ce5d070401ea05aa8aba2cff11d P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.531054 14516 tablet_replica.cc:333] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.531598 14516 raft_consensus.cc:2243] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.532024 14516 raft_consensus.cc:2272] T 65e31358a4b64d779e89d4029a7161aa P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.534482 14516 tablet_replica.cc:333] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.535049 14516 raft_consensus.cc:2243] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.535606 14516 raft_consensus.cc:2272] T 0f074e6849ac4a0b99df84f26fe15072 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:24.537326 25724 consensus_peers.cc:597] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf -> Peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Couldn't send request to peer 8ee23bc024b44f419ece505101f72977. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.538308 14516 tablet_replica.cc:333] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.539019 14516 raft_consensus.cc:2243] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.539539 14516 raft_consensus.cc:2272] T d83306074cc9408baf3602d8eba574b2 P 8ee23bc024b44f419ece505101f72977 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.542634 14516 tablet_replica.cc:333] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.543466 14516 raft_consensus.cc:2243] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.544639 14516 raft_consensus.cc:2272] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:24.545920 25724 consensus_peers.cc:597] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.547756 25650 consensus_peers.cc:597] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.547865 14516 tablet_replica.cc:333] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.548632 14516 raft_consensus.cc:2243] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.549185 14516 raft_consensus.cc:2272] T 5ea769177a384320ad501d87ce229221 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.551419 14516 tablet_replica.cc:333] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.552024 14516 raft_consensus.cc:2243] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.552559 14516 raft_consensus.cc:2272] T fd6861693b9d49f9b76bad4f3bf87557 P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.554771 14516 tablet_replica.cc:333] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.555331 14516 raft_consensus.cc:2243] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.556218 14516 raft_consensus.cc:2272] T b04aee67a4664365aa0bfb44a5ce8420 P 8ee23bc024b44f419ece505101f72977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.558431 14516 tablet_replica.cc:333] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.558990 14516 raft_consensus.cc:2243] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.559913 14516 raft_consensus.cc:2272] T f87ef76e38824eb39fb6e7d442c8d89f P 8ee23bc024b44f419ece505101f72977 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.562235 14516 tablet_replica.cc:333] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977: stopping tablet replica
I20260709 13:10:24.562767 14516 raft_consensus.cc:2243] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.563198 14516 raft_consensus.cc:2272] T 09e87e2309b84161ac6c20a13561d4d4 P 8ee23bc024b44f419ece505101f72977 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:24.588639 25724 consensus_peers.cc:597] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf -> Peer 3be37a832a2343ed8f586df2bb091991 (127.14.45.1:38065): Couldn't send request to peer 3be37a832a2343ed8f586df2bb091991. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.607590 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
I20260709 13:10:24.646111 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
W20260709 13:10:24.660938 25724 consensus_peers.cc:597] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf -> Peer 8ee23bc024b44f419ece505101f72977 (127.14.45.2:41755): Couldn't send request to peer 8ee23bc024b44f419ece505101f72977. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:41755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.683430 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:24.684381 14516 tablet_replica.cc:333] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.685091 14516 raft_consensus.cc:2243] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.686048 14516 raft_consensus.cc:2272] T 3ffe2f80fb374bcc8f404843a334d5f4 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.688228 14516 tablet_replica.cc:333] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.688865 14516 raft_consensus.cc:2243] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.689357 14516 raft_consensus.cc:2272] T 87cb42cab73d414c8cbda1ee10a4c84e P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.691497 14516 tablet_replica.cc:333] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.692070 14516 raft_consensus.cc:2243] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.692541 14516 raft_consensus.cc:2272] T a0069be48410429892a99600cd6c46ee P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.694792 14516 tablet_replica.cc:333] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.695340 14516 raft_consensus.cc:2243] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.695935 14516 raft_consensus.cc:2272] T 20fceb11e2a04d6693fd7b1f74782b68 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.698050 14516 tablet_replica.cc:333] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.698603 14516 raft_consensus.cc:2243] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.699357 14516 raft_consensus.cc:2272] T 6f159fe0d9aa499ebf56e97f7bd3dae7 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.701363 14516 tablet_replica.cc:333] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.701972 14516 raft_consensus.cc:2243] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.702441 14516 raft_consensus.cc:2272] T 1384e872d3384c91bfcbe6bb3a58417c P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.704407 14516 tablet_replica.cc:333] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.704985 14516 raft_consensus.cc:2243] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.705410 14516 raft_consensus.cc:2272] T df8a849878604c938fb5b2981c1d029a P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.707516 14516 tablet_replica.cc:333] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.708057 14516 raft_consensus.cc:2243] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.708513 14516 raft_consensus.cc:2272] T f87ef76e38824eb39fb6e7d442c8d89f P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.710529 14516 tablet_replica.cc:333] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.711058 14516 raft_consensus.cc:2243] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.711786 14516 raft_consensus.cc:2272] T 09e87e2309b84161ac6c20a13561d4d4 P c8630952f9e84d32b0406fa391901bcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.713687 14516 tablet_replica.cc:333] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.714273 14516 raft_consensus.cc:2243] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.715003 14516 raft_consensus.cc:2272] T fd6861693b9d49f9b76bad4f3bf87557 P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.716810 14516 tablet_replica.cc:333] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.717343 14516 raft_consensus.cc:2243] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.717824 14516 raft_consensus.cc:2272] T b04aee67a4664365aa0bfb44a5ce8420 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.719820 14516 tablet_replica.cc:333] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.720341 14516 raft_consensus.cc:2243] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.721181 14516 raft_consensus.cc:2272] T d83306074cc9408baf3602d8eba574b2 P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.723246 14516 tablet_replica.cc:333] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.723766 14516 raft_consensus.cc:2243] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.724232 14516 raft_consensus.cc:2272] T 9a0b8f7ad6dc4b809c2acd995cd39f5f P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.726302 14516 tablet_replica.cc:333] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.726817 14516 raft_consensus.cc:2243] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.727278 14516 raft_consensus.cc:2272] T 5ea769177a384320ad501d87ce229221 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.729281 14516 tablet_replica.cc:333] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.729853 14516 raft_consensus.cc:2243] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.730594 14516 raft_consensus.cc:2272] T 86ed59ba18e64316853c58eb1fe8ad5c P c8630952f9e84d32b0406fa391901bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.732586 14516 tablet_replica.cc:333] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.733110 14516 raft_consensus.cc:2243] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.733592 14516 raft_consensus.cc:2272] T 14779ce5d070401ea05aa8aba2cff11d P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.735646 14516 tablet_replica.cc:333] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.736136 14516 raft_consensus.cc:2243] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.736564 14516 raft_consensus.cc:2272] T 0f074e6849ac4a0b99df84f26fe15072 P c8630952f9e84d32b0406fa391901bcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.738646 14516 tablet_replica.cc:333] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf: stopping tablet replica
I20260709 13:10:24.739107 14516 raft_consensus.cc:2243] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.739519 14516 raft_consensus.cc:2272] T 65e31358a4b64d779e89d4029a7161aa P c8630952f9e84d32b0406fa391901bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.779702 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
I20260709 13:10:24.814314 14516 master.cc:562] Master@127.14.45.62:37821 shutting down...
I20260709 13:10:24.840078 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.840670 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.841053 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4ffc5d067cd049b79395a9e38ce32b44: stopping tablet replica
I20260709 13:10:24.862819 14516 master.cc:584] Master@127.14.45.62:37821 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14877 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:24.919046 14516 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.45.62:46723
I20260709 13:10:24.920256 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.927420 26116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.927596 26117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.928637 26119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.929067 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:24.930186 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.930440 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.930606 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602624930582 us; error 0 us; skew 500 ppm
I20260709 13:10:24.931167 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.933641 14516 webserver.cc:533] Webserver started at http://127.14.45.62:36773/ using document root <none> and password file <none>
I20260709 13:10:24.934208 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.934437 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.934705 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.935772 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/master-0-root/instance:
uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-lfdf"
I20260709 13:10:24.940361 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:24.944147 26124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.945065 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:24.945314 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/master-0-root
uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-lfdf"
I20260709 13:10:24.945580 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.962342 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.963589 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.004793 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.62:46723
I20260709 13:10:25.004906 26175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.62:46723 every 8 connection(s)
I20260709 13:10:25.009377 26176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.021675 26176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6: Bootstrap starting.
I20260709 13:10:25.027012 26176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.031953 26176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6: No bootstrap required, opened a new log
I20260709 13:10:25.034375 26176 raft_consensus.cc:359] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" member_type: VOTER }
I20260709 13:10:25.034837 26176 raft_consensus.cc:385] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.035099 26176 raft_consensus.cc:740] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 397b595eb2b8468f8c9a7af0eb3a4aa6, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.035719 26176 consensus_queue.cc:260] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" member_type: VOTER }
I20260709 13:10:25.036214 26176 raft_consensus.cc:399] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:25.036450 26176 raft_consensus.cc:493] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:25.036734 26176 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.041759 26176 raft_consensus.cc:515] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" member_type: VOTER }
I20260709 13:10:25.042333 26176 leader_election.cc:304] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 397b595eb2b8468f8c9a7af0eb3a4aa6; no voters: 
I20260709 13:10:25.043679 26176 leader_election.cc:290] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:25.044185 26179 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.045756 26179 raft_consensus.cc:697] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 397b595eb2b8468f8c9a7af0eb3a4aa6, State: Running, Role: LEADER
I20260709 13:10:25.046522 26179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" member_type: VOTER }
I20260709 13:10:25.047000 26176 sys_catalog.cc:565] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:25.051584 26181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 397b595eb2b8468f8c9a7af0eb3a4aa6. Latest consensus state: current_term: 1 leader_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" member_type: VOTER } }
I20260709 13:10:25.051949 26180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "397b595eb2b8468f8c9a7af0eb3a4aa6" member_type: VOTER } }
I20260709 13:10:25.052373 26181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:25.052616 26180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:25.055882 26186 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:25.064774 26186 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:25.065999 14516 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:25.074468 26186 catalog_manager.cc:1383] Generated new cluster ID: 679111e6f28f463daed5450a7c48cbb5
I20260709 13:10:25.074815 26186 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:25.115097 26186 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:25.116608 26186 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:25.144284 26186 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6: Generated new TSK 0
I20260709 13:10:25.145323 26186 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:25.196902 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.202955 26197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.204311 26198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.207013 14516 server_base.cc:1061] running on GCE node
W20260709 13:10:25.207067 26200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.208137 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.208451 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.208601 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602625208585 us; error 0 us; skew 500 ppm
I20260709 13:10:25.209169 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.211791 14516 webserver.cc:533] Webserver started at http://127.14.45.1:37125/ using document root <none> and password file <none>
I20260709 13:10:25.212352 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.212563 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.212868 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.214143 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-0-root/instance:
uuid: "1f14905185ba41b5954e2d95761a8712"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-lfdf"
I20260709 13:10:25.219179 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:25.222784 26205 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.223637 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:25.223959 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-0-root
uuid: "1f14905185ba41b5954e2d95761a8712"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-lfdf"
I20260709 13:10:25.224236 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.250389 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.251783 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.253398 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.255797 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.256012 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.256274 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.256454 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.300595 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.1:38735
I20260709 13:10:25.300704 26267 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.1:38735 every 8 connection(s)
I20260709 13:10:25.305835 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.312778 26272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.314559 26273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.316134 26275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.317093 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:25.318585 26268 heartbeater.cc:344] Connected to a master server at 127.14.45.62:46723
I20260709 13:10:25.318660 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.319056 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.319073 26268 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.319250 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602625319234 us; error 0 us; skew 500 ppm
I20260709 13:10:25.319983 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.320021 26268 heartbeater.cc:507] Master 127.14.45.62:46723 requested a full tablet report, sending...
I20260709 13:10:25.322681 14516 webserver.cc:533] Webserver started at http://127.14.45.2:40485/ using document root <none> and password file <none>
I20260709 13:10:25.322731 26141 ts_manager.cc:194] Registered new tserver with Master: 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735)
I20260709 13:10:25.323452 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.323745 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.324060 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.325367 26141 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39800
I20260709 13:10:25.325619 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-1-root/instance:
uuid: "c451651b617341639688174fd5e3d173"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-lfdf"
I20260709 13:10:25.330631 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:25.334056 26280 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.334868 14516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:25.335201 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-1-root
uuid: "c451651b617341639688174fd5e3d173"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-lfdf"
I20260709 13:10:25.335444 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.344794 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.346058 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.347666 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.350209 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.350422 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.350666 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.350832 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.392315 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.2:37969
I20260709 13:10:25.392453 26342 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.2:37969 every 8 connection(s)
I20260709 13:10:25.397228 14516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.405483 26346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.406069 26347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.409654 26343 heartbeater.cc:344] Connected to a master server at 127.14.45.62:46723
I20260709 13:10:25.410208 26343 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:25.410235 26349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.410763 14516 server_base.cc:1061] running on GCE node
I20260709 13:10:25.411149 26343 heartbeater.cc:507] Master 127.14.45.62:46723 requested a full tablet report, sending...
I20260709 13:10:25.411926 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.412232 14516 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.412365 14516 hybrid_clock.cc:648] HybridClock initialized: now 1783602625412353 us; error 0 us; skew 500 ppm
I20260709 13:10:25.413080 14516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.413595 26141 ts_manager.cc:194] Registered new tserver with Master: c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:25.415274 26141 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39816
I20260709 13:10:25.415838 14516 webserver.cc:533] Webserver started at http://127.14.45.3:43001/ using document root <none> and password file <none>
I20260709 13:10:25.416529 14516 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.416742 14516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.417027 14516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.418274 14516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-2-root/instance:
uuid: "0d9d330f85b14acf9283b9fadb609f61"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-lfdf"
I20260709 13:10:25.423089 14516 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:25.426791 26354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.427770 14516 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:25.428083 14516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-2-root
uuid: "0d9d330f85b14acf9283b9fadb609f61"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-lfdf"
I20260709 13:10:25.428385 14516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1vm47y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602292129808-14516-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.444381 14516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.445600 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.446866 14516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.449335 14516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.449568 14516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.449862 14516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.450031 14516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.491855 14516 rpc_server.cc:307] RPC server started. Bound to: 127.14.45.3:42997
I20260709 13:10:25.491971 26416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.45.3:42997 every 8 connection(s)
I20260709 13:10:25.506150 26417 heartbeater.cc:344] Connected to a master server at 127.14.45.62:46723
I20260709 13:10:25.506675 26417 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.507383 26417 heartbeater.cc:507] Master 127.14.45.62:46723 requested a full tablet report, sending...
I20260709 13:10:25.509246 26141 ts_manager.cc:194] Registered new tserver with Master: 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:25.509594 14516 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01475504s
I20260709 13:10:25.511060 26141 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39832
I20260709 13:10:25.535843 26141 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:25.538807 26141 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:25.618204 26308 tablet_service.cc:1511] Processing CreateTablet for tablet f39b31d8b1314efb8f651537358cbdea (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:25.619726 26308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39b31d8b1314efb8f651537358cbdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.621237 26381 tablet_service.cc:1511] Processing CreateTablet for tablet 919b09826ea6430ca668c7fa5da03da8 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:25.621666 26380 tablet_service.cc:1511] Processing CreateTablet for tablet e21f80a24abf4d4cb5d9513296234524 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:25.622830 26382 tablet_service.cc:1511] Processing CreateTablet for tablet f39b31d8b1314efb8f651537358cbdea (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:25.624181 26379 tablet_service.cc:1511] Processing CreateTablet for tablet 4baacc60c89348408762da7b3fa6324f (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:25.625399 26378 tablet_service.cc:1511] Processing CreateTablet for tablet 50b21924c6014b46bad1da33b5e0c762 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:25.625902 26228 tablet_service.cc:1511] Processing CreateTablet for tablet 0783e05e1d4e4a978872352c431cb1a0 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:25.626235 26306 tablet_service.cc:1511] Processing CreateTablet for tablet e21f80a24abf4d4cb5d9513296234524 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:25.627372 26228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0783e05e1d4e4a978872352c431cb1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.627725 26306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21f80a24abf4d4cb5d9513296234524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.630499 26377 tablet_service.cc:1511] Processing CreateTablet for tablet 0783e05e1d4e4a978872352c431cb1a0 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:25.631029 26305 tablet_service.cc:1511] Processing CreateTablet for tablet 4baacc60c89348408762da7b3fa6324f (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:25.632427 26305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4baacc60c89348408762da7b3fa6324f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.635007 26304 tablet_service.cc:1511] Processing CreateTablet for tablet 50b21924c6014b46bad1da33b5e0c762 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:25.636358 26304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b21924c6014b46bad1da33b5e0c762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.637192 26227 tablet_service.cc:1511] Processing CreateTablet for tablet dd011093018d45e997e63cc542fa9c4c (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:25.638607 26227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd011093018d45e997e63cc542fa9c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.638973 26233 tablet_service.cc:1511] Processing CreateTablet for tablet f39b31d8b1314efb8f651537358cbdea (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:25.640275 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39b31d8b1314efb8f651537358cbdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.642922 26231 tablet_service.cc:1511] Processing CreateTablet for tablet e21f80a24abf4d4cb5d9513296234524 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:25.644295 26376 tablet_service.cc:1511] Processing CreateTablet for tablet dd011093018d45e997e63cc542fa9c4c (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:25.645387 26230 tablet_service.cc:1511] Processing CreateTablet for tablet 4baacc60c89348408762da7b3fa6324f (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:25.647914 26229 tablet_service.cc:1511] Processing CreateTablet for tablet 50b21924c6014b46bad1da33b5e0c762 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:25.649767 26432 tablet_bootstrap.cc:492] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:25.650877 26232 tablet_service.cc:1511] Processing CreateTablet for tablet 919b09826ea6430ca668c7fa5da03da8 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:25.651859 26375 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc47b53a429438caae05c72fbd92d55 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:25.624114 26307 tablet_service.cc:1511] Processing CreateTablet for tablet 919b09826ea6430ca668c7fa5da03da8 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:25.655679 26374 tablet_service.cc:1511] Processing CreateTablet for tablet 83ac0f456c1a4de793143b4f18022e23 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:25.655946 26303 tablet_service.cc:1511] Processing CreateTablet for tablet 0783e05e1d4e4a978872352c431cb1a0 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:25.658514 26302 tablet_service.cc:1511] Processing CreateTablet for tablet dd011093018d45e997e63cc542fa9c4c (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:25.659118 26228 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc47b53a429438caae05c72fbd92d55 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:25.660547 26226 tablet_service.cc:1511] Processing CreateTablet for tablet 83ac0f456c1a4de793143b4f18022e23 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:25.663211 26301 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc47b53a429438caae05c72fbd92d55 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:25.663599 26300 tablet_service.cc:1511] Processing CreateTablet for tablet 83ac0f456c1a4de793143b4f18022e23 (DEFAULT_TABLE table=test-workload [id=c7d9ba7595f1459897b09fe4ee446d84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:25.644315 26231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21f80a24abf4d4cb5d9513296234524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.665603 26226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ac0f456c1a4de793143b4f18022e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.666868 26228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc47b53a429438caae05c72fbd92d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.670142 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4baacc60c89348408762da7b3fa6324f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.673961 26432 tablet_bootstrap.cc:654] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.674192 26232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919b09826ea6430ca668c7fa5da03da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.679339 26229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b21924c6014b46bad1da33b5e0c762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.653442 26307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919b09826ea6430ca668c7fa5da03da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.682622 26301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc47b53a429438caae05c72fbd92d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.622781 26381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919b09826ea6430ca668c7fa5da03da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.684710 26303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0783e05e1d4e4a978872352c431cb1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.685393 26380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21f80a24abf4d4cb5d9513296234524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.686026 26302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd011093018d45e997e63cc542fa9c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.692165 26382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39b31d8b1314efb8f651537358cbdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.693682 26300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ac0f456c1a4de793143b4f18022e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.698627 26375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc47b53a429438caae05c72fbd92d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.702111 26377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0783e05e1d4e4a978872352c431cb1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.706097 26379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4baacc60c89348408762da7b3fa6324f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.713901 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b21924c6014b46bad1da33b5e0c762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.718178 26374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ac0f456c1a4de793143b4f18022e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.728330 26376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd011093018d45e997e63cc542fa9c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.739274 26435 tablet_bootstrap.cc:492] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:25.752696 26435 tablet_bootstrap.cc:654] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.789605 26432 tablet_bootstrap.cc:492] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:25.790422 26432 ts_tablet_manager.cc:1403] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.141s	user 0.029s	sys 0.025s
I20260709 13:10:25.793576 26432 raft_consensus.cc:359] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.794456 26432 raft_consensus.cc:385] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.795212 26432 raft_consensus.cc:740] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.796842 26432 consensus_queue.cc:260] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.840530 26434 tablet_bootstrap.cc:492] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:25.851238 26434 tablet_bootstrap.cc:654] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.859599 26435 tablet_bootstrap.cc:492] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:25.866150 26435 ts_tablet_manager.cc:1403] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.014s
I20260709 13:10:25.879982 26268 heartbeater.cc:499] Master 127.14.45.62:46723 was elected leader, sending a full tablet report...
I20260709 13:10:25.881268 26434 tablet_bootstrap.cc:492] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:25.881693 26434 ts_tablet_manager.cc:1403] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.017s
I20260709 13:10:25.884853 26432 ts_tablet_manager.cc:1434] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.005s
I20260709 13:10:25.885241 26434 raft_consensus.cc:359] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.885955 26434 raft_consensus.cc:385] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.886186 26434 raft_consensus.cc:740] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.886546 26432 tablet_bootstrap.cc:492] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:25.886814 26434 consensus_queue.cc:260] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.888953 26435 raft_consensus.cc:359] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.890352 26343 heartbeater.cc:499] Master 127.14.45.62:46723 was elected leader, sending a full tablet report...
I20260709 13:10:25.896255 26439 raft_consensus.cc:493] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.896538 26344 tablet.cc:2406] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:25.894954 26434 ts_tablet_manager.cc:1434] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:10:25.896802 26439 raft_consensus.cc:515] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.898164 26435 raft_consensus.cc:385] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.898633 26435 raft_consensus.cc:740] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.898052 26432 tablet_bootstrap.cc:654] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.899511 26435 consensus_queue.cc:260] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.898077 26434 tablet_bootstrap.cc:492] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:25.907513 26417 heartbeater.cc:499] Master 127.14.45.62:46723 was elected leader, sending a full tablet report...
I20260709 13:10:25.907948 26435 ts_tablet_manager.cc:1434] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.010s
I20260709 13:10:25.911409 26434 tablet_bootstrap.cc:654] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.916146 26432 tablet_bootstrap.cc:492] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:25.916706 26432 ts_tablet_manager.cc:1403] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.003s
I20260709 13:10:25.918224 26435 tablet_bootstrap.cc:492] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:25.928964 26439 leader_election.cc:290] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:25.933179 26435 tablet_bootstrap.cc:654] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.933858 26432 raft_consensus.cc:359] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.937770 26432 raft_consensus.cc:385] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.938117 26432 raft_consensus.cc:740] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.940030 26432 consensus_queue.cc:260] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.942356 26432 ts_tablet_manager.cc:1434] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:10:25.943465 26432 tablet_bootstrap.cc:492] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:25.950711 26434 tablet_bootstrap.cc:492] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:25.951700 26434 ts_tablet_manager.cc:1403] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.021s
I20260709 13:10:25.955868 26432 tablet_bootstrap.cc:654] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.955458 26434 raft_consensus.cc:359] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.956529 26434 raft_consensus.cc:385] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.956985 26434 raft_consensus.cc:740] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.958011 26434 consensus_queue.cc:260] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.960047 26435 tablet_bootstrap.cc:492] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:25.960646 26435 ts_tablet_manager.cc:1403] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 13:10:25.961122 26434 ts_tablet_manager.cc:1434] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:25.962379 26434 tablet_bootstrap.cc:492] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:25.962507 26438 raft_consensus.cc:493] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.968346 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:25.969457 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
W20260709 13:10:25.970638 26283 leader_election.cc:343] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.968341 26438 raft_consensus.cc:515] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
W20260709 13:10:25.972114 26283 leader_election.cc:343] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.972577 26283 leader_election.cc:304] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c451651b617341639688174fd5e3d173; no voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:25.973558 26434 tablet_bootstrap.cc:654] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.978340 26439 raft_consensus.cc:2749] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.980652 26438 leader_election.cc:290] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:25.986599 26432 tablet_bootstrap.cc:492] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:25.989753 26432 ts_tablet_manager.cc:1403] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.007s
I20260709 13:10:25.988338 26435 raft_consensus.cc:359] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:25.994457 26435 raft_consensus.cc:385] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.995083 26435 raft_consensus.cc:740] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.996341 26435 consensus_queue.cc:260] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.008674 26435 ts_tablet_manager.cc:1434] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.003s
I20260709 13:10:26.010007 26432 raft_consensus.cc:359] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.011848 26432 raft_consensus.cc:385] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.022228 26432 raft_consensus.cc:740] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.023537 26435 tablet_bootstrap.cc:492] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.024453 26432 consensus_queue.cc:260] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.029232 26432 ts_tablet_manager.cc:1434] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:10:26.030104 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.031920 26432 tablet_bootstrap.cc:492] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:26.032553 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
W20260709 13:10:26.034106 26207 leader_election.cc:343] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c451651b617341639688174fd5e3d173 (127.14.45.2:37969): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:26.034806 26208 leader_election.cc:343] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.035420 26435 tablet_bootstrap.cc:654] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.035290 26208 leader_election.cc:304] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712; no voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173
I20260709 13:10:26.026274 26434 tablet_bootstrap.cc:492] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.036737 26434 ts_tablet_manager.cc:1403] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.075s	user 0.030s	sys 0.021s
I20260709 13:10:26.036995 26438 raft_consensus.cc:2749] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.039681 26432 tablet_bootstrap.cc:654] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.040630 26434 raft_consensus.cc:359] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.041857 26434 raft_consensus.cc:385] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.042232 26434 raft_consensus.cc:740] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.043248 26434 consensus_queue.cc:260] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.045850 26434 ts_tablet_manager.cc:1434] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:10:26.046933 26434 tablet_bootstrap.cc:492] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:26.049801 26432 tablet_bootstrap.cc:492] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:26.049813 26435 tablet_bootstrap.cc:492] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.050562 26432 ts_tablet_manager.cc:1403] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:10:26.050565 26435 ts_tablet_manager.cc:1403] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.006s
I20260709 13:10:26.053496 26434 tablet_bootstrap.cc:654] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.053797 26435 raft_consensus.cc:359] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.054018 26432 raft_consensus.cc:359] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.054641 26435 raft_consensus.cc:385] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.054724 26432 raft_consensus.cc:385] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.055017 26435 raft_consensus.cc:740] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.055111 26432 raft_consensus.cc:740] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.056012 26432 consensus_queue.cc:260] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.056012 26435 consensus_queue.cc:260] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.062875 26432 ts_tablet_manager.cc:1434] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:26.064239 26432 tablet_bootstrap.cc:492] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:26.064672 26435 ts_tablet_manager.cc:1434] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:26.065908 26435 tablet_bootstrap.cc:492] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.068588 26434 tablet_bootstrap.cc:492] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.069290 26434 ts_tablet_manager.cc:1403] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:10:26.071581 26432 tablet_bootstrap.cc:654] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.072911 26435 tablet_bootstrap.cc:654] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.072733 26434 raft_consensus.cc:359] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.073704 26434 raft_consensus.cc:385] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.074106 26434 raft_consensus.cc:740] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.075156 26434 consensus_queue.cc:260] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.077610 26434 ts_tablet_manager.cc:1434] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:26.078694 26434 tablet_bootstrap.cc:492] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:26.085590 26434 tablet_bootstrap.cc:654] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.109797 26189 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:26.115684 26432 tablet_bootstrap.cc:492] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:26.116369 26432 ts_tablet_manager.cc:1403] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.022s
I20260709 13:10:26.116380 26434 tablet_bootstrap.cc:492] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.117097 26434 ts_tablet_manager.cc:1403] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.016s
I20260709 13:10:26.117259 26435 tablet_bootstrap.cc:492] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.117877 26435 ts_tablet_manager.cc:1403] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.030s
I20260709 13:10:26.119808 26434 raft_consensus.cc:359] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.119740 26432 raft_consensus.cc:359] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.120676 26434 raft_consensus.cc:385] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.120790 26432 raft_consensus.cc:385] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.121057 26434 raft_consensus.cc:740] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.120718 26435 raft_consensus.cc:359] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.121377 26432 raft_consensus.cc:740] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.121759 26435 raft_consensus.cc:385] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.122088 26435 raft_consensus.cc:740] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.122066 26434 consensus_queue.cc:260] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.122329 26432 consensus_queue.cc:260] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.123136 26435 consensus_queue.cc:260] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.124357 26434 ts_tablet_manager.cc:1434] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:26.125439 26434 tablet_bootstrap.cc:492] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:26.126610 26438 raft_consensus.cc:493] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.127146 26438 raft_consensus.cc:515] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.129330 26438 leader_election.cc:290] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.129426 26435 ts_tablet_manager.cc:1434] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:10:26.130718 26435 tablet_bootstrap.cc:492] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.131069 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.131780 26318 raft_consensus.cc:2468] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:26.132006 26434 tablet_bootstrap.cc:654] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.133193 26207 leader_election.cc:304] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.135365 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
W20260709 13:10:26.136911 26208 leader_election.cc:343] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.138715 26438 raft_consensus.cc:2804] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.139107 26438 raft_consensus.cc:493] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.139437 26438 raft_consensus.cc:3060] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.143674 26434 tablet_bootstrap.cc:492] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.143667 26435 tablet_bootstrap.cc:654] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.144381 26434 ts_tablet_manager.cc:1403] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:10:26.147612 26434 raft_consensus.cc:359] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.148331 26434 raft_consensus.cc:385] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.148787 26434 raft_consensus.cc:740] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.149629 26434 consensus_queue.cc:260] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.150197 26432 ts_tablet_manager.cc:1434] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.005s
I20260709 13:10:26.151960 26434 ts_tablet_manager.cc:1434] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:26.153013 26434 tablet_bootstrap.cc:492] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:26.156286 26440 raft_consensus.cc:493] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.156921 26440 raft_consensus.cc:515] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.159561 26434 tablet_bootstrap.cc:654] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.159653 26432 tablet_bootstrap.cc:492] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:26.164283 26438 raft_consensus.cc:515] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.167860 26440 leader_election.cc:290] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.173439 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.173868 26435 tablet_bootstrap.cc:492] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.174226 26318 raft_consensus.cc:3060] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.174489 26435 ts_tablet_manager.cc:1403] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 13:10:26.173868 26434 tablet_bootstrap.cc:492] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.178365 26434 ts_tablet_manager.cc:1403] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:10:26.181180 26457 raft_consensus.cc:493] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.181613 26434 raft_consensus.cc:359] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.181798 26457 raft_consensus.cc:515] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.182449 26434 raft_consensus.cc:385] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.182787 26434 raft_consensus.cc:740] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.183571 26434 consensus_queue.cc:260] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.184572 26440 raft_consensus.cc:493] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.185266 26440 raft_consensus.cc:515] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.185881 26434 ts_tablet_manager.cc:1434] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:26.186007 26318 raft_consensus.cc:2468] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:26.187067 26434 tablet_bootstrap.cc:492] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:26.177690 26435 raft_consensus.cc:359] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.190577 26435 raft_consensus.cc:385] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.190936 26435 raft_consensus.cc:740] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.191699 26435 consensus_queue.cc:260] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.194188 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.195082 26438 leader_election.cc:290] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.195808 26457 leader_election.cc:290] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.195951 26207 leader_election.cc:304] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.196389 26440 leader_election.cc:290] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.192644 26432 tablet_bootstrap.cc:654] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.197788 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.198460 26318 raft_consensus.cc:2468] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:26.199916 26457 raft_consensus.cc:2804] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.200615 26457 raft_consensus.cc:697] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.201864 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.201711 26457 consensus_queue.cc:237] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.202580 26317 raft_consensus.cc:2468] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.203786 26434 tablet_bootstrap.cc:654] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.203794 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.203893 26356 leader_election.cc:304] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.210050 26440 raft_consensus.cc:493] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.210156 26207 leader_election.cc:304] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
W20260709 13:10:26.213480 26208 leader_election.cc:343] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.213758 26438 raft_consensus.cc:2804] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.214272 26438 raft_consensus.cc:493] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.214646 26438 raft_consensus.cc:3060] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:26.215777 26356 leader_election.cc:343] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c451651b617341639688174fd5e3d173 (127.14.45.2:37969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.216701 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
W20260709 13:10:26.219719 26208 leader_election.cc:343] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.213043 26440 raft_consensus.cc:515] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.226459 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.227088 26440 leader_election.cc:290] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.227725 26318 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.229344 26356 leader_election.cc:304] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.230288 26440 raft_consensus.cc:2804] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.230518 26435 ts_tablet_manager.cc:1434] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.012s
I20260709 13:10:26.230755 26440 raft_consensus.cc:493] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.231272 26440 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.232102 26435 tablet_bootstrap.cc:492] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.232779 26438 raft_consensus.cc:515] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.236828 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.237509 26318 raft_consensus.cc:3060] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.238960 26432 tablet_bootstrap.cc:492] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:26.239533 26432 ts_tablet_manager.cc:1403] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.007s
I20260709 13:10:26.240204 26440 raft_consensus.cc:515] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.235759 26438 leader_election.cc:290] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.242894 26440 leader_election.cc:290] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.243003 26139 catalog_manager.cc:5697] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.244164 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.244865 26316 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.245715 26318 raft_consensus.cc:2468] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:26.248446 26207 leader_election.cc:304] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.249878 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.250530 26462 raft_consensus.cc:2804] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.250994 26462 raft_consensus.cc:493] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.251287 26438 raft_consensus.cc:2804] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.251879 26438 raft_consensus.cc:697] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.252754 26438 consensus_queue.cc:237] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.253801 26434 tablet_bootstrap.cc:492] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.254329 26434 ts_tablet_manager.cc:1403] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.007s
W20260709 13:10:26.256227 26208 leader_election.cc:343] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.257853 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.251354 26462 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.257830 26434 raft_consensus.cc:359] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.261013 26432 raft_consensus.cc:359] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.261682 26434 raft_consensus.cc:385] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.262665 26434 raft_consensus.cc:740] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.261883 26432 raft_consensus.cc:385] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.263476 26316 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:26.263866 26432 raft_consensus.cc:740] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.264860 26356 leader_election.cc:304] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.265853 26440 raft_consensus.cc:2804] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.266789 26440 raft_consensus.cc:697] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.266816 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.267550 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.267864 26243 raft_consensus.cc:2468] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.268288 26242 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.267791 26440 consensus_queue.cc:237] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.269793 26435 tablet_bootstrap.cc:654] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.265413 26432 consensus_queue.cc:260] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.270910 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.274469 26243 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.275399 26462 raft_consensus.cc:515] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.275884 26432 ts_tablet_manager.cc:1434] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:10:26.277189 26432 tablet_bootstrap.cc:492] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:26.283209 26243 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:26.273221 26434 consensus_queue.cc:260] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
W20260709 13:10:26.273070 26357 leader_election.cc:343] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.285643 26357 leader_election.cc:304] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: c451651b617341639688174fd5e3d173
I20260709 13:10:26.286553 26432 tablet_bootstrap.cc:654] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.286953 26463 raft_consensus.cc:2804] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.287426 26463 raft_consensus.cc:493] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.287774 26463 raft_consensus.cc:3060] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.289319 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.290113 26316 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.296303 26434 ts_tablet_manager.cc:1434] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.006s
I20260709 13:10:26.297834 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
W20260709 13:10:26.299973 26357 leader_election.cc:343] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.300590 26462 leader_election.cc:290] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.300643 26463 raft_consensus.cc:515] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.304737 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
W20260709 13:10:26.306285 26356 leader_election.cc:343] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c451651b617341639688174fd5e3d173 (127.14.45.2:37969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.297633 26316 raft_consensus.cc:2468] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:26.307394 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.307974 26356 leader_election.cc:304] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.308244 26463 leader_election.cc:290] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.308882 26463 raft_consensus.cc:2804] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.308035 26242 raft_consensus.cc:3060] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.309363 26463 raft_consensus.cc:697] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.310248 26463 consensus_queue.cc:237] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.311743 26434 tablet_bootstrap.cc:492] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:26.316996 26242 raft_consensus.cc:2468] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:26.306219 26435 tablet_bootstrap.cc:492] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.318984 26435 ts_tablet_manager.cc:1403] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.008s
I20260709 13:10:26.321916 26462 raft_consensus.cc:493] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.322417 26462 raft_consensus.cc:515] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.325275 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.325656 26357 leader_election.cc:304] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: c451651b617341639688174fd5e3d173
I20260709 13:10:26.326714 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.326929 26463 raft_consensus.cc:2804] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.327440 26316 raft_consensus.cc:2468] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.324702 26434 tablet_bootstrap.cc:654] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.327591 26357 leader_election.cc:343] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.328933 26356 leader_election.cc:304] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.330026 26440 raft_consensus.cc:2804] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.330072 26462 leader_election.cc:290] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.330502 26438 raft_consensus.cc:493] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.330503 26440 raft_consensus.cc:493] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.331111 26438 raft_consensus.cc:515] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.332144 26432 tablet_bootstrap.cc:492] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:26.332706 26432 ts_tablet_manager.cc:1403] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.012s
I20260709 13:10:26.334628 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.334951 26438 leader_election.cc:290] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
W20260709 13:10:26.336249 26208 leader_election.cc:343] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.331112 26440 raft_consensus.cc:3060] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.337883 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.338672 26316 raft_consensus.cc:2468] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:26.338176 26140 catalog_manager.cc:5697] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.340010 26207 leader_election.cc:304] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 0d9d330f85b14acf9283b9fadb609f61
I20260709 13:10:26.341315 26438 raft_consensus.cc:2804] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.341708 26438 raft_consensus.cc:493] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.342167 26438 raft_consensus.cc:3060] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.342732 26139 catalog_manager.cc:5697] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.347951 26440 raft_consensus.cc:515] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.351352 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.352042 26440 leader_election.cc:290] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
W20260709 13:10:26.352924 26357 leader_election.cc:343] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.350351 26438 raft_consensus.cc:515] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.355024 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.355677 26316 raft_consensus.cc:3060] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.355862 26434 tablet_bootstrap.cc:492] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:26.356086 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.356613 26434 ts_tablet_manager.cc:1403] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.009s
I20260709 13:10:26.356731 26318 raft_consensus.cc:3060] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.357543 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
W20260709 13:10:26.359120 26208 leader_election.cc:343] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.359769 26438 leader_election.cc:290] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.363020 26432 raft_consensus.cc:359] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.363802 26432 raft_consensus.cc:385] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.364121 26432 raft_consensus.cc:740] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.364909 26435 raft_consensus.cc:359] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.364972 26432 consensus_queue.cc:260] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.365717 26435 raft_consensus.cc:385] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.366186 26435 raft_consensus.cc:740] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.367417 26435 consensus_queue.cc:260] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.366245 26316 raft_consensus.cc:2468] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:26.367908 26432 ts_tablet_manager.cc:1434] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:10:26.369297 26432 tablet_bootstrap.cc:492] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:26.369203 26356 leader_election.cc:304] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.369940 26435 ts_tablet_manager.cc:1434] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:10:26.370738 26440 raft_consensus.cc:2804] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.370932 26435 tablet_bootstrap.cc:492] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.371224 26440 raft_consensus.cc:697] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.372043 26440 consensus_queue.cc:237] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.373332 26318 raft_consensus.cc:2468] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:26.374233 26463 raft_consensus.cc:697] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.374981 26207 leader_election.cc:304] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 0d9d330f85b14acf9283b9fadb609f61
I20260709 13:10:26.375134 26463 consensus_queue.cc:237] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.375890 26438 raft_consensus.cc:2804] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.376477 26438 raft_consensus.cc:697] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.384485 26435 tablet_bootstrap.cc:654] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.364019 26434 raft_consensus.cc:359] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.388185 26438 consensus_queue.cc:237] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.392481 26434 raft_consensus.cc:385] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.392833 26434 raft_consensus.cc:740] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.393527 26434 consensus_queue.cc:260] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.395692 26434 ts_tablet_manager.cc:1434] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:10:26.396607 26139 catalog_manager.cc:5697] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.398749 26139 catalog_manager.cc:5697] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.400627 26432 tablet_bootstrap.cc:654] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.392088 26435 tablet_bootstrap.cc:492] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.404050 26435 ts_tablet_manager.cc:1403] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.006s
I20260709 13:10:26.407426 26432 tablet_bootstrap.cc:492] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:26.408007 26432 ts_tablet_manager.cc:1403] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.006s
I20260709 13:10:26.407460 26435 raft_consensus.cc:359] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.408422 26435 raft_consensus.cc:385] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.408766 26435 raft_consensus.cc:740] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.409935 26435 consensus_queue.cc:260] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.410784 26432 raft_consensus.cc:359] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.411500 26432 raft_consensus.cc:385] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.411763 26432 raft_consensus.cc:740] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.412427 26432 consensus_queue.cc:260] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.413034 26435 ts_tablet_manager.cc:1434] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:26.413993 26432 ts_tablet_manager.cc:1434] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:26.414222 26435 tablet_bootstrap.cc:492] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.414989 26432 tablet_bootstrap.cc:492] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:26.417929 26140 catalog_manager.cc:5697] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.420009 26432 tablet_bootstrap.cc:654] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.423878 26435 tablet_bootstrap.cc:654] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.430249 26435 tablet_bootstrap.cc:492] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.430979 26435 ts_tablet_manager.cc:1403] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.006s
I20260709 13:10:26.432014 26438 raft_consensus.cc:493] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.432672 26438 raft_consensus.cc:515] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.433836 26432 tablet_bootstrap.cc:492] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:26.434405 26432 ts_tablet_manager.cc:1403] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 13:10:26.429167 26138 catalog_manager.cc:5697] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.435110 26438 leader_election.cc:290] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.436563 26475 raft_consensus.cc:493] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.434013 26435 raft_consensus.cc:359] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.436996 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.437361 26435 raft_consensus.cc:385] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.437666 26435 raft_consensus.cc:740] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.437588 26432 raft_consensus.cc:359] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.438577 26432 raft_consensus.cc:385] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.438898 26432 raft_consensus.cc:740] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.438668 26435 consensus_queue.cc:260] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.439926 26432 consensus_queue.cc:260] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.439958 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.440994 26435 ts_tablet_manager.cc:1434] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:10:26.441974 26435 tablet_bootstrap.cc:492] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:26.442167 26432 ts_tablet_manager.cc:1434] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:26.437054 26475 raft_consensus.cc:515] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.446878 26435 tablet_bootstrap.cc:654] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.437917 26316 raft_consensus.cc:2393] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f14905185ba41b5954e2d95761a8712 in current term 1: Already voted for candidate 0d9d330f85b14acf9283b9fadb609f61 in this term.
I20260709 13:10:26.447934 26439 raft_consensus.cc:493] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.448630 26475 leader_election.cc:290] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735)
I20260709 13:10:26.448453 26439 raft_consensus.cc:515] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.449990 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.450588 26439 leader_election.cc:290] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997), 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735)
I20260709 13:10:26.450681 26318 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.452057 26356 leader_election.cc:304] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.452109 26207 leader_election.cc:304] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712; no voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173
I20260709 13:10:26.452587 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.453260 26243 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:26.454499 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.454761 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.455188 26392 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:26.455363 26243 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:26.454964 26283 leader_election.cc:304] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.456496 26439 raft_consensus.cc:2804] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.457019 26439 raft_consensus.cc:493] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.457448 26439 raft_consensus.cc:3060] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.459010 26475 raft_consensus.cc:2804] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.459496 26475 raft_consensus.cc:493] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.459825 26475 raft_consensus.cc:3060] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.465983 26438 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.470607 26439 raft_consensus.cc:515] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.473837 26438 raft_consensus.cc:2749] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.475485 26475 raft_consensus.cc:515] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.476199 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.477429 26392 raft_consensus.cc:2393] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c451651b617341639688174fd5e3d173 in current term 1: Already voted for candidate 0d9d330f85b14acf9283b9fadb609f61 in this term.
I20260709 13:10:26.477701 26475 leader_election.cc:290] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735)
I20260709 13:10:26.478657 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.479604 26318 raft_consensus.cc:2393] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d9d330f85b14acf9283b9fadb609f61 in current term 1: Already voted for candidate c451651b617341639688174fd5e3d173 in this term.
I20260709 13:10:26.479647 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.480365 26243 raft_consensus.cc:3060] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.481695 26439 leader_election.cc:290] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Requested vote from peers 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997), 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735)
I20260709 13:10:26.481966 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.483777 26283 leader_election.cc:304] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c451651b617341639688174fd5e3d173; no voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.484609 26439 raft_consensus.cc:2749] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.486150 26435 tablet_bootstrap.cc:492] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:26.486620 26435 ts_tablet_manager.cc:1403] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.018s
I20260709 13:10:26.486997 26438 raft_consensus.cc:493] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.487028 26243 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:26.487789 26438 raft_consensus.cc:515] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.488543 26357 leader_election.cc:304] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: c451651b617341639688174fd5e3d173
I20260709 13:10:26.489001 26435 raft_consensus.cc:359] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.489732 26435 raft_consensus.cc:385] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.489423 26475 raft_consensus.cc:2804] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.490049 26435 raft_consensus.cc:740] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.490471 26438 leader_election.cc:290] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.490895 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4baacc60c89348408762da7b3fa6324f" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.491212 26475 raft_consensus.cc:697] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.490972 26435 consensus_queue.cc:260] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.491456 26318 raft_consensus.cc:2468] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:26.492127 26475 consensus_queue.cc:237] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:26.492662 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4baacc60c89348408762da7b3fa6324f" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.493163 26207 leader_election.cc:304] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.493470 26435 ts_tablet_manager.cc:1434] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:26.493515 26392 raft_consensus.cc:2468] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:26.494266 26438 raft_consensus.cc:2804] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.494628 26438 raft_consensus.cc:493] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.495003 26438 raft_consensus.cc:3060] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.500221 26138 catalog_manager.cc:5697] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.501212 26438 raft_consensus.cc:515] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.503679 26438 leader_election.cc:290] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.504093 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4baacc60c89348408762da7b3fa6324f" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.504673 26318 raft_consensus.cc:3060] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.504817 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4baacc60c89348408762da7b3fa6324f" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.505415 26392 raft_consensus.cc:3060] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.512087 26318 raft_consensus.cc:2468] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:26.512420 26392 raft_consensus.cc:2468] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:26.513446 26207 leader_election.cc:304] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.514242 26438 raft_consensus.cc:2804] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.514915 26438 raft_consensus.cc:697] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.515789 26438 consensus_queue.cc:237] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.524231 26138 catalog_manager.cc:5697] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.532961 26475 raft_consensus.cc:493] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.533707 26475 raft_consensus.cc:515] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.535780 26475 leader_election.cc:290] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.536520 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.536823 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.537806 26318 raft_consensus.cc:2393] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d9d330f85b14acf9283b9fadb609f61 in current term 1: Already voted for candidate 1f14905185ba41b5954e2d95761a8712 in this term.
I20260709 13:10:26.538830 26356 leader_election.cc:304] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61; no voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173
I20260709 13:10:26.539693 26475 raft_consensus.cc:3060] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.545390 26475 raft_consensus.cc:2749] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.562920 26439 raft_consensus.cc:493] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.563464 26439 raft_consensus.cc:515] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.565316 26439 leader_election.cc:290] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.566097 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:26.566401 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.567163 26243 raft_consensus.cc:2393] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c451651b617341639688174fd5e3d173 in current term 1: Already voted for candidate 0d9d330f85b14acf9283b9fadb609f61 in this term.
I20260709 13:10:26.570401 26283 leader_election.cc:304] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c451651b617341639688174fd5e3d173; no voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.571111 26439 raft_consensus.cc:3060] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.577955 26439 raft_consensus.cc:2749] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.579087 26392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:26.579660 26392 raft_consensus.cc:606] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.584712 26392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:26.585232 26392 raft_consensus.cc:606] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.590308 26392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:26.590835 26392 raft_consensus.cc:606] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:26.594410 26392 raft_consensus.cc:3060] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.599815 26391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:26.600456 26391 raft_consensus.cc:606] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS c451651b617341639688174fd5e3d173
I20260709 13:10:26.601992 26438 consensus_queue.cc:1048] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.606771 26391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:26.607383 26391 raft_consensus.cc:606] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS c451651b617341639688174fd5e3d173
I20260709 13:10:26.623044 26492 consensus_queue.cc:1048] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.625254 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
mode: GRACEFUL
new_leader_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:56318
I20260709 13:10:26.626109 26243 raft_consensus.cc:606] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Received request to transfer leadership to TS c451651b617341639688174fd5e3d173
I20260709 13:10:26.635044 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
mode: GRACEFUL
new_leader_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:56318
I20260709 13:10:26.635643 26243 raft_consensus.cc:606] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Received request to transfer leadership to TS c451651b617341639688174fd5e3d173
I20260709 13:10:26.636150 26392 raft_consensus.cc:3060] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.642144 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
mode: GRACEFUL
new_leader_uuid: "0d9d330f85b14acf9283b9fadb609f61"
 from {username='slave'} at 127.0.0.1:56318
I20260709 13:10:26.642892 26243 raft_consensus.cc:606] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Received request to transfer leadership to TS 0d9d330f85b14acf9283b9fadb609f61
I20260709 13:10:26.645174 26438 consensus_queue.cc:1048] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.658598 26492 consensus_queue.cc:1048] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.667733 26457 raft_consensus.cc:993] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: : Instructing follower c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:26.668200 26492 raft_consensus.cc:1081] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Signalling peer c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:26.669829 26318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c"
dest_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:32878
I20260709 13:10:26.670528 26318 raft_consensus.cc:493] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.670960 26318 raft_consensus.cc:3060] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.676678 26318 raft_consensus.cc:515] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.679088 26318 leader_election.cc:290] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.679491 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.680210 26243 raft_consensus.cc:3055] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.680171 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd011093018d45e997e63cc542fa9c4c" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.680809 26243 raft_consensus.cc:740] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.681006 26392 raft_consensus.cc:3060] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.681838 26243 consensus_queue.cc:260] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.683328 26243 raft_consensus.cc:3060] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.689193 26392 raft_consensus.cc:2468] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:26.690606 26283 leader_election.cc:304] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.691336 26243 raft_consensus.cc:2468] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:26.691633 26439 raft_consensus.cc:2804] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.692836 26439 raft_consensus.cc:697] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:26.693923 26439 consensus_queue.cc:237] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.700551 26138 catalog_manager.cc:5697] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 1 to 2, leader changed from 1f14905185ba41b5954e2d95761a8712 (127.14.45.1) to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.743080 26492 raft_consensus.cc:493] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.743758 26492 raft_consensus.cc:515] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.745585 26492 leader_election.cc:290] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.746692 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:26.746951 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:26.747653 26318 raft_consensus.cc:2393] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f14905185ba41b5954e2d95761a8712 in current term 1: Already voted for candidate 0d9d330f85b14acf9283b9fadb609f61 in this term.
I20260709 13:10:26.748785 26207 leader_election.cc:304] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712; no voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173
I20260709 13:10:26.749500 26492 raft_consensus.cc:3060] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.754914 26492 raft_consensus.cc:2749] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.795496 26475 consensus_queue.cc:1048] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.802352 26463 raft_consensus.cc:993] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:26.802858 26463 raft_consensus.cc:1081] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:26.804517 26317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762"
dest_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:32892
I20260709 13:10:26.805137 26317 raft_consensus.cc:493] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.805518 26317 raft_consensus.cc:3060] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.806627 26492 consensus_queue.cc:1048] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.811408 26475 consensus_queue.cc:1048] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.813962 26317 raft_consensus.cc:515] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.825376 26317 leader_election.cc:290] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.827980 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.828830 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b21924c6014b46bad1da33b5e0c762" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.828801 26392 raft_consensus.cc:3055] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.829512 26392 raft_consensus.cc:740] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.829546 26243 raft_consensus.cc:3060] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.830711 26457 consensus_queue.cc:1048] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.830543 26392 consensus_queue.cc:260] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.831888 26392 raft_consensus.cc:3060] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.840471 26475 consensus_queue.cc:1048] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.842671 26438 raft_consensus.cc:993] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: : Instructing follower 0d9d330f85b14acf9283b9fadb609f61 to start an election
I20260709 13:10:26.843020 26243 raft_consensus.cc:2468] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:26.843258 26457 raft_consensus.cc:1081] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Signalling peer 0d9d330f85b14acf9283b9fadb609f61 to start an election
I20260709 13:10:26.844429 26283 leader_election.cc:304] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.845002 26391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
 from {username='slave'} at 127.0.0.1:49966
I20260709 13:10:26.845348 26439 raft_consensus.cc:2804] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.845657 26391 raft_consensus.cc:493] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.845988 26439 raft_consensus.cc:697] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:26.846164 26391 raft_consensus.cc:3060] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.847024 26439 consensus_queue.cc:237] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.849664 26392 raft_consensus.cc:2468] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:26.857892 26463 consensus_queue.cc:1048] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.859018 26391 raft_consensus.cc:515] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.861478 26391 leader_election.cc:290] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:26.863227 26318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.863898 26318 raft_consensus.cc:3060] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.864574 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ac0f456c1a4de793143b4f18022e23" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.865273 26242 raft_consensus.cc:3055] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.865639 26242 raft_consensus.cc:740] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.866499 26242 consensus_queue.cc:260] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.869675 26242 raft_consensus.cc:3060] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.871708 26318 raft_consensus.cc:2468] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 2.
I20260709 13:10:26.873106 26463 raft_consensus.cc:993] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:26.873584 26463 raft_consensus.cc:1081] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:26.874117 26356 leader_election.cc:304] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.875471 26463 raft_consensus.cc:2804] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.875888 26318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0"
dest_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:32892
I20260709 13:10:26.876163 26463 raft_consensus.cc:697] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.876636 26318 raft_consensus.cc:493] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.859745 26140 catalog_manager.cc:5697] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.877064 26463 consensus_queue.cc:237] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.877084 26242 raft_consensus.cc:2468] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 2.
I20260709 13:10:26.877086 26318 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.885715 26318 raft_consensus.cc:515] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.886543 26138 catalog_manager.cc:5697] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 1 to 2, leader changed from 1f14905185ba41b5954e2d95761a8712 (127.14.45.1) to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 2 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.887809 26318 leader_election.cc:290] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.889346 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:26.890079 26242 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.890462 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.891232 26391 raft_consensus.cc:3055] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.891593 26391 raft_consensus.cc:740] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.892463 26391 consensus_queue.cc:260] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.893730 26391 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.897450 26462 consensus_queue.cc:1048] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.898818 26242 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:26.900262 26283 leader_election.cc:304] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:26.901232 26439 raft_consensus.cc:2804] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.901758 26439 raft_consensus.cc:697] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:26.902674 26439 consensus_queue.cc:237] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.904650 26391 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:26.904894 26462 consensus_queue.cc:1048] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.915881 26138 catalog_manager.cc:5697] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.917163 26463 consensus_queue.cc:1048] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.918758 26463 raft_consensus.cc:993] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:26.919229 26463 raft_consensus.cc:1081] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:26.923978 26463 consensus_queue.cc:1048] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.928987 26241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:56348
I20260709 13:10:26.929829 26241 raft_consensus.cc:493] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.930250 26241 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.933207 26462 consensus_queue.cc:1048] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.949225 26457 consensus_queue.cc:1048] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.950314 26241 raft_consensus.cc:515] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.961100 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:26.962273 26241 leader_election.cc:290] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:26.966958 26462 consensus_queue.cc:1048] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.967226 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:26.967967 26391 raft_consensus.cc:3055] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.968324 26391 raft_consensus.cc:740] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:26.969271 26391 consensus_queue.cc:260] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:26.971429 26391 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.973023 26492 consensus_queue.cc:1048] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.977694 26440 raft_consensus.cc:993] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:26.978229 26440 raft_consensus.cc:1081] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:26.985042 26391 raft_consensus.cc:2468] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:26.989709 26208 leader_election.cc:304] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: c451651b617341639688174fd5e3d173
I20260709 13:10:26.990295 26243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:56348
I20260709 13:10:26.990741 26492 raft_consensus.cc:2804] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.991007 26243 raft_consensus.cc:493] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.991375 26492 raft_consensus.cc:697] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:26.991590 26243 raft_consensus.cc:3060] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.992372 26492 consensus_queue.cc:237] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.003688 26243 raft_consensus.cc:515] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:27.005014 26241 raft_consensus.cc:1240] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Rejecting Update request from peer 0d9d330f85b14acf9283b9fadb609f61 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:27.008173 26243 leader_election.cc:290] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:27.008234 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:27.009928 26316 raft_consensus.cc:3060] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.014784 26462 raft_consensus.cc:993] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:27.015009 26463 consensus_queue.cc:1059] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.015410 26462 raft_consensus.cc:1081] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:27.016638 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39b31d8b1314efb8f651537358cbdea" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:27.017107 26463 raft_consensus.cc:3055] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.017417 26241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:56348
I20260709 13:10:27.017598 26463 raft_consensus.cc:740] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:27.018090 26316 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:27.018239 26241 raft_consensus.cc:493] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.018778 26241 raft_consensus.cc:3060] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.019419 26207 leader_election.cc:304] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:27.018793 26463 consensus_queue.cc:260] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:27.020543 26492 raft_consensus.cc:2804] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.021013 26463 raft_consensus.cc:3060] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.021121 26492 raft_consensus.cc:697] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:27.021610 26139 catalog_manager.cc:5697] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.022557 26492 consensus_queue.cc:237] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } }
I20260709 13:10:27.027034 26241 raft_consensus.cc:515] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.029855 26241 leader_election.cc:290] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:27.030616 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:27.031208 26391 raft_consensus.cc:3055] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.031543 26391 raft_consensus.cc:740] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:27.032405 26391 consensus_queue.cc:260] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.032552 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919b09826ea6430ca668c7fa5da03da8" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:27.033383 26316 raft_consensus.cc:3060] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.033390 26391 raft_consensus.cc:3060] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.039698 26392 raft_consensus.cc:2468] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:27.040612 26391 raft_consensus.cc:2468] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:27.042297 26208 leader_election.cc:304] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:27.043576 26316 raft_consensus.cc:2468] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:27.044543 26492 raft_consensus.cc:2804] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.045179 26492 raft_consensus.cc:697] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:27.046166 26492 consensus_queue.cc:237] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.046818 26138 catalog_manager.cc:5697] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.060788 26138 catalog_manager.cc:5697] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.107184 26241 raft_consensus.cc:1275] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.108803 26498 consensus_queue.cc:1048] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.119323 26392 raft_consensus.cc:1275] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.120905 26439 consensus_queue.cc:1048] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.136802 26457 raft_consensus.cc:993] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: : Instructing follower c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:27.137358 26492 raft_consensus.cc:1081] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Signalling peer c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:27.139381 26316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55"
dest_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:32878
I20260709 13:10:27.140072 26316 raft_consensus.cc:493] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.140420 26316 raft_consensus.cc:3060] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.146291 26316 raft_consensus.cc:515] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.148519 26316 leader_election.cc:290] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:27.149350 26241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:27.149595 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc47b53a429438caae05c72fbd92d55" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:27.150095 26241 raft_consensus.cc:3055] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.150199 26392 raft_consensus.cc:3060] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.150480 26241 raft_consensus.cc:740] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:27.151376 26241 consensus_queue.cc:260] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.152630 26241 raft_consensus.cc:3060] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.157851 26392 raft_consensus.cc:2468] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:27.159385 26283 leader_election.cc:304] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:27.159708 26241 raft_consensus.cc:2468] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:27.160291 26513 raft_consensus.cc:2804] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.160795 26513 raft_consensus.cc:697] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:27.161527 26513 consensus_queue.cc:237] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:27.167936 26138 catalog_manager.cc:5697] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 1 to 2, leader changed from 1f14905185ba41b5954e2d95761a8712 (127.14.45.1) to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.328122 26392 raft_consensus.cc:1275] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.329409 26513 consensus_queue.cc:1048] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.337348 26241 raft_consensus.cc:1275] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.338565 26391 raft_consensus.cc:1275] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.340205 26513 consensus_queue.cc:1048] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.340869 26498 consensus_queue.cc:1048] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.346534 26243 raft_consensus.cc:1275] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer 0d9d330f85b14acf9283b9fadb609f61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.348155 26462 consensus_queue.cc:1048] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.352348 26243 raft_consensus.cc:1275] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.354185 26514 consensus_queue.cc:1048] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.360212 26316 raft_consensus.cc:1275] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Refusing update from remote peer 0d9d330f85b14acf9283b9fadb609f61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.362171 26475 consensus_queue.cc:1048] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.469590 26316 raft_consensus.cc:1275] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.470888 26492 consensus_queue.cc:1048] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.479130 26391 raft_consensus.cc:1275] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.480844 26492 consensus_queue.cc:1048] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.527901 26391 raft_consensus.cc:1275] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.529142 26492 consensus_queue.cc:1048] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.537423 26316 raft_consensus.cc:1275] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.539280 26516 consensus_queue.cc:1048] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.547868 26241 raft_consensus.cc:1275] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.549268 26514 consensus_queue.cc:1048] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.559182 26391 raft_consensus.cc:1275] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.561081 26514 consensus_queue.cc:1048] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.604832 26391 raft_consensus.cc:1275] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.606272 26516 consensus_queue.cc:1048] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.613644 26316 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.621600 26316 raft_consensus.cc:1275] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.622951 26457 consensus_queue.cc:1048] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.679488 26140 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56772:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:29.681617 26140 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:29.731052 26229 tablet_service.cc:1511] Processing CreateTablet for tablet 72267794052e4aa093b82b0f3dfbdb9b (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.732367 26229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72267794052e4aa093b82b0f3dfbdb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.732461 26307 tablet_service.cc:1511] Processing CreateTablet for tablet 72267794052e4aa093b82b0f3dfbdb9b (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.733961 26307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72267794052e4aa093b82b0f3dfbdb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.733814 26378 tablet_service.cc:1511] Processing CreateTablet for tablet 72267794052e4aa093b82b0f3dfbdb9b (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.735149 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72267794052e4aa093b82b0f3dfbdb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.741597 26305 tablet_service.cc:1511] Processing CreateTablet for tablet 7fab30bd62b7440face1864b386606e6 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.743060 26305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fab30bd62b7440face1864b386606e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.742834 26231 tablet_service.cc:1511] Processing CreateTablet for tablet 7fab30bd62b7440face1864b386606e6 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.744614 26231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fab30bd62b7440face1864b386606e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.742834 26379 tablet_service.cc:1511] Processing CreateTablet for tablet 7fab30bd62b7440face1864b386606e6 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.748121 26379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fab30bd62b7440face1864b386606e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.767277 26531 tablet_bootstrap.cc:492] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:29.769521 26233 tablet_service.cc:1511] Processing CreateTablet for tablet bc6eaa67c284473eaeacae1b3c3cc529 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.771080 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6eaa67c284473eaeacae1b3c3cc529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.773957 26304 tablet_service.cc:1511] Processing CreateTablet for tablet bc6eaa67c284473eaeacae1b3c3cc529 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.775705 26304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6eaa67c284473eaeacae1b3c3cc529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.775315 26376 tablet_service.cc:1511] Processing CreateTablet for tablet bc6eaa67c284473eaeacae1b3c3cc529 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.777580 26376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6eaa67c284473eaeacae1b3c3cc529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.780620 26230 tablet_service.cc:1511] Processing CreateTablet for tablet da9811da76234d248601c049234b1715 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.782207 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da9811da76234d248601c049234b1715. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:29.806406 26283 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:42997, user_credentials={real_user=slave}} blocked reactor thread for 56035.5us
I20260709 13:10:29.817292 26307 tablet_service.cc:1511] Processing CreateTablet for tablet da9811da76234d248601c049234b1715 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.819003 26307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da9811da76234d248601c049234b1715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.825938 26530 tablet_bootstrap.cc:492] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:29.832471 26531 tablet_bootstrap.cc:654] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.832688 26378 tablet_service.cc:1511] Processing CreateTablet for tablet da9811da76234d248601c049234b1715 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.834839 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da9811da76234d248601c049234b1715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.838112 26226 tablet_service.cc:1511] Processing CreateTablet for tablet 11db461c9b5e4ab9963e3a6098b4a280 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.839700 26226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11db461c9b5e4ab9963e3a6098b4a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.846869 26530 tablet_bootstrap.cc:654] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.847507 26531 tablet_bootstrap.cc:492] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:29.848125 26531 ts_tablet_manager.cc:1403] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 13:10:29.862102 26532 tablet_bootstrap.cc:492] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:29.869410 26532 tablet_bootstrap.cc:654] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.861158 26531 raft_consensus.cc:359] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.870121 26531 raft_consensus.cc:385] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.870486 26531 raft_consensus.cc:740] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.871443 26531 consensus_queue.cc:260] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.873090 26305 tablet_service.cc:1511] Processing CreateTablet for tablet 11db461c9b5e4ab9963e3a6098b4a280 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.874708 26305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11db461c9b5e4ab9963e3a6098b4a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.875643 26376 tablet_service.cc:1511] Processing CreateTablet for tablet 11db461c9b5e4ab9963e3a6098b4a280 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.876499 26531 ts_tablet_manager.cc:1434] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:29.877069 26376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11db461c9b5e4ab9963e3a6098b4a280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.877849 26531 tablet_bootstrap.cc:492] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:29.882594 26229 tablet_service.cc:1511] Processing CreateTablet for tablet 68d1c7c95c004e30926c6c62ed776921 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.884060 26229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d1c7c95c004e30926c6c62ed776921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.889011 26304 tablet_service.cc:1511] Processing CreateTablet for tablet 68d1c7c95c004e30926c6c62ed776921 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.890595 26379 tablet_service.cc:1511] Processing CreateTablet for tablet 68d1c7c95c004e30926c6c62ed776921 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.891249 26304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d1c7c95c004e30926c6c62ed776921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.892120 26379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d1c7c95c004e30926c6c62ed776921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.905260 26233 tablet_service.cc:1511] Processing CreateTablet for tablet 68724e03ae474ba4a5b3981e0d17a2c1 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.907799 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68724e03ae474ba4a5b3981e0d17a2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.910758 26530 tablet_bootstrap.cc:492] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:29.911378 26530 ts_tablet_manager.cc:1403] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.086s	user 0.042s	sys 0.007s
I20260709 13:10:29.914693 26530 raft_consensus.cc:359] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.915491 26530 raft_consensus.cc:385] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.915802 26530 raft_consensus.cc:740] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.925660 26226 tablet_service.cc:1511] Processing CreateTablet for tablet b20370852b9847a287f634b1121d18e0 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.927098 26226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20370852b9847a287f634b1121d18e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.925560 26302 tablet_service.cc:1511] Processing CreateTablet for tablet 68724e03ae474ba4a5b3981e0d17a2c1 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.930711 26302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68724e03ae474ba4a5b3981e0d17a2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.930962 26378 tablet_service.cc:1511] Processing CreateTablet for tablet 68724e03ae474ba4a5b3981e0d17a2c1 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.932435 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68724e03ae474ba4a5b3981e0d17a2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.916548 26530 consensus_queue.cc:260] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.934171 26531 tablet_bootstrap.cc:654] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.937806 26530 ts_tablet_manager.cc:1434] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:10:29.938851 26530 tablet_bootstrap.cc:492] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:29.952044 26532 tablet_bootstrap.cc:492] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:29.953545 26532 ts_tablet_manager.cc:1403] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.004s
I20260709 13:10:29.955027 26307 tablet_service.cc:1511] Processing CreateTablet for tablet b20370852b9847a287f634b1121d18e0 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.957319 26530 tablet_bootstrap.cc:654] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.961359 26532 raft_consensus.cc:359] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.962316 26532 raft_consensus.cc:385] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.962666 26532 raft_consensus.cc:740] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.963194 26379 tablet_service.cc:1511] Processing CreateTablet for tablet b20370852b9847a287f634b1121d18e0 (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.966670 26379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20370852b9847a287f634b1121d18e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.966298 26532 consensus_queue.cc:260] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.974215 26531 tablet_bootstrap.cc:492] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:29.974901 26531 ts_tablet_manager.cc:1403] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.004s
I20260709 13:10:29.975819 26307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20370852b9847a287f634b1121d18e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.977151 26226 tablet_service.cc:1511] Processing CreateTablet for tablet 8458a2764a2c4f378500b113c748fe5c (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.978595 26226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8458a2764a2c4f378500b113c748fe5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.978470 26531 raft_consensus.cc:359] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.979338 26531 raft_consensus.cc:385] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.979655 26531 raft_consensus.cc:740] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.980444 26531 consensus_queue.cc:260] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:29.983703 26532 ts_tablet_manager.cc:1434] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:10:29.985276 26532 tablet_bootstrap.cc:492] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:29.994840 26531 ts_tablet_manager.cc:1434] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:10:29.996557 26531 tablet_bootstrap.cc:492] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.000290 26304 tablet_service.cc:1511] Processing CreateTablet for tablet 8458a2764a2c4f378500b113c748fe5c (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:30.001655 26304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8458a2764a2c4f378500b113c748fe5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.003288 26378 tablet_service.cc:1511] Processing CreateTablet for tablet 8458a2764a2c4f378500b113c748fe5c (DEFAULT_TABLE table=soft_deleted_table [id=aac029306d29450599175d65992037f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:30.004683 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8458a2764a2c4f378500b113c748fe5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.028616 26532 tablet_bootstrap.cc:654] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.048578 26518 raft_consensus.cc:493] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.049227 26518 raft_consensus.cc:515] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.050979 26531 tablet_bootstrap.cc:654] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.051555 26518 leader_election.cc:290] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.052121 26530 tablet_bootstrap.cc:492] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.052663 26530 ts_tablet_manager.cc:1403] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.023s
I20260709 13:10:30.053773 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72267794052e4aa093b82b0f3dfbdb9b" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:30.054505 26391 raft_consensus.cc:2468] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:30.055773 26208 leader_election.cc:304] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.055856 26530 raft_consensus.cc:359] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.056725 26530 raft_consensus.cc:385] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.056818 26518 raft_consensus.cc:2804] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.057466 26518 raft_consensus.cc:493] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.057643 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72267794052e4aa093b82b0f3dfbdb9b" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:30.057932 26518 raft_consensus.cc:3060] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.058405 26316 raft_consensus.cc:2468] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:30.057066 26530 raft_consensus.cc:740] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.063675 26530 consensus_queue.cc:260] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.066624 26518 raft_consensus.cc:515] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.069660 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72267794052e4aa093b82b0f3dfbdb9b" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.069890 26518 leader_election.cc:290] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.070415 26532 tablet_bootstrap.cc:492] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.070284 26316 raft_consensus.cc:3060] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.070983 26532 ts_tablet_manager.cc:1403] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.000s
I20260709 13:10:30.071539 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72267794052e4aa093b82b0f3dfbdb9b" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.072180 26391 raft_consensus.cc:3060] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.075430 26531 tablet_bootstrap.cc:492] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.076001 26531 ts_tablet_manager.cc:1403] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.008s
I20260709 13:10:30.077244 26391 raft_consensus.cc:2468] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:30.078358 26208 leader_election.cc:304] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.078261 26532 raft_consensus.cc:359] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.079043 26532 raft_consensus.cc:385] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.079265 26518 raft_consensus.cc:2804] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.079156 26531 raft_consensus.cc:359] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.079777 26530 ts_tablet_manager.cc:1434] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:10:30.080111 26531 raft_consensus.cc:385] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.079901 26316 raft_consensus.cc:2468] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:30.080560 26531 raft_consensus.cc:740] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.081373 26531 consensus_queue.cc:260] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.082603 26518 raft_consensus.cc:697] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:30.083776 26530 tablet_bootstrap.cc:492] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.084503 26518 consensus_queue.cc:237] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.090780 26531 ts_tablet_manager.cc:1434] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:10:30.091943 26531 tablet_bootstrap.cc:492] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.092267 26530 tablet_bootstrap.cc:654] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.093832 26532 raft_consensus.cc:740] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.094908 26532 consensus_queue.cc:260] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.098205 26532 ts_tablet_manager.cc:1434] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:10:30.099372 26532 tablet_bootstrap.cc:492] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.101826 26531 tablet_bootstrap.cc:654] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.104809 26532 tablet_bootstrap.cc:654] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.108714 26530 tablet_bootstrap.cc:492] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.108568 26139 catalog_manager.cc:5697] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.109529 26530 ts_tablet_manager.cc:1403] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:10:30.114369 26530 raft_consensus.cc:359] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.115178 26530 raft_consensus.cc:385] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.115568 26530 raft_consensus.cc:740] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.116714 26530 consensus_queue.cc:260] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.122083 26530 ts_tablet_manager.cc:1434] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:10:30.122838 26532 tablet_bootstrap.cc:492] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.123483 26532 ts_tablet_manager.cc:1403] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.005s
I20260709 13:10:30.123869 26531 tablet_bootstrap.cc:492] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.125759 26530 tablet_bootstrap.cc:492] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.127560 26532 raft_consensus.cc:359] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.128278 26531 ts_tablet_manager.cc:1403] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.008s
I20260709 13:10:30.128347 26532 raft_consensus.cc:385] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.129277 26532 raft_consensus.cc:740] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.130288 26532 consensus_queue.cc:260] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.132218 26531 raft_consensus.cc:359] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.132790 26532 ts_tablet_manager.cc:1434] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:30.133010 26531 raft_consensus.cc:385] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.133630 26531 raft_consensus.cc:740] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.134393 26532 tablet_bootstrap.cc:492] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.134729 26531 consensus_queue.cc:260] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.137452 26530 tablet_bootstrap.cc:654] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.142011 26532 tablet_bootstrap.cc:654] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.142553 26531 ts_tablet_manager.cc:1434] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:10:30.143651 26531 tablet_bootstrap.cc:492] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.150346 26531 tablet_bootstrap.cc:654] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.155920 26532 tablet_bootstrap.cc:492] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.156482 26532 ts_tablet_manager.cc:1403] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.017s
I20260709 13:10:30.157395 26530 tablet_bootstrap.cc:492] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.157994 26530 ts_tablet_manager.cc:1403] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.005s
I20260709 13:10:30.158790 26531 tablet_bootstrap.cc:492] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.159387 26531 ts_tablet_manager.cc:1403] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:10:30.159408 26532 raft_consensus.cc:359] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.161183 26530 raft_consensus.cc:359] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
W20260709 13:10:30.162822 26189 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:30.162590 26531 raft_consensus.cc:359] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.162938 26532 raft_consensus.cc:385] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.163065 26530 raft_consensus.cc:385] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.163334 26531 raft_consensus.cc:385] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.163434 26532 raft_consensus.cc:740] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.163614 26530 raft_consensus.cc:740] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.163841 26531 raft_consensus.cc:740] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.164566 26531 consensus_queue.cc:260] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.164557 26532 consensus_queue.cc:260] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.164556 26530 consensus_queue.cc:260] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.167188 26531 ts_tablet_manager.cc:1434] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:30.167399 26532 ts_tablet_manager.cc:1434] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:10:30.168219 26531 tablet_bootstrap.cc:492] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.170197 26530 ts_tablet_manager.cc:1434] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:10:30.171653 26530 tablet_bootstrap.cc:492] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.179981 26530 tablet_bootstrap.cc:654] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.180925 26532 tablet_bootstrap.cc:492] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.188042 26532 tablet_bootstrap.cc:654] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.189706 26531 tablet_bootstrap.cc:654] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.197515 26530 tablet_bootstrap.cc:492] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.198133 26530 ts_tablet_manager.cc:1403] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:10:30.199461 26532 tablet_bootstrap.cc:492] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.199517 26531 tablet_bootstrap.cc:492] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.200139 26532 ts_tablet_manager.cc:1403] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.012s
I20260709 13:10:30.200244 26531 ts_tablet_manager.cc:1403] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.000s
I20260709 13:10:30.201478 26530 raft_consensus.cc:359] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.202366 26530 raft_consensus.cc:385] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.202737 26530 raft_consensus.cc:740] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.203311 26532 raft_consensus.cc:359] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.204144 26532 raft_consensus.cc:385] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.203644 26531 raft_consensus.cc:359] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.203698 26530 consensus_queue.cc:260] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.204506 26532 raft_consensus.cc:740] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.204684 26531 raft_consensus.cc:385] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.205124 26531 raft_consensus.cc:740] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.206076 26531 consensus_queue.cc:260] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.206861 26530 ts_tablet_manager.cc:1434] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:30.207970 26530 tablet_bootstrap.cc:492] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.208581 26531 ts_tablet_manager.cc:1434] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:10:30.209775 26531 tablet_bootstrap.cc:492] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.214785 26530 tablet_bootstrap.cc:654] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.216349 26531 tablet_bootstrap.cc:654] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.220450 26532 consensus_queue.cc:260] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.222910 26531 tablet_bootstrap.cc:492] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.223462 26531 ts_tablet_manager.cc:1403] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:10:30.222980 26532 ts_tablet_manager.cc:1434] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:10:30.225968 26532 tablet_bootstrap.cc:492] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.226512 26530 tablet_bootstrap.cc:492] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.227046 26530 ts_tablet_manager.cc:1403] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:10:30.227162 26531 raft_consensus.cc:359] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.227991 26531 raft_consensus.cc:385] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.228294 26531 raft_consensus.cc:740] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.229180 26531 consensus_queue.cc:260] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.232478 26532 tablet_bootstrap.cc:654] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.230490 26530 raft_consensus.cc:359] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.233587 26530 raft_consensus.cc:385] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.233919 26530 raft_consensus.cc:740] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.234439 26531 ts_tablet_manager.cc:1434] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:30.234727 26530 consensus_queue.cc:260] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.235641 26531 tablet_bootstrap.cc:492] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.237207 26530 ts_tablet_manager.cc:1434] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:10:30.240129 26530 tablet_bootstrap.cc:492] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.242904 26531 tablet_bootstrap.cc:654] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.246946 26530 tablet_bootstrap.cc:654] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.253142 26532 tablet_bootstrap.cc:492] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.253803 26532 ts_tablet_manager.cc:1403] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:10:30.257323 26530 tablet_bootstrap.cc:492] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.257162 26532 raft_consensus.cc:359] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.257977 26530 ts_tablet_manager.cc:1403] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:10:30.258176 26532 raft_consensus.cc:385] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.258342 26518 raft_consensus.cc:493] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.258674 26532 raft_consensus.cc:740] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.259029 26518 raft_consensus.cc:515] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.259770 26532 consensus_queue.cc:260] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.261364 26530 raft_consensus.cc:359] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.262249 26530 raft_consensus.cc:385] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.262552 26532 ts_tablet_manager.cc:1434] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:30.262569 26530 raft_consensus.cc:740] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.262969 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da9811da76234d248601c049234b1715" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:30.263613 26391 raft_consensus.cc:2468] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:30.263635 26531 tablet_bootstrap.cc:492] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.263921 26532 tablet_bootstrap.cc:492] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.261806 26517 raft_consensus.cc:493] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.264328 26531 ts_tablet_manager.cc:1403] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.003s
I20260709 13:10:30.264537 26517 raft_consensus.cc:515] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.266669 26517 leader_election.cc:290] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.266253 26530 consensus_queue.cc:260] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.267231 26531 raft_consensus.cc:359] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.270398 26530 ts_tablet_manager.cc:1434] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:30.270872 26531 raft_consensus.cc:385] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.271553 26532 tablet_bootstrap.cc:654] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.271746 26531 raft_consensus.cc:740] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.272619 26530 tablet_bootstrap.cc:492] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.272714 26531 consensus_queue.cc:260] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.273488 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fab30bd62b7440face1864b386606e6" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.274329 26243 raft_consensus.cc:2468] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.275410 26531 ts_tablet_manager.cc:1434] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:30.276717 26531 tablet_bootstrap.cc:492] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: Bootstrap starting.
I20260709 13:10:30.280740 26530 tablet_bootstrap.cc:654] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.285020 26208 leader_election.cc:304] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.285573 26531 tablet_bootstrap.cc:654] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.287623 26558 raft_consensus.cc:2804] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.288110 26558 raft_consensus.cc:493] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.288462 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da9811da76234d248601c049234b1715" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:30.288486 26558 raft_consensus.cc:3060] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.289506 26316 raft_consensus.cc:2468] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 0.
I20260709 13:10:30.282727 26283 leader_election.cc:304] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.291666 26529 raft_consensus.cc:2804] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.292088 26529 raft_consensus.cc:493] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.292451 26529 raft_consensus.cc:3060] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.294839 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fab30bd62b7440face1864b386606e6" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:30.295941 26391 raft_consensus.cc:2468] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.298781 26530 tablet_bootstrap.cc:492] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.299397 26530 ts_tablet_manager.cc:1403] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:10:30.302551 26530 raft_consensus.cc:359] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.303287 26530 raft_consensus.cc:385] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.303579 26530 raft_consensus.cc:740] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.308864 26558 raft_consensus.cc:515] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.310737 26530 consensus_queue.cc:260] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.312655 26530 ts_tablet_manager.cc:1434] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:30.312755 26518 leader_election.cc:290] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.313661 26530 tablet_bootstrap.cc:492] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: Bootstrap starting.
I20260709 13:10:30.318496 26475 raft_consensus.cc:493] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.319315 26475 raft_consensus.cc:515] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.320204 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da9811da76234d248601c049234b1715" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.320914 26316 raft_consensus.cc:3060] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.322074 26475 leader_election.cc:290] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:30.328236 26517 raft_consensus.cc:493] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.328853 26517 raft_consensus.cc:515] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.330862 26558 leader_election.cc:290] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.331795 26517 leader_election.cc:290] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
W20260709 13:10:30.333693 26208 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.45.3:42997, user_credentials={real_user=slave}} blocked reactor thread for 48827us
I20260709 13:10:30.335753 26531 tablet_bootstrap.cc:492] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: No bootstrap required, opened a new log
I20260709 13:10:30.336676 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.337522 26243 raft_consensus.cc:2468] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:30.338619 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da9811da76234d248601c049234b1715" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.339464 26391 raft_consensus.cc:3060] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.339794 26530 tablet_bootstrap.cc:654] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.343334 26357 leader_election.cc:304] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.345221 26475 raft_consensus.cc:2804] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.345724 26475 raft_consensus.cc:493] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.350090 26475 raft_consensus.cc:3060] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.352007 26530 tablet_bootstrap.cc:492] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: No bootstrap required, opened a new log
I20260709 13:10:30.352615 26530 ts_tablet_manager.cc:1403] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.007s
I20260709 13:10:30.355906 26530 raft_consensus.cc:359] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.356902 26530 raft_consensus.cc:385] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.357292 26530 raft_consensus.cc:740] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.358321 26530 consensus_queue.cc:260] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.338711 26316 raft_consensus.cc:2468] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:30.361202 26531 ts_tablet_manager.cc:1403] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.011s
I20260709 13:10:30.358249 26529 raft_consensus.cc:515] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.366403 26530 ts_tablet_manager.cc:1434] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:10:30.372416 26207 leader_election.cc:304] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.373106 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.373550 26558 raft_consensus.cc:2804] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.373682 26529 leader_election.cc:290] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.373986 26243 raft_consensus.cc:2468] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.374280 26558 raft_consensus.cc:697] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:30.375260 26558 consensus_queue.cc:237] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.377537 26531 raft_consensus.cc:359] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.378355 26531 raft_consensus.cc:385] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.378634 26531 raft_consensus.cc:740] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.379588 26531 consensus_queue.cc:260] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.383004 26531 ts_tablet_manager.cc:1434] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:10:30.385947 26532 tablet_bootstrap.cc:492] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.387207 26532 ts_tablet_manager.cc:1403] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.124s	user 0.033s	sys 0.060s
I20260709 13:10:30.390157 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fab30bd62b7440face1864b386606e6" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.390995 26243 raft_consensus.cc:3060] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.392829 26391 raft_consensus.cc:2468] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 1.
I20260709 13:10:30.390035 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:30.398113 26392 raft_consensus.cc:2468] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.394977 26316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:30.400208 26316 raft_consensus.cc:2468] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:30.393232 26475 raft_consensus.cc:515] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.403012 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fab30bd62b7440face1864b386606e6" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.396458 26532 raft_consensus.cc:359] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.403784 26392 raft_consensus.cc:3060] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.405125 26243 raft_consensus.cc:2468] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.403822 26532 raft_consensus.cc:385] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.409775 26532 raft_consensus.cc:740] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.410642 26532 consensus_queue.cc:260] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.410920 26138 catalog_manager.cc:5697] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 1 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.413290 26532 ts_tablet_manager.cc:1434] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:10:30.414361 26532 tablet_bootstrap.cc:492] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.415692 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.416358 26243 raft_consensus.cc:3060] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.419788 26283 leader_election.cc:304] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.420895 26532 tablet_bootstrap.cc:654] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.421880 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.421659 26475 leader_election.cc:290] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:30.422566 26317 raft_consensus.cc:3060] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.423048 26283 leader_election.cc:304] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.423903 26243 raft_consensus.cc:2468] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:30.425113 26357 leader_election.cc:304] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.425964 26561 raft_consensus.cc:2804] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.426101 26475 raft_consensus.cc:2804] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.426608 26561 raft_consensus.cc:493] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.427174 26561 raft_consensus.cc:3060] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.428105 26475 raft_consensus.cc:697] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:30.428890 26475 consensus_queue.cc:237] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.430020 26517 raft_consensus.cc:2804] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.439848 26561 raft_consensus.cc:515] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.442826 26561 leader_election.cc:290] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.444702 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.445413 26392 raft_consensus.cc:2468] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.445693 26243 raft_consensus.cc:3060] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.446002 26317 raft_consensus.cc:2468] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:30.446995 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.447660 26391 raft_consensus.cc:3060] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.443477 26517 raft_consensus.cc:697] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:30.450706 26532 tablet_bootstrap.cc:492] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.451246 26532 ts_tablet_manager.cc:1403] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.004s
I20260709 13:10:30.454032 26532 raft_consensus.cc:359] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.454701 26532 raft_consensus.cc:385] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.454993 26532 raft_consensus.cc:740] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.455354 26243 raft_consensus.cc:2468] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.455657 26532 consensus_queue.cc:260] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.447680 26561 raft_consensus.cc:493] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.459240 26391 raft_consensus.cc:2468] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.459543 26561 raft_consensus.cc:515] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.455381 26517 consensus_queue.cc:237] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.461884 26561 leader_election.cc:290] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.463277 26283 leader_election.cc:304] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.463289 26241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11db461c9b5e4ab9963e3a6098b4a280" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.466202 26241 raft_consensus.cc:2468] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.466365 26561 raft_consensus.cc:2804] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.463709 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11db461c9b5e4ab9963e3a6098b4a280" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:30.467008 26561 raft_consensus.cc:697] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:30.467712 26391 raft_consensus.cc:2468] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.468168 26561 consensus_queue.cc:237] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.469696 26283 leader_election.cc:304] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.470582 26565 raft_consensus.cc:2804] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.468197 26532 ts_tablet_manager.cc:1434] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:30.470983 26565 raft_consensus.cc:493] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.471361 26565 raft_consensus.cc:3060] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.471864 26532 tablet_bootstrap.cc:492] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: Bootstrap starting.
I20260709 13:10:30.478832 26532 tablet_bootstrap.cc:654] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.490209 26138 catalog_manager.cc:5697] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.491461 26532 tablet_bootstrap.cc:492] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: No bootstrap required, opened a new log
I20260709 13:10:30.492003 26532 ts_tablet_manager.cc:1403] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:10:30.495072 26565 raft_consensus.cc:515] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.495195 26532 raft_consensus.cc:359] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.496183 26532 raft_consensus.cc:385] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.496520 26532 raft_consensus.cc:740] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.498374 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11db461c9b5e4ab9963e3a6098b4a280" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.499044 26243 raft_consensus.cc:3060] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.504558 26475 raft_consensus.cc:493] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.505146 26475 raft_consensus.cc:515] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.508299 26241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458a2764a2c4f378500b113c748fe5c" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.508874 26475 leader_election.cc:290] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:30.497346 26532 consensus_queue.cc:260] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.509292 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458a2764a2c4f378500b113c748fe5c" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:30.510160 26241 raft_consensus.cc:2468] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:30.510413 26317 raft_consensus.cc:2468] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:30.507027 26243 raft_consensus.cc:2468] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.512310 26356 leader_election.cc:304] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.513422 26283 leader_election.cc:304] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.513672 26475 raft_consensus.cc:2804] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.514197 26475 raft_consensus.cc:493] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.514529 26475 raft_consensus.cc:3060] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.514407 26529 raft_consensus.cc:2804] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.514379 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11db461c9b5e4ab9963e3a6098b4a280" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.516312 26391 raft_consensus.cc:3060] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.516556 26532 ts_tablet_manager.cc:1434] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:10:30.519550 26518 consensus_queue.cc:1048] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.520788 26558 consensus_queue.cc:1048] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.524571 26475 raft_consensus.cc:515] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.525767 26565 leader_election.cc:290] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.535298 26475 leader_election.cc:290] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:30.529415 26391 raft_consensus.cc:2468] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.537760 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458a2764a2c4f378500b113c748fe5c" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.538709 26243 raft_consensus.cc:3060] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.538829 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458a2764a2c4f378500b113c748fe5c" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.539558 26317 raft_consensus.cc:3060] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.552839 26317 raft_consensus.cc:2468] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:30.554672 26529 raft_consensus.cc:697] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:30.555249 26356 leader_election.cc:304] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.556475 26475 raft_consensus.cc:2804] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.556154 26529 consensus_queue.cc:237] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.557082 26475 raft_consensus.cc:697] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:30.558038 26475 consensus_queue.cc:237] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.563030 26243 raft_consensus.cc:2468] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:30.572383 26570 raft_consensus.cc:493] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.573243 26570 raft_consensus.cc:515] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.578022 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20370852b9847a287f634b1121d18e0" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.578790 26243 raft_consensus.cc:2468] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.580200 26283 leader_election.cc:304] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.582050 26572 raft_consensus.cc:2804] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.582592 26572 raft_consensus.cc:493] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.583076 26572 raft_consensus.cc:3060] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.585479 26138 catalog_manager.cc:5697] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.612607 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20370852b9847a287f634b1121d18e0" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61" is_pre_election: true
I20260709 13:10:30.613405 26392 raft_consensus.cc:2468] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 0.
I20260709 13:10:30.618068 26570 leader_election.cc:290] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.620323 26572 raft_consensus.cc:515] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.621403 26139 catalog_manager.cc:5697] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 0 to 1, leader changed from <none> to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.623458 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20370852b9847a287f634b1121d18e0" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.622961 26139 catalog_manager.cc:5697] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 0 to 1, leader changed from <none> to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.624030 26572 leader_election.cc:290] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.624110 26243 raft_consensus.cc:3060] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.625008 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20370852b9847a287f634b1121d18e0" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.625550 26392 raft_consensus.cc:3060] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.625579 26139 catalog_manager.cc:5697] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 0 to 1, leader changed from <none> to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.632184 26243 raft_consensus.cc:2468] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.633294 26283 leader_election.cc:304] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:30.634100 26392 raft_consensus.cc:2468] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 1.
I20260709 13:10:30.635066 26572 raft_consensus.cc:2804] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.635708 26572 raft_consensus.cc:697] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:30.636689 26572 consensus_queue.cc:237] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.649574 26475 raft_consensus.cc:493] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.650324 26475 raft_consensus.cc:515] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.650319 26139 catalog_manager.cc:5697] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 0 to 1, leader changed from <none> to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 1 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.653169 26475 leader_election.cc:290] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:30.653931 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712" is_pre_election: true
I20260709 13:10:30.654371 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173" is_pre_election: true
I20260709 13:10:30.654655 26243 raft_consensus.cc:2468] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:30.655069 26317 raft_consensus.cc:2468] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 0.
I20260709 13:10:30.655835 26357 leader_election.cc:304] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.656826 26475 raft_consensus.cc:2804] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.657339 26475 raft_consensus.cc:493] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.657712 26475 raft_consensus.cc:3060] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.664300 26475 raft_consensus.cc:515] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.666281 26475 leader_election.cc:290] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:30.667073 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:30.667625 26243 raft_consensus.cc:3060] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.667619 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.668367 26317 raft_consensus.cc:3060] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.672433 26243 raft_consensus.cc:2468] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:30.673527 26357 leader_election.cc:304] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.673619 26317 raft_consensus.cc:2468] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 1.
I20260709 13:10:30.674378 26475 raft_consensus.cc:2804] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.674893 26475 raft_consensus.cc:697] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:30.675621 26475 consensus_queue.cc:237] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.682896 26139 catalog_manager.cc:5697] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 1 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.766896 26558 consensus_queue.cc:1048] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.780157 26558 consensus_queue.cc:1048] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.877164 26317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fab30bd62b7440face1864b386606e6"
dest_uuid: "c451651b617341639688174fd5e3d173"
mode: GRACEFUL
new_leader_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:10:30.877915 26317 raft_consensus.cc:606] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Received request to transfer leadership to TS 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:30.883970 26317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529"
dest_uuid: "c451651b617341639688174fd5e3d173"
mode: GRACEFUL
new_leader_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:10:30.884608 26317 raft_consensus.cc:606] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Received request to transfer leadership to TS 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:30.887878 26572 consensus_queue.cc:1048] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.895571 26570 raft_consensus.cc:993] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: : Instructing follower 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:30.896065 26570 raft_consensus.cc:1081] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Signalling peer 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:30.900314 26243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:56346
I20260709 13:10:30.900398 26392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:30.900899 26243 raft_consensus.cc:493] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.901073 26392 raft_consensus.cc:606] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS c451651b617341639688174fd5e3d173
I20260709 13:10:30.901326 26243 raft_consensus.cc:3060] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.903503 26572 consensus_queue.cc:1048] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.907766 26391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
mode: GRACEFUL
new_leader_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:42162
I20260709 13:10:30.908365 26391 raft_consensus.cc:606] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Received request to transfer leadership to TS c451651b617341639688174fd5e3d173
I20260709 13:10:30.910372 26243 raft_consensus.cc:515] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.912436 26241 raft_consensus.cc:1240] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Rejecting Update request from peer c451651b617341639688174fd5e3d173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.913219 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.913903 26317 raft_consensus.cc:3055] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.914247 26317 raft_consensus.cc:740] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:30.915060 26317 consensus_queue.cc:260] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.915614 26243 leader_election.cc:290] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.915946 26572 consensus_queue.cc:1059] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.917097 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6eaa67c284473eaeacae1b3c3cc529" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.917683 26392 raft_consensus.cc:3060] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.920610 26570 consensus_queue.cc:1048] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.920147 26317 raft_consensus.cc:3060] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.926780 26392 raft_consensus.cc:2468] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:30.928043 26208 leader_election.cc:304] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.928835 26582 raft_consensus.cc:2804] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.928890 26529 raft_consensus.cc:993] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: : Instructing follower 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:30.929333 26582 raft_consensus.cc:697] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:30.929468 26529 raft_consensus.cc:1081] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Signalling peer 1f14905185ba41b5954e2d95761a8712 to start an election
I20260709 13:10:30.930199 26582 consensus_queue.cc:237] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.935402 26317 raft_consensus.cc:2468] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:30.937111 26241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fab30bd62b7440face1864b386606e6"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
 from {username='slave'} at 127.0.0.1:56346
I20260709 13:10:30.937666 26241 raft_consensus.cc:493] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.938385 26241 raft_consensus.cc:3060] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.939230 26140 catalog_manager.cc:5697] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 1 to 2, leader changed from c451651b617341639688174fd5e3d173 (127.14.45.2) to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.944573 26241 raft_consensus.cc:515] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.951203 26391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fab30bd62b7440face1864b386606e6" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:30.951879 26572 consensus_queue.cc:1048] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.951812 26391 raft_consensus.cc:3060] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.954660 26572 consensus_queue.cc:1048] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.955639 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fab30bd62b7440face1864b386606e6" candidate_uuid: "1f14905185ba41b5954e2d95761a8712" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:30.956281 26317 raft_consensus.cc:3055] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.956605 26317 raft_consensus.cc:740] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:30.958958 26241 leader_election.cc:290] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Requested vote from peers c451651b617341639688174fd5e3d173 (127.14.45.2:37969), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:30.960994 26391 raft_consensus.cc:2468] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:30.961831 26390 raft_consensus.cc:1240] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Rejecting Update request from peer c451651b617341639688174fd5e3d173 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:30.962280 26317 consensus_queue.cc:260] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.963701 26475 consensus_queue.cc:1048] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.964262 26317 raft_consensus.cc:3060] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.966100 26208 leader_election.cc:304] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:30.966995 26558 raft_consensus.cc:2804] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.967476 26558 raft_consensus.cc:697] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Becoming Leader. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:30.968255 26558 consensus_queue.cc:237] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:30.972781 26317 raft_consensus.cc:2468] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f14905185ba41b5954e2d95761a8712 in term 2.
I20260709 13:10:30.978734 26572 consensus_queue.cc:1048] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.991575 26475 consensus_queue.cc:1048] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.991576 26139 catalog_manager.cc:5697] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 reported cstate change: term changed from 1 to 2, leader changed from c451651b617341639688174fd5e3d173 (127.14.45.2) to 1f14905185ba41b5954e2d95761a8712 (127.14.45.1). New cstate: current_term: 2 leader_uuid: "1f14905185ba41b5954e2d95761a8712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.003755 26475 consensus_queue.cc:1048] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.019392 26560 consensus_queue.cc:1048] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.028931 26594 raft_consensus.cc:993] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:31.029429 26560 raft_consensus.cc:1081] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:31.031036 26316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1"
dest_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:32892
I20260709 13:10:31.031683 26316 raft_consensus.cc:493] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:31.032109 26316 raft_consensus.cc:3060] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.037271 26316 raft_consensus.cc:515] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:31.039343 26316 leader_election.cc:290] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:31.040109 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:31.040499 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68724e03ae474ba4a5b3981e0d17a2c1" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:31.040779 26243 raft_consensus.cc:3060] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.041100 26392 raft_consensus.cc:3055] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:31.041394 26392 raft_consensus.cc:740] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:31.042165 26392 consensus_queue.cc:260] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:31.043318 26392 raft_consensus.cc:3060] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.047614 26243 raft_consensus.cc:2468] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:31.049078 26283 leader_election.cc:304] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f14905185ba41b5954e2d95761a8712, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:31.049576 26392 raft_consensus.cc:2468] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:31.049817 26517 raft_consensus.cc:2804] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:31.050374 26517 raft_consensus.cc:697] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:31.051198 26517 consensus_queue.cc:237] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:31.057401 26140 catalog_manager.cc:5697] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.111505 26517 consensus_queue.cc:1048] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.122997 26517 consensus_queue.cc:1048] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.218647 26560 consensus_queue.cc:1048] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.226022 26594 raft_consensus.cc:993] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: : Instructing follower c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:31.226591 26475 raft_consensus.cc:1081] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Signalling peer c451651b617341639688174fd5e3d173 to start an election
I20260709 13:10:31.228346 26316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921"
dest_uuid: "c451651b617341639688174fd5e3d173"
 from {username='slave'} at 127.0.0.1:32892
I20260709 13:10:31.229313 26316 raft_consensus.cc:493] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:31.229696 26316 raft_consensus.cc:3060] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.234162 26475 consensus_queue.cc:1048] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.237342 26316 raft_consensus.cc:515] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:31.240252 26241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:31.240839 26316 leader_election.cc:290] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3:42997)
I20260709 13:10:31.242321 26392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d1c7c95c004e30926c6c62ed776921" candidate_uuid: "c451651b617341639688174fd5e3d173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
I20260709 13:10:31.243251 26392 raft_consensus.cc:3055] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:31.243664 26392 raft_consensus.cc:740] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:31.244670 26392 consensus_queue.cc:260] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:31.245723 26392 raft_consensus.cc:3060] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.252552 26392 raft_consensus.cc:2468] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c451651b617341639688174fd5e3d173 in term 2.
I20260709 13:10:31.253554 26283 leader_election.cc:304] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 1f14905185ba41b5954e2d95761a8712
I20260709 13:10:31.254427 26570 raft_consensus.cc:2804] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:31.255076 26570 raft_consensus.cc:697] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Leader. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:31.255865 26570 consensus_queue.cc:237] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:31.262880 26140 catalog_manager.cc:5697] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 reported cstate change: term changed from 1 to 2, leader changed from 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3) to c451651b617341639688174fd5e3d173 (127.14.45.2). New cstate: current_term: 2 leader_uuid: "c451651b617341639688174fd5e3d173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.343685 26392 raft_consensus.cc:1275] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.345068 26540 consensus_queue.cc:1048] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.356914 26316 raft_consensus.cc:1275] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.358284 26540 consensus_queue.cc:1048] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.449011 26243 raft_consensus.cc:1275] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.449021 26316 raft_consensus.cc:1275] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.450500 26570 consensus_queue.cc:1048] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.450649 26540 consensus_queue.cc:1048] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.459990 26391 raft_consensus.cc:1275] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer 1f14905185ba41b5954e2d95761a8712: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.463985 26558 consensus_queue.cc:1048] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.464531 26392 raft_consensus.cc:1275] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.466392 26570 consensus_queue.cc:1048] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.702203 26392 raft_consensus.cc:1275] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.703444 26517 consensus_queue.cc:1048] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.709205 26241 raft_consensus.cc:3060] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.717650 26241 raft_consensus.cc:1275] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Refusing update from remote peer c451651b617341639688174fd5e3d173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.719031 26517 consensus_queue.cc:1048] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.923378 26139 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56772:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:33.948329 26139 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56772:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:34.009364 14516 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:34.160259 26619 log.cc:927] Time spent T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
W20260709 13:10:34.261660 26207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.2:37969, user_credentials={real_user=slave}} blocked reactor thread for 77060us
I20260709 13:10:34.261777 26643 tablet.cc:1724] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:34.303432 26652 log.cc:927] Time spent T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:10:34.303979 26639 log.cc:927] Time spent T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: Append to log took a long time: real 0.154s	user 0.000s	sys 0.003s
I20260709 13:10:34.273211 26648 tablet.cc:1724] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.357576 26658 tablet.cc:1724] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.357890 26662 tablet.cc:1724] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.361088 26665 tablet.cc:1724] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.361164 26663 tablet.cc:1724] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:34.371968 26357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:38735, user_credentials={real_user=slave}} blocked reactor thread for 54946.9us
I20260709 13:10:34.410575 26649 tablet.cc:1724] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:34.412488 26646 log.cc:927] Time spent T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: Append to log took a long time: real 0.197s	user 0.003s	sys 0.000s
I20260709 13:10:34.411487 26661 tablet.cc:1724] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.404738 26657 tablet.cc:1724] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.455677 26643 tablet.cc:1724] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.460263 26658 tablet.cc:1724] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.499114 26315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0"
dest_uuid: "c451651b617341639688174fd5e3d173"
mode: GRACEFUL
new_leader_uuid: "0d9d330f85b14acf9283b9fadb609f61"
 from {username='slave'} at 127.0.0.1:35204
I20260709 13:10:34.500191 26315 raft_consensus.cc:606] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Received request to transfer leadership to TS 0d9d330f85b14acf9283b9fadb609f61
W20260709 13:10:34.503423 26208 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.3:42997, user_credentials={real_user=slave}} blocked reactor thread for 71023.3us
I20260709 13:10:34.508837 26672 tablet.cc:1724] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.515797 26657 tablet.cc:1724] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.480921 26648 tablet.cc:1724] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.521754 26661 tablet.cc:1724] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.526290 26665 tablet.cc:1724] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:34.538714 26283 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.45.1:38735, user_credentials={real_user=slave}} blocked reactor thread for 94531.3us
I20260709 13:10:34.543360 26671 tablet.cc:1724] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.531247 26663 tablet.cc:1724] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.572654 26658 tablet.cc:1724] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.574841 26672 tablet.cc:1724] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.575058 26643 tablet.cc:1724] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.607746 26648 tablet.cc:1724] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.610952 26662 tablet.cc:1724] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.622033 26675 tablet.cc:1724] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.624734 26649 tablet.cc:1724] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.632145 26667 raft_consensus.cc:993] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: : Instructing follower 0d9d330f85b14acf9283b9fadb609f61 to start an election
I20260709 13:10:34.635298 26637 raft_consensus.cc:1081] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Signalling peer 0d9d330f85b14acf9283b9fadb609f61 to start an election
I20260709 13:10:34.639307 26671 tablet.cc:1724] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.642953 26386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
 from {username='slave'} at 127.0.0.1:49950
I20260709 13:10:34.643764 26386 raft_consensus.cc:493] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.646143 26386 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.671486 26242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524"
dest_uuid: "1f14905185ba41b5954e2d95761a8712"
mode: GRACEFUL
new_leader_uuid: "0d9d330f85b14acf9283b9fadb609f61"
 from {username='slave'} at 127.0.0.1:56322
I20260709 13:10:34.672271 26242 raft_consensus.cc:606] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Received request to transfer leadership to TS 0d9d330f85b14acf9283b9fadb609f61
I20260709 13:10:34.674163 14516 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:34.675024 14516 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:34.663605 26675 tablet.cc:1724] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.678884 26386 raft_consensus.cc:515] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:34.683096 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:34.683883 26242 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.690989 26386 leader_election.cc:290] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 3 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:34.692252 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0783e05e1d4e4a978872352c431cb1a0" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:34.693030 26317 raft_consensus.cc:3055] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.693321 26317 raft_consensus.cc:740] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c451651b617341639688174fd5e3d173, State: Running, Role: LEADER
I20260709 13:10:34.694238 26317 consensus_queue.cc:260] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:34.694581 26242 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 3.
I20260709 13:10:34.695714 26317 raft_consensus.cc:3060] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.696535 26357 leader_election.cc:304] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, 1f14905185ba41b5954e2d95761a8712; no voters: 
I20260709 13:10:34.697826 26660 raft_consensus.cc:2804] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.698405 26660 raft_consensus.cc:697] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:34.699383 26660 consensus_queue.cc:237] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:34.702253 26140 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6: soft_deleted_table [id=aac029306d29450599175d65992037f2] alter complete (version 1)
I20260709 13:10:34.709359 26317 raft_consensus.cc:2468] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 3.
I20260709 13:10:34.722631 26140 catalog_manager.cc:5697] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 2 to 3, leader changed from c451651b617341639688174fd5e3d173 (127.14.45.2) to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.066046 26633 raft_consensus.cc:993] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: : Instructing follower 0d9d330f85b14acf9283b9fadb609f61 to start an election
I20260709 13:10:35.066836 26644 raft_consensus.cc:1081] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Signalling peer 0d9d330f85b14acf9283b9fadb609f61 to start an election
I20260709 13:10:35.068514 26391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524"
dest_uuid: "0d9d330f85b14acf9283b9fadb609f61"
 from {username='slave'} at 127.0.0.1:49966
I20260709 13:10:35.069080 26391 raft_consensus.cc:493] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.069326 26391 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.074462 26391 raft_consensus.cc:515] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:35.075851 26391 leader_election.cc:290] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 3 election: Requested vote from peers 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735), c451651b617341639688174fd5e3d173 (127.14.45.2:37969)
I20260709 13:10:35.076941 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f14905185ba41b5954e2d95761a8712"
I20260709 13:10:35.077222 26317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21f80a24abf4d4cb5d9513296234524" candidate_uuid: "0d9d330f85b14acf9283b9fadb609f61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c451651b617341639688174fd5e3d173"
I20260709 13:10:35.077605 26242 raft_consensus.cc:3055] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:35.077939 26317 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.078023 26242 raft_consensus.cc:740] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f14905185ba41b5954e2d95761a8712, State: Running, Role: LEADER
I20260709 13:10:35.079027 26242 consensus_queue.cc:260] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:35.080093 26242 raft_consensus.cc:3060] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.084148 26317 raft_consensus.cc:2468] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 3.
I20260709 13:10:35.085457 26242 raft_consensus.cc:2468] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d9d330f85b14acf9283b9fadb609f61 in term 3.
I20260709 13:10:35.085770 26356 leader_election.cc:304] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9d330f85b14acf9283b9fadb609f61, c451651b617341639688174fd5e3d173; no voters: 
I20260709 13:10:35.086757 26660 raft_consensus.cc:2804] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:35.087281 26660 raft_consensus.cc:697] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 LEADER]: Becoming Leader. State: Replica: 0d9d330f85b14acf9283b9fadb609f61, State: Running, Role: LEADER
I20260709 13:10:35.088186 26660 consensus_queue.cc:237] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } }
I20260709 13:10:35.095569 26317 raft_consensus.cc:1275] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Refusing update from remote peer 0d9d330f85b14acf9283b9fadb609f61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:35.096858 26660 consensus_queue.cc:1048] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.097476 26140 catalog_manager.cc:5697] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 reported cstate change: term changed from 2 to 3, leader changed from 1f14905185ba41b5954e2d95761a8712 (127.14.45.1) to 0d9d330f85b14acf9283b9fadb609f61 (127.14.45.3). New cstate: current_term: 3 leader_uuid: "0d9d330f85b14acf9283b9fadb609f61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9d330f85b14acf9283b9fadb609f61" member_type: VOTER last_known_addr { host: "127.14.45.3" port: 42997 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.112393 26242 raft_consensus.cc:1275] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Refusing update from remote peer 0d9d330f85b14acf9283b9fadb609f61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:35.114176 26660 consensus_queue.cc:1048] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.521457 26242 raft_consensus.cc:1275] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Refusing update from remote peer 0d9d330f85b14acf9283b9fadb609f61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:35.523111 26560 consensus_queue.cc:1048] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f14905185ba41b5954e2d95761a8712" member_type: VOTER last_known_addr { host: "127.14.45.1" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.532775 26318 raft_consensus.cc:1275] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Refusing update from remote peer 0d9d330f85b14acf9283b9fadb609f61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:35.534545 26560 consensus_queue.cc:1048] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c451651b617341639688174fd5e3d173" member_type: VOTER last_known_addr { host: "127.14.45.2" port: 37969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.738763 14516 tablet_server.cc:179] TabletServer@127.14.45.1:0 shutting down...
W20260709 13:10:35.751117 26283 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:10:35.756732 26283 consensus_peers.cc:597] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 -> Peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Couldn't send request to peer 1f14905185ba41b5954e2d95761a8712. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:35.777225 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:35.778272 14516 tablet_replica.cc:333] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.779140 14516 raft_consensus.cc:2243] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.779646 14516 raft_consensus.cc:2272] T 8458a2764a2c4f378500b113c748fe5c P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.781916 14516 tablet_replica.cc:333] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.782743 14516 raft_consensus.cc:2243] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.783332 14516 raft_consensus.cc:2272] T 68d1c7c95c004e30926c6c62ed776921 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.785959 14516 tablet_replica.cc:333] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.786588 14516 raft_consensus.cc:2243] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.786995 14516 raft_consensus.cc:2272] T b20370852b9847a287f634b1121d18e0 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.789148 14516 tablet_replica.cc:333] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.789723 14516 raft_consensus.cc:2243] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.790228 14516 raft_consensus.cc:2272] T 68724e03ae474ba4a5b3981e0d17a2c1 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.792177 14516 tablet_replica.cc:333] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.792695 14516 raft_consensus.cc:2243] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.793076 14516 raft_consensus.cc:2272] T 11db461c9b5e4ab9963e3a6098b4a280 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.795254 14516 tablet_replica.cc:333] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.795794 14516 raft_consensus.cc:2243] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.796571 14516 raft_consensus.cc:2272] T 7fab30bd62b7440face1864b386606e6 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.798610 14516 tablet_replica.cc:333] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.799274 14516 raft_consensus.cc:2243] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.799698 14516 raft_consensus.cc:2272] T 6dc47b53a429438caae05c72fbd92d55 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.801935 14516 tablet_replica.cc:333] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.802439 14516 raft_consensus.cc:2243] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.803149 14516 raft_consensus.cc:2272] T bc6eaa67c284473eaeacae1b3c3cc529 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.805085 14516 tablet_replica.cc:333] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.805584 14516 raft_consensus.cc:2243] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.806377 14516 raft_consensus.cc:2272] T da9811da76234d248601c049234b1715 P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.808302 14516 tablet_replica.cc:333] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.808794 14516 raft_consensus.cc:2243] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.809162 14516 raft_consensus.cc:2272] T e21f80a24abf4d4cb5d9513296234524 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.812099 14516 tablet_replica.cc:333] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.812652 14516 raft_consensus.cc:2243] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.813429 14516 raft_consensus.cc:2272] T 919b09826ea6430ca668c7fa5da03da8 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.815871 14516 tablet_replica.cc:333] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.816427 14516 raft_consensus.cc:2243] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.817348 14516 raft_consensus.cc:2272] T 72267794052e4aa093b82b0f3dfbdb9b P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.819692 14516 tablet_replica.cc:333] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.820364 14516 raft_consensus.cc:2243] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.820940 14516 raft_consensus.cc:2272] T 50b21924c6014b46bad1da33b5e0c762 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:35.821615 26283 consensus_peers.cc:597] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 -> Peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Couldn't send request to peer 1f14905185ba41b5954e2d95761a8712. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:35.823879 14516 tablet_replica.cc:333] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.824592 14516 raft_consensus.cc:2243] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.825399 14516 raft_consensus.cc:2272] T f39b31d8b1314efb8f651537358cbdea P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.827872 14516 tablet_replica.cc:333] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.828462 14516 raft_consensus.cc:2243] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.828930 14516 raft_consensus.cc:2272] T 83ac0f456c1a4de793143b4f18022e23 P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.831230 14516 tablet_replica.cc:333] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.831718 14516 raft_consensus.cc:2243] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.832634 14516 raft_consensus.cc:2272] T 4baacc60c89348408762da7b3fa6324f P 1f14905185ba41b5954e2d95761a8712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.834743 14516 tablet_replica.cc:333] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.835213 14516 raft_consensus.cc:2243] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.835565 14516 raft_consensus.cc:2272] T 0783e05e1d4e4a978872352c431cb1a0 P 1f14905185ba41b5954e2d95761a8712 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.838722 14516 tablet_replica.cc:333] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712: stopping tablet replica
I20260709 13:10:35.839191 14516 raft_consensus.cc:2243] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.839596 14516 raft_consensus.cc:2272] T dd011093018d45e997e63cc542fa9c4c P 1f14905185ba41b5954e2d95761a8712 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.882596 14516 tablet_server.cc:196] TabletServer@127.14.45.1:0 shutdown complete.
I20260709 13:10:35.921731 14516 tablet_server.cc:179] TabletServer@127.14.45.2:0 shutting down...
I20260709 13:10:35.952658 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:35.953362 14516 tablet_replica.cc:333] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.954226 14516 raft_consensus.cc:2243] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.954768 14516 raft_consensus.cc:2272] T 8458a2764a2c4f378500b113c748fe5c P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.956997 14516 tablet_replica.cc:333] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.957643 14516 raft_consensus.cc:2243] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.958734 14516 raft_consensus.cc:2272] T 68724e03ae474ba4a5b3981e0d17a2c1 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.961867 14516 tablet_replica.cc:333] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.962781 14516 raft_consensus.cc:2243] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:35.963397 26356 consensus_peers.cc:597] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 -> Peer c451651b617341639688174fd5e3d173 (127.14.45.2:37969): Couldn't send request to peer c451651b617341639688174fd5e3d173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:35.963809 14516 raft_consensus.cc:2272] T b20370852b9847a287f634b1121d18e0 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.966996 14516 tablet_replica.cc:333] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.967780 14516 raft_consensus.cc:2243] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.968619 14516 raft_consensus.cc:2272] T 68d1c7c95c004e30926c6c62ed776921 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.970775 14516 tablet_replica.cc:333] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.971450 14516 raft_consensus.cc:2243] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.972368 14516 raft_consensus.cc:2272] T 11db461c9b5e4ab9963e3a6098b4a280 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.975633 14516 tablet_replica.cc:333] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.976634 14516 raft_consensus.cc:2243] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.977377 14516 raft_consensus.cc:2272] T 7fab30bd62b7440face1864b386606e6 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.980232 14516 tablet_replica.cc:333] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.981112 14516 raft_consensus.cc:2243] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.981817 14516 raft_consensus.cc:2272] T da9811da76234d248601c049234b1715 P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.984540 14516 tablet_replica.cc:333] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.985112 14516 raft_consensus.cc:2243] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.985528 14516 raft_consensus.cc:2272] T e21f80a24abf4d4cb5d9513296234524 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.988380 14516 tablet_replica.cc:333] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.988976 14516 raft_consensus.cc:2243] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:35.989886 14516 raft_consensus.cc:2272] T 50b21924c6014b46bad1da33b5e0c762 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.992183 14516 tablet_replica.cc:333] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.992710 14516 raft_consensus.cc:2243] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.993160 14516 raft_consensus.cc:2272] T 919b09826ea6430ca668c7fa5da03da8 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.995970 14516 tablet_replica.cc:333] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:35.996577 14516 raft_consensus.cc:2243] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.997089 14516 raft_consensus.cc:2272] T 72267794052e4aa093b82b0f3dfbdb9b P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.999552 14516 tablet_replica.cc:333] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.000131 14516 raft_consensus.cc:2243] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.000613 14516 raft_consensus.cc:2272] T 83ac0f456c1a4de793143b4f18022e23 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.002970 14516 tablet_replica.cc:333] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.003523 14516 raft_consensus.cc:2243] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.003945 14516 raft_consensus.cc:2272] T 4baacc60c89348408762da7b3fa6324f P c451651b617341639688174fd5e3d173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.006139 14516 tablet_replica.cc:333] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.006625 14516 raft_consensus.cc:2243] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.007020 14516 raft_consensus.cc:2272] T 0783e05e1d4e4a978872352c431cb1a0 P c451651b617341639688174fd5e3d173 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.009958 14516 tablet_replica.cc:333] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.010507 14516 raft_consensus.cc:2243] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.011448 14516 raft_consensus.cc:2272] T 6dc47b53a429438caae05c72fbd92d55 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.014350 14516 tablet_replica.cc:333] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.014999 14516 raft_consensus.cc:2243] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.015535 14516 raft_consensus.cc:2272] T bc6eaa67c284473eaeacae1b3c3cc529 P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.017705 14516 tablet_replica.cc:333] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.018313 14516 raft_consensus.cc:2243] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.018963 14516 raft_consensus.cc:2272] T f39b31d8b1314efb8f651537358cbdea P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.021042 14516 tablet_replica.cc:333] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173: stopping tablet replica
I20260709 13:10:36.021553 14516 raft_consensus.cc:2243] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.022406 14516 raft_consensus.cc:2272] T dd011093018d45e997e63cc542fa9c4c P c451651b617341639688174fd5e3d173 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.064100 14516 tablet_server.cc:196] TabletServer@127.14.45.2:0 shutdown complete.
I20260709 13:10:36.097757 14516 tablet_server.cc:179] TabletServer@127.14.45.3:0 shutting down...
W20260709 13:10:36.112336 26357 consensus_peers.cc:597] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 -> Peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Couldn't send request to peer 1f14905185ba41b5954e2d95761a8712. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.131280 26357 consensus_peers.cc:597] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 -> Peer 1f14905185ba41b5954e2d95761a8712 (127.14.45.1:38735): Couldn't send request to peer 1f14905185ba41b5954e2d95761a8712. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.1:38735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.135142 14516 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:36.136061 14516 tablet_replica.cc:333] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.136857 14516 raft_consensus.cc:2243] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.137806 14516 raft_consensus.cc:2272] T 8458a2764a2c4f378500b113c748fe5c P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.140086 14516 tablet_replica.cc:333] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.140798 14516 raft_consensus.cc:2243] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.141319 14516 raft_consensus.cc:2272] T b20370852b9847a287f634b1121d18e0 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.143627 14516 tablet_replica.cc:333] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.144308 14516 raft_consensus.cc:2243] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.144934 14516 raft_consensus.cc:2272] T 68724e03ae474ba4a5b3981e0d17a2c1 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.148351 14516 tablet_replica.cc:333] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.149380 14516 raft_consensus.cc:2243] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.150033 14516 raft_consensus.cc:2272] T 68d1c7c95c004e30926c6c62ed776921 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.150533 26356 consensus_peers.cc:597] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 -> Peer c451651b617341639688174fd5e3d173 (127.14.45.2:37969): Couldn't send request to peer c451651b617341639688174fd5e3d173. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:37969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.152501 14516 tablet_replica.cc:333] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.153223 14516 raft_consensus.cc:2243] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.153693 14516 raft_consensus.cc:2272] T 11db461c9b5e4ab9963e3a6098b4a280 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.155781 14516 tablet_replica.cc:333] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.156394 14516 raft_consensus.cc:2243] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.156817 14516 raft_consensus.cc:2272] T 7fab30bd62b7440face1864b386606e6 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.158972 14516 tablet_replica.cc:333] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.159535 14516 raft_consensus.cc:2243] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.159966 14516 raft_consensus.cc:2272] T da9811da76234d248601c049234b1715 P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.162310 14516 tablet_replica.cc:333] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.162884 14516 raft_consensus.cc:2243] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.163698 14516 raft_consensus.cc:2272] T e21f80a24abf4d4cb5d9513296234524 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.166595 14516 tablet_replica.cc:333] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.167177 14516 raft_consensus.cc:2243] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.167671 14516 raft_consensus.cc:2272] T 919b09826ea6430ca668c7fa5da03da8 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.170025 14516 tablet_replica.cc:333] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.170881 14516 raft_consensus.cc:2243] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.171612 14516 raft_consensus.cc:2272] T 50b21924c6014b46bad1da33b5e0c762 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.174428 14516 tablet_replica.cc:333] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
W20260709 13:10:36.174978 26356 consensus_peers.cc:597] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 -> Peer c451651b617341639688174fd5e3d173 (127.14.45.2:37969): Couldn't send request to peer c451651b617341639688174fd5e3d173. Status: Network error: Client connection negotiation failed: client connection to 127.14.45.2:37969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.175264 14516 raft_consensus.cc:2243] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.175925 14516 raft_consensus.cc:2272] T 72267794052e4aa093b82b0f3dfbdb9b P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.178115 14516 tablet_replica.cc:333] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.178742 14516 raft_consensus.cc:2243] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.179572 14516 raft_consensus.cc:2272] T 83ac0f456c1a4de793143b4f18022e23 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.181903 14516 tablet_replica.cc:333] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.182430 14516 raft_consensus.cc:2243] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.182857 14516 raft_consensus.cc:2272] T 4baacc60c89348408762da7b3fa6324f P 0d9d330f85b14acf9283b9fadb609f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.184947 14516 tablet_replica.cc:333] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.185462 14516 raft_consensus.cc:2243] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.185958 14516 raft_consensus.cc:2272] T bc6eaa67c284473eaeacae1b3c3cc529 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.188095 14516 tablet_replica.cc:333] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.188617 14516 raft_consensus.cc:2243] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.189052 14516 raft_consensus.cc:2272] T 6dc47b53a429438caae05c72fbd92d55 P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.191159 14516 tablet_replica.cc:333] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.191697 14516 raft_consensus.cc:2243] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.192129 14516 raft_consensus.cc:2272] T f39b31d8b1314efb8f651537358cbdea P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.194331 14516 tablet_replica.cc:333] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.194845 14516 raft_consensus.cc:2243] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.195864 14516 raft_consensus.cc:2272] T 0783e05e1d4e4a978872352c431cb1a0 P 0d9d330f85b14acf9283b9fadb609f61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.198221 14516 tablet_replica.cc:333] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61: stopping tablet replica
I20260709 13:10:36.198719 14516 raft_consensus.cc:2243] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.199186 14516 raft_consensus.cc:2272] T dd011093018d45e997e63cc542fa9c4c P 0d9d330f85b14acf9283b9fadb609f61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.242372 14516 tablet_server.cc:196] TabletServer@127.14.45.3:0 shutdown complete.
I20260709 13:10:36.277827 14516 master.cc:562] Master@127.14.45.62:46723 shutting down...
I20260709 13:10:36.304872 14516 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.305480 14516 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.305888 14516 tablet_replica.cc:333] T 00000000000000000000000000000000 P 397b595eb2b8468f8c9a7af0eb3a4aa6: stopping tablet replica
I20260709 13:10:36.327705 14516 master.cc:584] Master@127.14.45.62:46723 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11470 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26348 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (344093 ms total)
[  PASSED  ] 8 tests.
I20260709 13:10:36.392409 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 429 messages since previous log ~14 seconds ago
I20260709 13:10:36.392642 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 427 messages since previous log ~14 seconds ago
I20260709 13:10:36.392789 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 424 messages since previous log ~14 seconds ago
I20260709 13:10:36.392944 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:10:36.393086 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:36.393225 14516 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~145 seconds ago
I20260709 13:10:36.393358 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~145 seconds ago
I20260709 13:10:36.393505 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 12 messages since previous log ~171 seconds ago
I20260709 13:10:36.393718 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:10:36.394243 14516 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
